[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:31:04 dist-test-slave-zkpd krb5kdc[26897](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:31:04 dist-test-slave-zkpd krb5kdc[26897](info): set up 2 sockets
Aug 08 11:31:04 dist-test-slave-zkpd krb5kdc[26897](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 11:31:05.327564 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.098s user 0.008s sys 0.014s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:31:05 dist-test-slave-zkpd krb5kdc[26897](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188665, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:31:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:31:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:31:05.529891 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:34003
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:42017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:34003
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:05.877064 26911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:05.877489 26911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:05.877640 26911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:05.885195 26911 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:31:05.885295 26911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:05.885399 26911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:05.885569 26911 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:31:05.885646 26911 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:31:05.895974 26911 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:42017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:34003
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:34003
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:05.897368 26911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:05.898693 26911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:05.911048 26920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:05.911082 26918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:05.911216 26917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:05.911765 26911 server_base.cc:1034] running on GCE node
I20260808 11:31:05.912539 26911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:05.913841 26911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:05.915059 26911 hybrid_clock.cc:648] HybridClock initialized: now 1786188665914986 us; error 46 us; skew 500 ppm
I20260808 11:31:05.915361 26911 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:05 dist-test-slave-zkpd krb5kdc[26897](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188665, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:05.918503 26911 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:31:05.919960 26911 webserver.cc:460] Webserver started at http://127.26.66.190:35723/ using document root <none> and password file <none>
I20260808 11:31:05.920594 26911 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:05.920693 26911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:05.920940 26911 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:05.923962 26911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "b723c3c680274417b90f4588e1a04d05"
format_stamp: "Formatted at 2026-08-08 11:31:05 on dist-test-slave-zkpd"
server_key: "428c0ed62a3cee1b0ea1141f542a3141"
server_key_iv: "a7f58249bbbee5673b0374fdc09fe309"
server_key_version: "encryptionkey@0"
I20260808 11:31:05.924711 26911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "b723c3c680274417b90f4588e1a04d05"
format_stamp: "Formatted at 2026-08-08 11:31:05 on dist-test-slave-zkpd"
server_key: "428c0ed62a3cee1b0ea1141f542a3141"
server_key_iv: "a7f58249bbbee5673b0374fdc09fe309"
server_key_version: "encryptionkey@0"
I20260808 11:31:05.929742 26911 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 11:31:05.933089 26927 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:05.934391 26911 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260808 11:31:05.934531 26911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "b723c3c680274417b90f4588e1a04d05"
format_stamp: "Formatted at 2026-08-08 11:31:05 on dist-test-slave-zkpd"
server_key: "428c0ed62a3cee1b0ea1141f542a3141"
server_key_iv: "a7f58249bbbee5673b0374fdc09fe309"
server_key_version: "encryptionkey@0"
I20260808 11:31:05.934685 26911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:05.956023 26911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:05.960338 26911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:05.960583 26911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:05.981124 26911 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:34003
I20260808 11:31:05.981156 26981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:34003 every 8 connection(s)
I20260808 11:31:05.982510 26911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:31:05.986222 26982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:05.989646 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 26911
I20260808 11:31:05.989959 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:31:05.991750 26890 external_mini_cluster.cc:1428] Setting key 68a624fc0016c431248b3e357e001b6b
I20260808 11:31:05.996562 26982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b723c3c680274417b90f4588e1a04d05: Bootstrap starting.
I20260808 11:31:05.999672 26982 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b723c3c680274417b90f4588e1a04d05: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:06.000733 26982 log.cc:824] T 00000000000000000000000000000000 P b723c3c680274417b90f4588e1a04d05: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:06.003399 26982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b723c3c680274417b90f4588e1a04d05: No bootstrap required, opened a new log
I20260808 11:31:06.013253 26982 raft_consensus.cc:348] T 00000000000000000000000000000000 P b723c3c680274417b90f4588e1a04d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b723c3c680274417b90f4588e1a04d05" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 34003 } }
I20260808 11:31:06.013680 26982 raft_consensus.cc:374] T 00000000000000000000000000000000 P b723c3c680274417b90f4588e1a04d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:06.013800 26982 raft_consensus.cc:729] T 00000000000000000000000000000000 P b723c3c680274417b90f4588e1a04d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b723c3c680274417b90f4588e1a04d05, State: Initialized, Role: FOLLOWER
I20260808 11:31:06.014460 26982 consensus_queue.cc:260] T 00000000000000000000000000000000 P b723c3c680274417b90f4588e1a04d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b723c3c680274417b90f4588e1a04d05" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 34003 } }
I20260808 11:31:06.014732 26982 raft_consensus.cc:388] T 00000000000000000000000000000000 P b723c3c680274417b90f4588e1a04d05 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:31:06.014961 26982 raft_consensus.cc:482] T 00000000000000000000000000000000 P b723c3c680274417b90f4588e1a04d05 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:31:06.015146 26982 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b723c3c680274417b90f4588e1a04d05 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:06.018002 26982 raft_consensus.cc:504] T 00000000000000000000000000000000 P b723c3c680274417b90f4588e1a04d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b723c3c680274417b90f4588e1a04d05" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 34003 } }
I20260808 11:31:06.018503 26982 leader_election.cc:302] T 00000000000000000000000000000000 P b723c3c680274417b90f4588e1a04d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b723c3c680274417b90f4588e1a04d05; no voters:
I20260808 11:31:06.019207 26982 leader_election.cc:288] T 00000000000000000000000000000000 P b723c3c680274417b90f4588e1a04d05 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:31:06.019387 26987 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b723c3c680274417b90f4588e1a04d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:31:06.021291 26982 sys_catalog.cc:564] T 00000000000000000000000000000000 P b723c3c680274417b90f4588e1a04d05 [sys.catalog]: configured and running, proceeding with master startup.
Aug 08 11:31:06 dist-test-slave-zkpd krb5kdc[26897](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188665, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:06.025987 26987 raft_consensus.cc:686] T 00000000000000000000000000000000 P b723c3c680274417b90f4588e1a04d05 [term 1 LEADER]: Becoming Leader. State: Replica: b723c3c680274417b90f4588e1a04d05, State: Running, Role: LEADER
I20260808 11:31:06.026542 26987 consensus_queue.cc:237] T 00000000000000000000000000000000 P b723c3c680274417b90f4588e1a04d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b723c3c680274417b90f4588e1a04d05" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 34003 } }
I20260808 11:31:06.030344 26988 sys_catalog.cc:455] T 00000000000000000000000000000000 P b723c3c680274417b90f4588e1a04d05 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b723c3c680274417b90f4588e1a04d05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b723c3c680274417b90f4588e1a04d05" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 34003 } } }
I20260808 11:31:06.030712 26988 sys_catalog.cc:458] T 00000000000000000000000000000000 P b723c3c680274417b90f4588e1a04d05 [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:06.035125 26989 sys_catalog.cc:455] T 00000000000000000000000000000000 P b723c3c680274417b90f4588e1a04d05 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b723c3c680274417b90f4588e1a04d05. Latest consensus state: current_term: 1 leader_uuid: "b723c3c680274417b90f4588e1a04d05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b723c3c680274417b90f4588e1a04d05" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 34003 } } }
I20260808 11:31:06.035519 26989 sys_catalog.cc:458] T 00000000000000000000000000000000 P b723c3c680274417b90f4588e1a04d05 [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:06.040253 26984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:05.995513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53764 (local address 127.26.66.190:34003)
0808 11:31:05.996464 (+ 951us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:05.996479 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:05.997814 (+ 1335us) server_negotiation.cc:407] Connection header received
0808 11:31:06.008490 (+ 10676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:06.008517 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:06.009003 (+ 486us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:06.009462 (+ 459us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:06.012191 (+ 2729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:06.014275 (+ 2084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:06.016201 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:06.017259 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:06.017443 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:06.025940 (+ 8497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:06.025962 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:06.025992 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:06.026060 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:06.031732 (+ 5672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:06.033162 (+ 1430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:06.033174 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:06.033185 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:06.033488 (+ 303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:06.034222 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:06.034230 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:06.034236 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:06.035037 (+ 801us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:06.035558 (+ 521us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:06.037962 (+ 2404us) server_negotiation.cc:299] Negotiation successful
0808 11:31:06.038492 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":703,"thread_start_us":460,"threads_started":1}
I20260808 11:31:06.043336 26996 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:31:06.050071 26996 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:31:06.060472 26996 catalog_manager.cc:1347] Generated new cluster ID: 0a0168b3cf574442a1a0a9d9797a8a2f
I20260808 11:31:06.060616 26996 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:31:06.070744 26996 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:31:06.072556 26996 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:31:06.094300 26996 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b723c3c680274417b90f4588e1a04d05: Generated new TSK 0
I20260808 11:31:06.095151 26996 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.66.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
I20260808 11:31:06.156538 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:0
--local_ip_for_outbound_sockets=127.26.66.129
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:34003
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:42017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:06.518251 27008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:06.518540 27008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:06.518710 27008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:06.526129 27008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:06.526273 27008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:06.526474 27008 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:31:06.537021 27008 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:42017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:34003
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:06.538493 27008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:06.540050 27008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:06.553737 27014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:06.553773 27016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:06.553943 27013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:06.554908 27008 server_base.cc:1034] running on GCE node
I20260808 11:31:06.555588 27008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:06.556627 27008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:06.557857 27008 hybrid_clock.cc:648] HybridClock initialized: now 1786188666557821 us; error 30 us; skew 500 ppm
I20260808 11:31:06.558197 27008 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:06 dist-test-slave-zkpd krb5kdc[26897](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188666, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:06.561542 27008 init.cc:377] Logged in from keytab as kudu/127.26.66.129@KRBTEST.COM (short username kudu)
I20260808 11:31:06.563174 27008 webserver.cc:460] Webserver started at http://127.26.66.129:39313/ using document root <none> and password file <none>
I20260808 11:31:06.563979 27008 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:06.564138 27008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:06.564491 27008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:06.567559 27008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-0/data/instance:
uuid: "64fcb6a5cdc94826a9ba4ab602e66aa9"
format_stamp: "Formatted at 2026-08-08 11:31:06 on dist-test-slave-zkpd"
server_key: "550b8558b9594f9d0e5418e71b20dea6"
server_key_iv: "37aa46f5a8e681acc8c6d2caa17b0e35"
server_key_version: "encryptionkey@0"
I20260808 11:31:06.568399 27008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance:
uuid: "64fcb6a5cdc94826a9ba4ab602e66aa9"
format_stamp: "Formatted at 2026-08-08 11:31:06 on dist-test-slave-zkpd"
server_key: "550b8558b9594f9d0e5418e71b20dea6"
server_key_iv: "37aa46f5a8e681acc8c6d2caa17b0e35"
server_key_version: "encryptionkey@0"
I20260808 11:31:06.573654 27008 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260808 11:31:06.577178 27023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:06.578456 27008 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:31:06.578635 27008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "64fcb6a5cdc94826a9ba4ab602e66aa9"
format_stamp: "Formatted at 2026-08-08 11:31:06 on dist-test-slave-zkpd"
server_key: "550b8558b9594f9d0e5418e71b20dea6"
server_key_iv: "37aa46f5a8e681acc8c6d2caa17b0e35"
server_key_version: "encryptionkey@0"
I20260808 11:31:06.578856 27008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:06.593140 27008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:06.597599 27008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:06.597915 27008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:06.598869 27008 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:31:06.600291 27008 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:06.600396 27008 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:06.600553 27008 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:06.600630 27008 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:06.639020 27008 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:36709
I20260808 11:31:06.639070 27139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:36709 every 8 connection(s)
I20260808 11:31:06.640441 27008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:31:06.648422 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 27008
I20260808 11:31:06.648662 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance
I20260808 11:31:06.649366 26890 external_mini_cluster.cc:1428] Setting key 7f21af72937365b7247e32cd310af48c
Aug 08 11:31:06 dist-test-slave-zkpd krb5kdc[26897](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188666, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:06.662549 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:06.643039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:53869 (local address 127.26.66.190:34003)
0808 11:31:06.643536 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:06.643541 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:06.644647 (+ 1106us) server_negotiation.cc:407] Connection header received
0808 11:31:06.646524 (+ 1877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:06.646529 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:06.646616 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:06.646735 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:06.648252 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:06.649178 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:06.651317 (+ 2139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:06.651886 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:06.652052 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:06.655497 (+ 3445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:06.655506 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:06.655514 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:06.655560 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:06.659149 (+ 3589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:06.660131 (+ 982us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:06.660135 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:06.660138 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:06.660258 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:06.660778 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:06.660781 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:06.660783 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:06.661048 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:06.661161 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:06.662108 (+ 947us) server_negotiation.cc:299] Negotiation successful
0808 11:31:06.662279 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":241,"threads_started":1}
I20260808 11:31:06.664217 27144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:06.643670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:34003 (local address 127.26.66.129:53869)
0808 11:31:06.644479 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:06.644518 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:06.646239 (+ 1721us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:06.646977 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:06.646986 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:06.647489 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:06.648077 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:06.648095 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:06.649337 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:06.649342 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:06.651129 (+ 1787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:06.651146 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:06.652121 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:06.652126 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:06.652332 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:06.653054 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:06.653076 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:06.655266 (+ 2190us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:06.659296 (+ 4030us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:06.659306 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:06.659326 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:06.660015 (+ 689us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:06.660375 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:06.660383 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:06.660390 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:06.660661 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:06.661176 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:06.661187 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:06.661661 (+ 474us) client_negotiation.cc:769] Sending connection context
0808 11:31:06.661974 (+ 313us) client_negotiation.cc:240] Negotiation successful
0808 11:31:06.662583 (+ 609us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":340,"threads_started":1}
I20260808 11:31:06.665921 27141 heartbeater.cc:347] Connected to a master server at 127.26.66.190:34003
I20260808 11:31:06.666260 27141 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:06.667037 27141 heartbeater.cc:511] Master 127.26.66.190:34003 requested a full tablet report, sending...
I20260808 11:31:06.669287 26945 ts_manager.cc:194] Registered new tserver with Master: 64fcb6a5cdc94826a9ba4ab602e66aa9 (127.26.66.129:36709)
I20260808 11:31:06.671057 26945 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.129@KRBTEST.COM'} at 127.26.66.129:53869
WARNING: no policy specified for kudu/127.26.66.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
I20260808 11:31:06.698630 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:0
--local_ip_for_outbound_sockets=127.26.66.130
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:34003
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:42017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:07.048723 27147 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:07.049048 27147 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:07.049229 27147 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:07.056406 27147 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:07.056551 27147 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:07.056743 27147 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:31:07.066427 27147 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:42017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:34003
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:07.067739 27147 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:07.069139 27147 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:07.084399 27153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:07.084332 27154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:07.084371 27156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:07.085222 27147 server_base.cc:1034] running on GCE node
I20260808 11:31:07.085863 27147 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:07.086805 27147 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:07.087996 27147 hybrid_clock.cc:648] HybridClock initialized: now 1786188667087947 us; error 40 us; skew 500 ppm
I20260808 11:31:07.088301 27147 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:07 dist-test-slave-zkpd krb5kdc[26897](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188667, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:07.091462 27147 init.cc:377] Logged in from keytab as kudu/127.26.66.130@KRBTEST.COM (short username kudu)
I20260808 11:31:07.092909 27147 webserver.cc:460] Webserver started at http://127.26.66.130:36415/ using document root <none> and password file <none>
I20260808 11:31:07.093606 27147 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:07.093773 27147 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:07.094098 27147 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:07.097052 27147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-1/data/instance:
uuid: "aaf494e140d44a038b85543252e52516"
format_stamp: "Formatted at 2026-08-08 11:31:07 on dist-test-slave-zkpd"
server_key: "b303a83375cea780c52d922a94013ba5"
server_key_iv: "f5b896f21a838348d036b0edb3354842"
server_key_version: "encryptionkey@0"
I20260808 11:31:07.097837 27147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance:
uuid: "aaf494e140d44a038b85543252e52516"
format_stamp: "Formatted at 2026-08-08 11:31:07 on dist-test-slave-zkpd"
server_key: "b303a83375cea780c52d922a94013ba5"
server_key_iv: "f5b896f21a838348d036b0edb3354842"
server_key_version: "encryptionkey@0"
I20260808 11:31:07.102985 27147 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 11:31:07.106462 27163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:07.107714 27147 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 11:31:07.107961 27147 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "aaf494e140d44a038b85543252e52516"
format_stamp: "Formatted at 2026-08-08 11:31:07 on dist-test-slave-zkpd"
server_key: "b303a83375cea780c52d922a94013ba5"
server_key_iv: "f5b896f21a838348d036b0edb3354842"
server_key_version: "encryptionkey@0"
I20260808 11:31:07.108175 27147 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:07.141904 27147 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:07.146418 27147 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:07.146734 27147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:07.147732 27147 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:31:07.149207 27147 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:07.149320 27147 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:07.149487 27147 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:07.149567 27147 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:07.185242 27147 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:36339
I20260808 11:31:07.185264 27280 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:36339 every 8 connection(s)
I20260808 11:31:07.186985 27147 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:31:07.187459 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 27147
I20260808 11:31:07.187692 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance
I20260808 11:31:07.188284 26890 external_mini_cluster.cc:1428] Setting key 992982195fe48daaef07b800be2b118f
Aug 08 11:31:07 dist-test-slave-zkpd krb5kdc[26897](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188667, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:07.210009 27284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:07.191084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:59663 (local address 127.26.66.190:34003)
0808 11:31:07.192354 (+ 1270us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:07.192360 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:07.192382 (+ 22us) server_negotiation.cc:407] Connection header received
0808 11:31:07.193875 (+ 1493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:07.193880 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:07.193963 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:07.194098 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:07.195592 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:07.196421 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:07.197990 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:07.198432 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:07.198566 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:07.202663 (+ 4097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:07.202672 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:07.202679 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:07.202722 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:07.206582 (+ 3860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:07.207343 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:07.207352 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:07.207357 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:07.207533 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:07.208057 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:07.208064 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:07.208071 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:07.208467 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:07.208627 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:07.209322 (+ 695us) server_negotiation.cc:299] Negotiation successful
0808 11:31:07.209569 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1137,"thread_start_us":1029,"threads_started":1}
I20260808 11:31:07.210613 27283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:07.190693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:34003 (local address 127.26.66.130:59663)
0808 11:31:07.191611 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:07.191666 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:07.193577 (+ 1911us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:07.194344 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:07.194352 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:07.194867 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:07.195417 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:07.195435 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:07.196587 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:07.196592 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:07.197832 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:07.197845 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:07.198675 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:07.198682 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:07.198949 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:07.199676 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:07.199715 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:07.202421 (+ 2706us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:07.206749 (+ 4328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:07.206756 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:07.206767 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:07.207209 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:07.207663 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:07.207667 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:07.207669 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:07.207872 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:07.208608 (+ 736us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:07.208614 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:07.208940 (+ 326us) client_negotiation.cc:769] Sending connection context
0808 11:31:07.209161 (+ 221us) client_negotiation.cc:240] Negotiation successful
0808 11:31:07.209524 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":632,"thread_start_us":403,"threads_started":1}
WARNING: no policy specified for kudu/127.26.66.131@KRBTEST.COM; defaulting to no policy
I20260808 11:31:07.212208 27281 heartbeater.cc:347] Connected to a master server at 127.26.66.190:34003
I20260808 11:31:07.212559 27281 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:07.213377 27281 heartbeater.cc:511] Master 127.26.66.190:34003 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.131@KRBTEST.COM" created.
I20260808 11:31:07.214977 26945 ts_manager.cc:194] Registered new tserver with Master: aaf494e140d44a038b85543252e52516 (127.26.66.130:36339)
I20260808 11:31:07.215843 26945 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.130@KRBTEST.COM'} at 127.26.66.130:59663
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
I20260808 11:31:07.237746 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:0
--local_ip_for_outbound_sockets=127.26.66.131
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:34003
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:42017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:07.587774 27287 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:07.588155 27287 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:07.588322 27287 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:07.595670 27287 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:07.595808 27287 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:07.596024 27287 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:31:07.605609 27287 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:42017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:34003
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:07.606995 27287 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:07.608346 27287 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:07.621932 27293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:07.621958 27292 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:07.622015 27295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:07.622936 27287 server_base.cc:1034] running on GCE node
I20260808 11:31:07.623569 27287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:07.624603 27287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:07.625842 27287 hybrid_clock.cc:648] HybridClock initialized: now 1786188667625787 us; error 64 us; skew 500 ppm
I20260808 11:31:07.626221 27287 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:07 dist-test-slave-zkpd krb5kdc[26897](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188667, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:07.629427 27287 init.cc:377] Logged in from keytab as kudu/127.26.66.131@KRBTEST.COM (short username kudu)
I20260808 11:31:07.630875 27287 webserver.cc:460] Webserver started at http://127.26.66.131:34327/ using document root <none> and password file <none>
I20260808 11:31:07.631567 27287 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:07.631717 27287 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:07.632110 27287 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:07.635052 27287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-2/data/instance:
uuid: "1acc6d2aaf8a484dbc271012396e8404"
format_stamp: "Formatted at 2026-08-08 11:31:07 on dist-test-slave-zkpd"
server_key: "7b23dd8d0cf8a2db6ef9206bcb7289da"
server_key_iv: "2710a85d489d32243747be57a715d192"
server_key_version: "encryptionkey@0"
I20260808 11:31:07.635836 27287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance:
uuid: "1acc6d2aaf8a484dbc271012396e8404"
format_stamp: "Formatted at 2026-08-08 11:31:07 on dist-test-slave-zkpd"
server_key: "7b23dd8d0cf8a2db6ef9206bcb7289da"
server_key_iv: "2710a85d489d32243747be57a715d192"
server_key_version: "encryptionkey@0"
I20260808 11:31:07.641747 27287 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 11:31:07.645149 27302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:07.646450 27287 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:31:07.646627 27287 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "1acc6d2aaf8a484dbc271012396e8404"
format_stamp: "Formatted at 2026-08-08 11:31:07 on dist-test-slave-zkpd"
server_key: "7b23dd8d0cf8a2db6ef9206bcb7289da"
server_key_iv: "2710a85d489d32243747be57a715d192"
server_key_version: "encryptionkey@0"
I20260808 11:31:07.646813 27287 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:07.661936 27287 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:07.665743 27287 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:07.666054 27287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:07.667011 27287 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:31:07.668449 27287 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:07.668556 27287 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:07.668712 27287 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:07.668790 27287 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:07.674350 27141 heartbeater.cc:503] Master 127.26.66.190:34003 was elected leader, sending a full tablet report...
I20260808 11:31:07.706881 27287 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:39519
I20260808 11:31:07.706966 27422 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:39519 every 8 connection(s)
I20260808 11:31:07.708312 27287 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:31:07.717180 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 27287
I20260808 11:31:07.717393 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance
I20260808 11:31:07.717841 26890 external_mini_cluster.cc:1428] Setting key 5109f7a726d288f144d30a41e158a3f0
Aug 08 11:31:07 dist-test-slave-zkpd krb5kdc[26897](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188667, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:07.728957 27426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:07.710878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:56325 (local address 127.26.66.190:34003)
0808 11:31:07.711438 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:07.711442 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:07.712433 (+ 991us) server_negotiation.cc:407] Connection header received
0808 11:31:07.714429 (+ 1996us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:07.714435 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:07.714517 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:07.714642 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:07.716178 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:07.717187 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:07.719031 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:07.719612 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:07.719756 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:07.723727 (+ 3971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:07.723732 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:07.723735 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:07.723766 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:07.726315 (+ 2549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:07.727024 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:07.727028 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:07.727030 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:07.727148 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:07.727518 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:07.727521 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:07.727523 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:07.727757 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:07.727877 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:07.728529 (+ 652us) server_negotiation.cc:299] Negotiation successful
0808 11:31:07.728678 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":256,"threads_started":1}
I20260808 11:31:07.729790 27427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:07.711480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:34003 (local address 127.26.66.131:56325)
0808 11:31:07.712233 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:07.712269 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:07.714162 (+ 1893us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:07.714883 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:07.714891 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:07.715389 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:07.716021 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:07.716039 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:07.717404 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:07.717408 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:07.718902 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:07.718916 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:07.719824 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:07.719830 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:07.720133 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:07.720941 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:07.720964 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:07.723538 (+ 2574us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:07.726434 (+ 2896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:07.726440 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:07.726450 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:07.726921 (+ 471us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:07.727236 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:07.727239 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:07.727241 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:07.727422 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:07.727872 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:07.727877 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:07.728206 (+ 329us) client_negotiation.cc:769] Sending connection context
0808 11:31:07.728429 (+ 223us) client_negotiation.cc:240] Negotiation successful
0808 11:31:07.728774 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":329,"threads_started":1}
I20260808 11:31:07.731002 27423 heartbeater.cc:347] Connected to a master server at 127.26.66.190:34003
I20260808 11:31:07.731289 27423 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:07.732074 27423 heartbeater.cc:511] Master 127.26.66.190:34003 requested a full tablet report, sending...
I20260808 11:31:07.733670 26945 ts_manager.cc:194] Registered new tserver with Master: 1acc6d2aaf8a484dbc271012396e8404 (127.26.66.131:39519)
I20260808 11:31:07.734303 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 11:31:07.734575 26945 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.131@KRBTEST.COM'} at 127.26.66.131:56325
Aug 08 11:31:07 dist-test-slave-zkpd krb5kdc[26897](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188667, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 11:31:07 dist-test-slave-zkpd krb5kdc[26897](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188667, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.66.129@KRBTEST.COM
I20260808 11:31:07.784021 27432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:07.769077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36810 (local address 127.26.66.129:36709)
0808 11:31:07.769736 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:07.769743 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:07.769772 (+ 29us) server_negotiation.cc:407] Connection header received
0808 11:31:07.769923 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:07.769930 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:07.770140 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:07.770271 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:07.771638 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:07.772670 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:07.773907 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:07.774446 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:07.774538 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:07.778537 (+ 3999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:07.778548 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:07.778561 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:07.778594 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:07.781345 (+ 2751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:07.781943 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:07.781949 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:07.781952 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:07.782102 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:07.782445 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:07.782449 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:07.782451 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:07.782806 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:07.783040 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:07.783273 (+ 233us) server_negotiation.cc:299] Negotiation successful
0808 11:31:07.783557 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":515,"thread_start_us":337,"threads_started":1}
W20260808 11:31:07.785233 27051 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36810
Aug 08 11:31:07 dist-test-slave-zkpd krb5kdc[26897](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 11:31:07 dist-test-slave-zkpd krb5kdc[26897](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.129@KRBTEST.COM
I20260808 11:31:07.834085 27432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:07.820303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36822 (local address 127.26.66.129:36709)
0808 11:31:07.820593 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:07.820601 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:07.820945 (+ 344us) server_negotiation.cc:407] Connection header received
0808 11:31:07.821131 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:07.821135 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:07.821202 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:07.821295 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:07.823029 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:07.823722 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:07.824960 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:07.825394 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:07.825490 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:07.829288 (+ 3798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:07.829293 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:07.829296 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:07.829329 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:07.831771 (+ 2442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:07.832443 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:07.832447 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:07.832450 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:07.832573 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:07.832891 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:07.832894 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:07.832896 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:07.833125 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:07.833305 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:07.833557 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 11:31:07.833738 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 11:31:07.835609 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 27008
I20260808 11:31:07.848564 27432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:07.836669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36832 (local address 127.26.66.129:36709)
0808 11:31:07.836861 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:07.836889 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:07.837242 (+ 353us) server_negotiation.cc:407] Connection header received
0808 11:31:07.837334 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:07.837338 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:07.837387 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:07.837458 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:07.838589 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:07.839431 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:07.840734 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:07.841160 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:07.841253 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:07.843470 (+ 2217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:07.843475 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:07.843478 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:07.843507 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:07.846145 (+ 2638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:07.846770 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:07.846774 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:07.846776 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:07.846908 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:07.847238 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:07.847241 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:07.847244 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:07.847496 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:07.847687 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:07.848027 (+ 340us) server_negotiation.cc:299] Negotiation successful
0808 11:31:07.848186 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 11:31:07.849354 27135 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:07.935576 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 27008
I20260808 11:31:07.956441 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 27147
Aug 08 11:31:07 dist-test-slave-zkpd krb5kdc[26897](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.130@KRBTEST.COM
I20260808 11:31:07.972314 27439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:07.957337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33442 (local address 127.26.66.130:36339)
0808 11:31:07.957868 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:07.957874 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:07.957899 (+ 25us) server_negotiation.cc:407] Connection header received
0808 11:31:07.957959 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:07.957965 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:07.958168 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:07.958354 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:07.959580 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:07.960647 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:07.961899 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:07.962448 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:07.962590 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:07.966598 (+ 4008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:07.966608 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:07.966621 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:07.966654 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:07.969415 (+ 2761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:07.970077 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:07.970084 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:07.970086 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:07.970213 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:07.970626 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:07.970631 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:07.970636 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:07.970976 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:07.971307 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:07.971627 (+ 320us) server_negotiation.cc:299] Negotiation successful
0808 11:31:07.971923 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":271,"threads_started":1}
I20260808 11:31:07.973555 27276 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:08.062068 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 27147
I20260808 11:31:08.082306 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 27287
Aug 08 11:31:08 dist-test-slave-zkpd krb5kdc[26897](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.131@KRBTEST.COM
I20260808 11:31:08.098716 27441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:08.083386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58512 (local address 127.26.66.131:39519)
0808 11:31:08.084177 (+ 791us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:08.084185 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:08.084219 (+ 34us) server_negotiation.cc:407] Connection header received
0808 11:31:08.084282 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:08.084301 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:08.084514 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:08.084698 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:08.085968 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:08.086956 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:08.088327 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:08.088907 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:08.089047 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:08.093127 (+ 4080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:08.093139 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:08.093151 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:08.093181 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:08.096049 (+ 2868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:08.096778 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:08.096785 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:08.096787 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:08.096932 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:08.097254 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:08.097257 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:08.097259 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:08.097605 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:08.097854 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:08.098092 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 11:31:08.098299 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":603,"thread_start_us":329,"threads_started":1}
I20260808 11:31:08.100068 27417 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:08.183705 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 27287
I20260808 11:31:08.204319 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 26911
I20260808 11:31:08.205569 26977 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:08.312047 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 26911
2026-08-08T11:31:08Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4140 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:31:08 dist-test-slave-zkpd krb5kdc[27446](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:31:08 dist-test-slave-zkpd krb5kdc[27446](info): set up 2 sockets
Aug 08 11:31:08 dist-test-slave-zkpd krb5kdc[27446](info): commencing operation
krb5kdc: starting...
W20260808 11:31:09.436605 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.077s user 0.000s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:31:09 dist-test-slave-zkpd krb5kdc[27446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188669, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:31:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:31:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:31:09.642931 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:35107
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:35107
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:09.971071 27461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:09.971393 27461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:09.971549 27461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:09.978658 27461 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:31:09.978801 27461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:09.978912 27461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:09.979023 27461 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:31:09.979097 27461 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:31:09.988730 27461 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:35107
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:35107
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:09.990033 27461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:09.991305 27461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:10.002907 27467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:10.002947 27468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:10.003111 27470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:10.004101 27461 server_base.cc:1034] running on GCE node
I20260808 11:31:10.004778 27461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:10.006043 27461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:10.007246 27461 hybrid_clock.cc:648] HybridClock initialized: now 1786188670007204 us; error 25 us; skew 500 ppm
I20260808 11:31:10.007534 27461 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:10 dist-test-slave-zkpd krb5kdc[27446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188670, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:10.014626 27461 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:31:10.016199 27461 webserver.cc:460] Webserver started at http://127.26.66.190:42649/ using document root <none> and password file <none>
I20260808 11:31:10.016845 27461 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:10.016947 27461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:10.017237 27461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:10.020273 27461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "106c84f5002e4aea8d83cbb5ffa1961f"
format_stamp: "Formatted at 2026-08-08 11:31:10 on dist-test-slave-zkpd"
server_key: "f4a32cdcc0d1c76efdce32958f6f79e6"
server_key_iv: "a884d48da62a3cf4b4c8c173329d8524"
server_key_version: "encryptionkey@0"
I20260808 11:31:10.020990 27461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "106c84f5002e4aea8d83cbb5ffa1961f"
format_stamp: "Formatted at 2026-08-08 11:31:10 on dist-test-slave-zkpd"
server_key: "f4a32cdcc0d1c76efdce32958f6f79e6"
server_key_iv: "a884d48da62a3cf4b4c8c173329d8524"
server_key_version: "encryptionkey@0"
I20260808 11:31:10.026227 27461 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.005s
I20260808 11:31:10.029603 27478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:10.030938 27461 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260808 11:31:10.031123 27461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "106c84f5002e4aea8d83cbb5ffa1961f"
format_stamp: "Formatted at 2026-08-08 11:31:10 on dist-test-slave-zkpd"
server_key: "f4a32cdcc0d1c76efdce32958f6f79e6"
server_key_iv: "a884d48da62a3cf4b4c8c173329d8524"
server_key_version: "encryptionkey@0"
I20260808 11:31:10.031342 27461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:10.050733 27461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:10.054684 27461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:10.055024 27461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:10.073972 27461 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:35107
I20260808 11:31:10.074002 27534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:35107 every 8 connection(s)
I20260808 11:31:10.075352 27461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:31:10.079137 27535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:10.080688 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 27461
I20260808 11:31:10.080938 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:31:10.081612 26890 external_mini_cluster.cc:1428] Setting key de8906f6eafbed44d7e418bfa54553cc
I20260808 11:31:10.093775 27535 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 106c84f5002e4aea8d83cbb5ffa1961f: Bootstrap starting.
Aug 08 11:31:10 dist-test-slave-zkpd krb5kdc[27446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188669, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:10.096921 27535 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 106c84f5002e4aea8d83cbb5ffa1961f: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:10.098342 27535 log.cc:824] T 00000000000000000000000000000000 P 106c84f5002e4aea8d83cbb5ffa1961f: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:10.101822 27535 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 106c84f5002e4aea8d83cbb5ffa1961f: No bootstrap required, opened a new log
I20260808 11:31:10.106163 27539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:10.083567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47074 (local address 127.26.66.190:35107)
0808 11:31:10.084465 (+ 898us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:10.084488 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:10.084553 (+ 65us) server_negotiation.cc:407] Connection header received
0808 11:31:10.086344 (+ 1791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:10.086379 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:10.086894 (+ 515us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:10.087310 (+ 416us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:10.088800 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:10.090892 (+ 2092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:10.092201 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:10.093212 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:10.093426 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:10.097272 (+ 3846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:10.097289 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:10.097311 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:10.097369 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:10.101479 (+ 4110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:10.102207 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:10.102214 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:10.102222 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:10.102461 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:10.102834 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:10.102839 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:10.102842 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:10.103549 (+ 707us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:10.103872 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:10.104331 (+ 459us) server_negotiation.cc:299] Negotiation successful
0808 11:31:10.104781 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":645,"thread_start_us":375,"threads_started":1}
I20260808 11:31:10.111472 27535 raft_consensus.cc:348] T 00000000000000000000000000000000 P 106c84f5002e4aea8d83cbb5ffa1961f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "106c84f5002e4aea8d83cbb5ffa1961f" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 35107 } }
I20260808 11:31:10.111812 27535 raft_consensus.cc:374] T 00000000000000000000000000000000 P 106c84f5002e4aea8d83cbb5ffa1961f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:10.111951 27535 raft_consensus.cc:729] T 00000000000000000000000000000000 P 106c84f5002e4aea8d83cbb5ffa1961f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 106c84f5002e4aea8d83cbb5ffa1961f, State: Initialized, Role: FOLLOWER
I20260808 11:31:10.112510 27535 consensus_queue.cc:260] T 00000000000000000000000000000000 P 106c84f5002e4aea8d83cbb5ffa1961f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "106c84f5002e4aea8d83cbb5ffa1961f" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 35107 } }
I20260808 11:31:10.112715 27535 raft_consensus.cc:388] T 00000000000000000000000000000000 P 106c84f5002e4aea8d83cbb5ffa1961f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:31:10.112814 27535 raft_consensus.cc:482] T 00000000000000000000000000000000 P 106c84f5002e4aea8d83cbb5ffa1961f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:31:10.112929 27535 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 106c84f5002e4aea8d83cbb5ffa1961f [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:10.115154 27535 raft_consensus.cc:504] T 00000000000000000000000000000000 P 106c84f5002e4aea8d83cbb5ffa1961f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "106c84f5002e4aea8d83cbb5ffa1961f" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 35107 } }
I20260808 11:31:10.115684 27535 leader_election.cc:302] T 00000000000000000000000000000000 P 106c84f5002e4aea8d83cbb5ffa1961f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 106c84f5002e4aea8d83cbb5ffa1961f; no voters:
I20260808 11:31:10.116325 27535 leader_election.cc:288] T 00000000000000000000000000000000 P 106c84f5002e4aea8d83cbb5ffa1961f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:31:10.116456 27541 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 106c84f5002e4aea8d83cbb5ffa1961f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:31:10.117177 27541 raft_consensus.cc:686] T 00000000000000000000000000000000 P 106c84f5002e4aea8d83cbb5ffa1961f [term 1 LEADER]: Becoming Leader. State: Replica: 106c84f5002e4aea8d83cbb5ffa1961f, State: Running, Role: LEADER
I20260808 11:31:10.117753 27541 consensus_queue.cc:237] T 00000000000000000000000000000000 P 106c84f5002e4aea8d83cbb5ffa1961f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "106c84f5002e4aea8d83cbb5ffa1961f" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 35107 } }
I20260808 11:31:10.118384 27535 sys_catalog.cc:564] T 00000000000000000000000000000000 P 106c84f5002e4aea8d83cbb5ffa1961f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:31:10.120853 27544 sys_catalog.cc:455] T 00000000000000000000000000000000 P 106c84f5002e4aea8d83cbb5ffa1961f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 106c84f5002e4aea8d83cbb5ffa1961f. Latest consensus state: current_term: 1 leader_uuid: "106c84f5002e4aea8d83cbb5ffa1961f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "106c84f5002e4aea8d83cbb5ffa1961f" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 35107 } } }
I20260808 11:31:10.120841 27542 sys_catalog.cc:455] T 00000000000000000000000000000000 P 106c84f5002e4aea8d83cbb5ffa1961f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "106c84f5002e4aea8d83cbb5ffa1961f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "106c84f5002e4aea8d83cbb5ffa1961f" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 35107 } } }
I20260808 11:31:10.121274 27544 sys_catalog.cc:458] T 00000000000000000000000000000000 P 106c84f5002e4aea8d83cbb5ffa1961f [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:10.121310 27542 sys_catalog.cc:458] T 00000000000000000000000000000000 P 106c84f5002e4aea8d83cbb5ffa1961f [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:10.122788 27548 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:31:10.128217 27548 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:31:10.144148 27548 catalog_manager.cc:1347] Generated new cluster ID: cc4196efe802498a8750fffddb518461
I20260808 11:31:10.144320 27548 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:31:10.173417 27548 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:31:10.174880 27548 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:31:10.181921 27548 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 106c84f5002e4aea8d83cbb5ffa1961f: Generated new TSK 0
I20260808 11:31:10.182946 27548 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.66.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
I20260808 11:31:10.239384 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:0
--local_ip_for_outbound_sockets=127.26.66.129
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:35107
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:10.572927 27563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:10.573210 27563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:10.573385 27563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:10.580708 27563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:10.580842 27563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:10.581038 27563 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:31:10.590961 27563 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:35107
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:10.592309 27563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:10.593675 27563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:10.607075 27568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:10.607048 27571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:10.607136 27569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:10.608268 27563 server_base.cc:1034] running on GCE node
I20260808 11:31:10.608897 27563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:10.609754 27563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:10.610960 27563 hybrid_clock.cc:648] HybridClock initialized: now 1786188670610913 us; error 37 us; skew 500 ppm
I20260808 11:31:10.611281 27563 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:10 dist-test-slave-zkpd krb5kdc[27446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188670, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:10.614518 27563 init.cc:377] Logged in from keytab as kudu/127.26.66.129@KRBTEST.COM (short username kudu)
I20260808 11:31:10.616050 27563 webserver.cc:460] Webserver started at http://127.26.66.129:38107/ using document root <none> and password file <none>
I20260808 11:31:10.616700 27563 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:10.616812 27563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:10.617132 27563 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:10.620266 27563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-0/data/instance:
uuid: "f4801330cc5c4c5388cbd0baae91d2aa"
format_stamp: "Formatted at 2026-08-08 11:31:10 on dist-test-slave-zkpd"
server_key: "53b71e2df2f9a491d4c172b1e3db3aa7"
server_key_iv: "58a1079ad501edb3d7001afedebbea98"
server_key_version: "encryptionkey@0"
I20260808 11:31:10.621014 27563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance:
uuid: "f4801330cc5c4c5388cbd0baae91d2aa"
format_stamp: "Formatted at 2026-08-08 11:31:10 on dist-test-slave-zkpd"
server_key: "53b71e2df2f9a491d4c172b1e3db3aa7"
server_key_iv: "58a1079ad501edb3d7001afedebbea98"
server_key_version: "encryptionkey@0"
I20260808 11:31:10.626585 27563 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 11:31:10.630048 27580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:10.631371 27563 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 11:31:10.631539 27563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "f4801330cc5c4c5388cbd0baae91d2aa"
format_stamp: "Formatted at 2026-08-08 11:31:10 on dist-test-slave-zkpd"
server_key: "53b71e2df2f9a491d4c172b1e3db3aa7"
server_key_iv: "58a1079ad501edb3d7001afedebbea98"
server_key_version: "encryptionkey@0"
I20260808 11:31:10.631737 27563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:10.647040 27563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:10.650863 27563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:10.651151 27563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:10.652127 27563 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:31:10.653407 27563 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:10.653486 27563 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:10.653647 27563 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:10.653740 27563 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:10.687767 27563 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:34439
I20260808 11:31:10.687839 27695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:34439 every 8 connection(s)
I20260808 11:31:10.689198 27563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:31:10.699256 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 27563
I20260808 11:31:10.699492 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance
I20260808 11:31:10.700343 26890 external_mini_cluster.cc:1428] Setting key 799d3407d8d38ebbfeeb589bc9f1108d
Aug 08 11:31:10 dist-test-slave-zkpd krb5kdc[27446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188670, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:10.709476 27698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:10.691941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:39179 (local address 127.26.66.190:35107)
0808 11:31:10.692423 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:10.692428 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:10.693373 (+ 945us) server_negotiation.cc:407] Connection header received
0808 11:31:10.695256 (+ 1883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:10.695260 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:10.695332 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:10.695430 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:10.697028 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:10.697767 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:10.699272 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:10.699952 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:10.700102 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:10.703797 (+ 3695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:10.703802 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:10.703806 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:10.703838 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:10.706406 (+ 2568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:10.707114 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:10.707120 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:10.707124 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:10.707251 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:10.707687 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:10.707693 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:10.707696 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:10.708046 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:10.708201 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:10.708893 (+ 692us) server_negotiation.cc:299] Negotiation successful
0808 11:31:10.709117 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":242,"threads_started":1}
I20260808 11:31:10.710423 27699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:10.692510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:35107 (local address 127.26.66.129:39179)
0808 11:31:10.693205 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:10.693245 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:10.694999 (+ 1754us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:10.695677 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:10.695685 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:10.696306 (+ 621us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:10.696877 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:10.696896 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:10.697903 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:10.697907 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:10.699115 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:10.699127 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:10.700168 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:10.700172 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:10.700380 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:10.701281 (+ 901us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:10.701312 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:10.703572 (+ 2260us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:10.706549 (+ 2977us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:10.706558 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:10.706573 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:10.706990 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:10.707371 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:10.707376 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:10.707380 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:10.707571 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:10.708174 (+ 603us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:10.708182 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:10.708518 (+ 336us) client_negotiation.cc:769] Sending connection context
0808 11:31:10.708789 (+ 271us) client_negotiation.cc:240] Negotiation successful
0808 11:31:10.709296 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":277,"threads_started":1}
I20260808 11:31:10.712143 27696 heartbeater.cc:347] Connected to a master server at 127.26.66.190:35107
I20260808 11:31:10.712471 27696 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:10.713339 27696 heartbeater.cc:511] Master 127.26.66.190:35107 requested a full tablet report, sending...
I20260808 11:31:10.715574 27498 ts_manager.cc:194] Registered new tserver with Master: f4801330cc5c4c5388cbd0baae91d2aa (127.26.66.129:34439)
I20260808 11:31:10.717041 27498 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.129@KRBTEST.COM'} at 127.26.66.129:39179
WARNING: no policy specified for kudu/127.26.66.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
I20260808 11:31:10.746639 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:0
--local_ip_for_outbound_sockets=127.26.66.130
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:35107
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:11.072306 27702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:11.072594 27702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:11.072798 27702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:11.079967 27702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:11.080063 27702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:11.080267 27702 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:31:11.089738 27702 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:35107
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:11.091022 27702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:11.092393 27702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:11.105043 27707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:11.105082 27708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:11.105119 27710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:11.105849 27702 server_base.cc:1034] running on GCE node
I20260808 11:31:11.106453 27702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:11.107267 27702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:11.108467 27702 hybrid_clock.cc:648] HybridClock initialized: now 1786188671108410 us; error 55 us; skew 500 ppm
I20260808 11:31:11.108773 27702 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:11 dist-test-slave-zkpd krb5kdc[27446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188671, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:11.111817 27702 init.cc:377] Logged in from keytab as kudu/127.26.66.130@KRBTEST.COM (short username kudu)
I20260808 11:31:11.113246 27702 webserver.cc:460] Webserver started at http://127.26.66.130:40887/ using document root <none> and password file <none>
I20260808 11:31:11.113924 27702 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:11.114069 27702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:11.114382 27702 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:11.117213 27702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-1/data/instance:
uuid: "516afafe5ed94cefa0de9a0f302b0b08"
format_stamp: "Formatted at 2026-08-08 11:31:11 on dist-test-slave-zkpd"
server_key: "997981284ecb379963f9a8a5e1293bf2"
server_key_iv: "a2b49db2ad583a3e26140cf3a9657dbe"
server_key_version: "encryptionkey@0"
I20260808 11:31:11.118033 27702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance:
uuid: "516afafe5ed94cefa0de9a0f302b0b08"
format_stamp: "Formatted at 2026-08-08 11:31:11 on dist-test-slave-zkpd"
server_key: "997981284ecb379963f9a8a5e1293bf2"
server_key_iv: "a2b49db2ad583a3e26140cf3a9657dbe"
server_key_version: "encryptionkey@0"
I20260808 11:31:11.123006 27702 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 11:31:11.126286 27720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:11.127545 27702 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 11:31:11.127718 27702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "516afafe5ed94cefa0de9a0f302b0b08"
format_stamp: "Formatted at 2026-08-08 11:31:11 on dist-test-slave-zkpd"
server_key: "997981284ecb379963f9a8a5e1293bf2"
server_key_iv: "a2b49db2ad583a3e26140cf3a9657dbe"
server_key_version: "encryptionkey@0"
I20260808 11:31:11.127950 27702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:11.142872 27702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:11.146785 27702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:11.147073 27702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:11.148114 27702 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:31:11.149466 27702 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:11.149569 27702 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:11.149717 27702 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:11.149796 27702 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:11.183573 27702 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:45587
I20260808 11:31:11.183660 27835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:45587 every 8 connection(s)
I20260808 11:31:11.184899 27702 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:31:11.194792 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 27702
I20260808 11:31:11.194993 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance
I20260808 11:31:11.195546 26890 external_mini_cluster.cc:1428] Setting key b353ab0264e11db349d3828fcb0311d8
Aug 08 11:31:11 dist-test-slave-zkpd krb5kdc[27446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188671, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:11.205744 27698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:11.187399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:57069 (local address 127.26.66.190:35107)
0808 11:31:11.187618 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:11.187624 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:11.188825 (+ 1201us) server_negotiation.cc:407] Connection header received
0808 11:31:11.190630 (+ 1805us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:11.190635 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:11.190706 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:11.190840 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:11.192277 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.192981 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.194465 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.195135 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.195264 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:11.198860 (+ 3596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:11.198870 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:11.198878 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:11.198923 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:11.202692 (+ 3769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:11.203380 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:11.203388 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:11.203394 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:11.203563 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:11.204047 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:11.204052 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:11.204054 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:11.204331 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:11.204497 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:11.205170 (+ 673us) server_negotiation.cc:299] Negotiation successful
0808 11:31:11.205409 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 11:31:11.206657 27838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:11.187943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:35107 (local address 127.26.66.130:57069)
0808 11:31:11.188652 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:11.188689 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:11.190341 (+ 1652us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:11.191009 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:11.191017 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:11.191508 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:11.192130 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:11.192150 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.193111 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.193115 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:11.194311 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:11.194324 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.195343 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.195348 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:11.195537 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:11.196348 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:11.196378 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:11.198626 (+ 2248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:11.202837 (+ 4211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:11.202843 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:11.202854 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:11.203253 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:11.203669 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:11.203673 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:11.203675 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:11.203866 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:11.204465 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:11.204473 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:11.204799 (+ 326us) client_negotiation.cc:769] Sending connection context
0808 11:31:11.205061 (+ 262us) client_negotiation.cc:240] Negotiation successful
0808 11:31:11.205555 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":265,"threads_started":1}
I20260808 11:31:11.208207 27836 heartbeater.cc:347] Connected to a master server at 127.26.66.190:35107
I20260808 11:31:11.208506 27836 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:11.209232 27836 heartbeater.cc:511] Master 127.26.66.190:35107 requested a full tablet report, sending...
I20260808 11:31:11.210685 27498 ts_manager.cc:194] Registered new tserver with Master: 516afafe5ed94cefa0de9a0f302b0b08 (127.26.66.130:45587)
I20260808 11:31:11.211585 27498 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.130@KRBTEST.COM'} at 127.26.66.130:57069
WARNING: no policy specified for kudu/127.26.66.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
I20260808 11:31:11.243748 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:0
--local_ip_for_outbound_sockets=127.26.66.131
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:35107
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:11.580060 27841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:11.580356 27841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:11.580458 27841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:11.587749 27841 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:11.587854 27841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:11.588039 27841 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:31:11.597941 27841 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:35107
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:11.599174 27841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:11.600495 27841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:11.613991 27846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:11.613956 27847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:11.614228 27849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:11.614864 27841 server_base.cc:1034] running on GCE node
I20260808 11:31:11.615419 27841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:11.616451 27841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:11.617647 27841 hybrid_clock.cc:648] HybridClock initialized: now 1786188671617570 us; error 81 us; skew 500 ppm
I20260808 11:31:11.617951 27841 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:11 dist-test-slave-zkpd krb5kdc[27446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188671, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:11.621137 27841 init.cc:377] Logged in from keytab as kudu/127.26.66.131@KRBTEST.COM (short username kudu)
I20260808 11:31:11.622565 27841 webserver.cc:460] Webserver started at http://127.26.66.131:44123/ using document root <none> and password file <none>
I20260808 11:31:11.623238 27841 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:11.623395 27841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:11.623723 27841 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:11.626643 27841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-2/data/instance:
uuid: "b1b8c5d9e97a4f6093943358b1aa9eed"
format_stamp: "Formatted at 2026-08-08 11:31:11 on dist-test-slave-zkpd"
server_key: "21b3544d51ad3976f931b3fd7339681a"
server_key_iv: "e255f7a0ad9b86472592693b8aec7406"
server_key_version: "encryptionkey@0"
I20260808 11:31:11.627440 27841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance:
uuid: "b1b8c5d9e97a4f6093943358b1aa9eed"
format_stamp: "Formatted at 2026-08-08 11:31:11 on dist-test-slave-zkpd"
server_key: "21b3544d51ad3976f931b3fd7339681a"
server_key_iv: "e255f7a0ad9b86472592693b8aec7406"
server_key_version: "encryptionkey@0"
I20260808 11:31:11.632812 27841 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 11:31:11.636368 27857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:11.637632 27841 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 11:31:11.637817 27841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "b1b8c5d9e97a4f6093943358b1aa9eed"
format_stamp: "Formatted at 2026-08-08 11:31:11 on dist-test-slave-zkpd"
server_key: "21b3544d51ad3976f931b3fd7339681a"
server_key_iv: "e255f7a0ad9b86472592693b8aec7406"
server_key_version: "encryptionkey@0"
I20260808 11:31:11.638027 27841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:11.660745 27841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:11.664611 27841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:11.664897 27841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:11.665839 27841 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:31:11.667109 27841 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:11.667223 27841 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:11.667379 27841 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:11.667454 27841 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:11.702265 27841 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:46451
I20260808 11:31:11.702363 27972 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:46451 every 8 connection(s)
I20260808 11:31:11.703538 27841 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:31:11.713745 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 27841
I20260808 11:31:11.713958 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance
I20260808 11:31:11.714406 26890 external_mini_cluster.cc:1428] Setting key 0b997e677b87135cd31b99d759134230
Aug 08 11:31:11 dist-test-slave-zkpd krb5kdc[27446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188671, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:11.720654 27696 heartbeater.cc:503] Master 127.26.66.190:35107 was elected leader, sending a full tablet report...
I20260808 11:31:11.724339 27976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:11.706137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:51715 (local address 127.26.66.190:35107)
0808 11:31:11.706667 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:11.706672 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:11.707515 (+ 843us) server_negotiation.cc:407] Connection header received
0808 11:31:11.709477 (+ 1962us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:11.709484 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:11.709592 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:11.709720 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:11.711225 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.712065 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.713582 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.714164 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.714301 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:11.718383 (+ 4082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:11.718388 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:11.718391 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:11.718423 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:11.721261 (+ 2838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:11.721967 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:11.721974 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:11.721978 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:11.722152 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:11.722594 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:11.722600 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:11.722603 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:11.722883 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:11.723057 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:11.723697 (+ 640us) server_negotiation.cc:299] Negotiation successful
0808 11:31:11.723936 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":318,"threads_started":1}
I20260808 11:31:11.725219 27977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:11.706649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:35107 (local address 127.26.66.131:51715)
0808 11:31:11.707347 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:11.707388 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:11.709203 (+ 1815us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:11.709961 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:11.709969 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:11.710482 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:11.711043 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:11.711067 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.712219 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.712223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:11.713435 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:11.713447 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.714392 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.714399 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:11.714678 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:11.715408 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:11.715441 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:11.718178 (+ 2737us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:11.721407 (+ 3229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:11.721415 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:11.721428 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:11.721843 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:11.722260 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:11.722265 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:11.722268 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:11.722473 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:11.723014 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:11.723023 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:11.723347 (+ 324us) client_negotiation.cc:769] Sending connection context
0808 11:31:11.723608 (+ 261us) client_negotiation.cc:240] Negotiation successful
0808 11:31:11.724140 (+ 532us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":301,"threads_started":1}
I20260808 11:31:11.726589 27974 heartbeater.cc:347] Connected to a master server at 127.26.66.190:35107
I20260808 11:31:11.726883 27974 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:11.727551 27974 heartbeater.cc:511] Master 127.26.66.190:35107 requested a full tablet report, sending...
I20260808 11:31:11.729375 27496 ts_manager.cc:194] Registered new tserver with Master: b1b8c5d9e97a4f6093943358b1aa9eed (127.26.66.131:46451)
I20260808 11:31:11.730279 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 11:31:11.730646 27496 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.131@KRBTEST.COM'} at 127.26.66.131:51715
I20260808 11:31:11.750572 27976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:11.737712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49418 (local address 127.26.66.190:35107)
0808 11:31:11.737878 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:11.737882 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:11.738423 (+ 541us) server_negotiation.cc:407] Connection header received
0808 11:31:11.738645 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:11.738650 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:11.738713 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:11.738820 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:11.740401 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.741171 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.742499 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.742928 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.743073 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:11.745434 (+ 2361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:11.745439 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:11.745442 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:11.745474 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:11.747950 (+ 2476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:11.748601 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:11.748607 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:11.748611 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:11.748744 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:11.749112 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:11.749117 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:11.749120 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:11.749428 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:11.749724 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:11.750029 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 11:31:11.750250 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 11:31:11.756953 27496 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49418:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 11:31:11.763999 27496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:31:11.791996 27990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:11.776556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:45587 (local address 127.0.0.1:48784)
0808 11:31:11.777912 (+ 1356us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:11.777933 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:11.778060 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:11.779694 (+ 1634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:11.779705 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:11.779746 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:31:11.780359 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:11.780376 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.784366 (+ 3990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.784372 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:11.788584 (+ 4212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:11.788600 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.790846 (+ 2246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.790854 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:11.791068 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:11.791161 (+ 93us) client_negotiation.cc:769] Sending connection context
0808 11:31:11.791385 (+ 224us) client_negotiation.cc:240] Negotiation successful
0808 11:31:11.791573 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1242,"thread_start_us":11541,"threads_started":1}
I20260808 11:31:11.791998 27991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:11.777590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48784 (local address 127.26.66.130:45587)
0808 11:31:11.778273 (+ 683us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:11.778282 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:11.778309 (+ 27us) server_negotiation.cc:407] Connection header received
0808 11:31:11.778409 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:11.778417 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:11.779125 (+ 708us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:11.779362 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:31:11.780609 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.784157 (+ 3548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.788772 (+ 4615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.790626 (+ 1854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.790773 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:11.790975 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:11.791446 (+ 471us) server_negotiation.cc:299] Negotiation successful
0808 11:31:11.791600 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":515,"thread_start_us":858,"threads_started":1}
I20260808 11:31:11.797042 27989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:11.776797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:46451 (local address 127.0.0.1:34896)
0808 11:31:11.787837 (+ 11040us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:11.787855 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:11.788014 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:11.790059 (+ 2045us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:11.790064 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:11.790088 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:31:11.790415 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:11.790422 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.792528 (+ 2106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.792533 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:11.794726 (+ 2193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:11.794740 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.796041 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.796048 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:11.796232 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:11.796341 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 11:31:11.796436 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 11:31:11.796557 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10902,"mutex_wait_us":76,"thread_start_us":895,"threads_started":1}
I20260808 11:31:11.797083 27987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:11.776015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:34439 (local address 127.0.0.1:38898)
0808 11:31:11.777169 (+ 1154us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:11.777206 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:11.777386 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:11.789446 (+ 12060us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:11.789451 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:11.789476 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:31:11.789875 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:11.789887 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.792138 (+ 2251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.792145 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:11.794337 (+ 2192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:11.794358 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.796227 (+ 1869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.796233 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:11.796497 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:11.796526 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 11:31:11.796588 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 11:31:11.796710 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":924,"mutex_wait_us":196,"thread_start_us":950,"threads_started":1}
I20260808 11:31:11.796554 27768 tablet_service.cc:1467] Processing CreateTablet for tablet 0c9fe29cff29460fbd61e24c34cc3b76 (DEFAULT_TABLE table=test-table [id=45009f6833794271ab146e027f62113c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:31:11.797565 27988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:11.776415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38898 (local address 127.26.66.129:34439)
0808 11:31:11.788817 (+ 12402us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:11.788826 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:11.788858 (+ 32us) server_negotiation.cc:407] Connection header received
0808 11:31:11.788948 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:11.788955 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:11.789206 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:11.790111 (+ 905us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:31:11.790399 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.791962 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.794558 (+ 2596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.795982 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.796338 (+ 356us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:11.796552 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:11.796646 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 11:31:11.796804 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12218,"thread_start_us":12035,"threads_started":1}
I20260808 11:31:11.797863 27993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:11.778132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34896 (local address 127.26.66.131:46451)
0808 11:31:11.789273 (+ 11141us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:11.789281 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:11.789314 (+ 33us) server_negotiation.cc:407] Connection header received
0808 11:31:11.789410 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:11.789417 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:11.789633 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:11.789843 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:31:11.790587 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.792355 (+ 1768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.794906 (+ 2551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.795815 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.795980 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:11.796210 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:11.797393 (+ 1183us) server_negotiation.cc:299] Negotiation successful
0808 11:31:11.797513 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10971,"thread_start_us":10809,"threads_started":1}
I20260808 11:31:11.798130 27768 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c9fe29cff29460fbd61e24c34cc3b76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:11.801020 27628 tablet_service.cc:1467] Processing CreateTablet for tablet 0c9fe29cff29460fbd61e24c34cc3b76 (DEFAULT_TABLE table=test-table [id=45009f6833794271ab146e027f62113c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:31:11.801461 27907 tablet_service.cc:1467] Processing CreateTablet for tablet 0c9fe29cff29460fbd61e24c34cc3b76 (DEFAULT_TABLE table=test-table [id=45009f6833794271ab146e027f62113c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:31:11.802287 27628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c9fe29cff29460fbd61e24c34cc3b76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:11.802865 27907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c9fe29cff29460fbd61e24c34cc3b76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:11.813310 27994 tablet_bootstrap.cc:492] T 0c9fe29cff29460fbd61e24c34cc3b76 P 516afafe5ed94cefa0de9a0f302b0b08: Bootstrap starting.
I20260808 11:31:11.815021 27995 tablet_bootstrap.cc:492] T 0c9fe29cff29460fbd61e24c34cc3b76 P f4801330cc5c4c5388cbd0baae91d2aa: Bootstrap starting.
I20260808 11:31:11.817744 27994 tablet_bootstrap.cc:654] T 0c9fe29cff29460fbd61e24c34cc3b76 P 516afafe5ed94cefa0de9a0f302b0b08: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:11.818779 27995 tablet_bootstrap.cc:654] T 0c9fe29cff29460fbd61e24c34cc3b76 P f4801330cc5c4c5388cbd0baae91d2aa: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:11.819197 27994 log.cc:824] T 0c9fe29cff29460fbd61e24c34cc3b76 P 516afafe5ed94cefa0de9a0f302b0b08: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:11.820412 27995 log.cc:824] T 0c9fe29cff29460fbd61e24c34cc3b76 P f4801330cc5c4c5388cbd0baae91d2aa: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:11.828897 27997 tablet_bootstrap.cc:492] T 0c9fe29cff29460fbd61e24c34cc3b76 P b1b8c5d9e97a4f6093943358b1aa9eed: Bootstrap starting.
I20260808 11:31:11.829917 27995 tablet_bootstrap.cc:492] T 0c9fe29cff29460fbd61e24c34cc3b76 P f4801330cc5c4c5388cbd0baae91d2aa: No bootstrap required, opened a new log
I20260808 11:31:11.830184 27995 ts_tablet_manager.cc:1397] T 0c9fe29cff29460fbd61e24c34cc3b76 P f4801330cc5c4c5388cbd0baae91d2aa: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.004s
I20260808 11:31:11.831782 27997 tablet_bootstrap.cc:654] T 0c9fe29cff29460fbd61e24c34cc3b76 P b1b8c5d9e97a4f6093943358b1aa9eed: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:11.832883 27997 log.cc:824] T 0c9fe29cff29460fbd61e24c34cc3b76 P b1b8c5d9e97a4f6093943358b1aa9eed: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:11.834946 27994 tablet_bootstrap.cc:492] T 0c9fe29cff29460fbd61e24c34cc3b76 P 516afafe5ed94cefa0de9a0f302b0b08: No bootstrap required, opened a new log
I20260808 11:31:11.835201 27994 ts_tablet_manager.cc:1397] T 0c9fe29cff29460fbd61e24c34cc3b76 P 516afafe5ed94cefa0de9a0f302b0b08: Time spent bootstrapping tablet: real 0.022s user 0.006s sys 0.009s
I20260808 11:31:11.838769 27995 raft_consensus.cc:348] T 0c9fe29cff29460fbd61e24c34cc3b76 P f4801330cc5c4c5388cbd0baae91d2aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4801330cc5c4c5388cbd0baae91d2aa" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34439 } } peers { permanent_uuid: "516afafe5ed94cefa0de9a0f302b0b08" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 45587 } } peers { permanent_uuid: "b1b8c5d9e97a4f6093943358b1aa9eed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 46451 } }
I20260808 11:31:11.839118 27995 raft_consensus.cc:374] T 0c9fe29cff29460fbd61e24c34cc3b76 P f4801330cc5c4c5388cbd0baae91d2aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:11.839214 27995 raft_consensus.cc:729] T 0c9fe29cff29460fbd61e24c34cc3b76 P f4801330cc5c4c5388cbd0baae91d2aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4801330cc5c4c5388cbd0baae91d2aa, State: Initialized, Role: FOLLOWER
I20260808 11:31:11.839948 27995 consensus_queue.cc:260] T 0c9fe29cff29460fbd61e24c34cc3b76 P f4801330cc5c4c5388cbd0baae91d2aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4801330cc5c4c5388cbd0baae91d2aa" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34439 } } peers { permanent_uuid: "516afafe5ed94cefa0de9a0f302b0b08" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 45587 } } peers { permanent_uuid: "b1b8c5d9e97a4f6093943358b1aa9eed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 46451 } }
I20260808 11:31:11.841935 27995 ts_tablet_manager.cc:1428] T 0c9fe29cff29460fbd61e24c34cc3b76 P f4801330cc5c4c5388cbd0baae91d2aa: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260808 11:31:11.842559 27997 tablet_bootstrap.cc:492] T 0c9fe29cff29460fbd61e24c34cc3b76 P b1b8c5d9e97a4f6093943358b1aa9eed: No bootstrap required, opened a new log
I20260808 11:31:11.842907 27997 ts_tablet_manager.cc:1397] T 0c9fe29cff29460fbd61e24c34cc3b76 P b1b8c5d9e97a4f6093943358b1aa9eed: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.000s
I20260808 11:31:11.843784 27994 raft_consensus.cc:348] T 0c9fe29cff29460fbd61e24c34cc3b76 P 516afafe5ed94cefa0de9a0f302b0b08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4801330cc5c4c5388cbd0baae91d2aa" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34439 } } peers { permanent_uuid: "516afafe5ed94cefa0de9a0f302b0b08" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 45587 } } peers { permanent_uuid: "b1b8c5d9e97a4f6093943358b1aa9eed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 46451 } }
I20260808 11:31:11.844255 27994 raft_consensus.cc:374] T 0c9fe29cff29460fbd61e24c34cc3b76 P 516afafe5ed94cefa0de9a0f302b0b08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:11.844358 27994 raft_consensus.cc:729] T 0c9fe29cff29460fbd61e24c34cc3b76 P 516afafe5ed94cefa0de9a0f302b0b08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 516afafe5ed94cefa0de9a0f302b0b08, State: Initialized, Role: FOLLOWER
I20260808 11:31:11.844923 27994 consensus_queue.cc:260] T 0c9fe29cff29460fbd61e24c34cc3b76 P 516afafe5ed94cefa0de9a0f302b0b08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4801330cc5c4c5388cbd0baae91d2aa" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34439 } } peers { permanent_uuid: "516afafe5ed94cefa0de9a0f302b0b08" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 45587 } } peers { permanent_uuid: "b1b8c5d9e97a4f6093943358b1aa9eed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 46451 } }
I20260808 11:31:11.846256 27836 heartbeater.cc:503] Master 127.26.66.190:35107 was elected leader, sending a full tablet report...
I20260808 11:31:11.846593 27994 ts_tablet_manager.cc:1428] T 0c9fe29cff29460fbd61e24c34cc3b76 P 516afafe5ed94cefa0de9a0f302b0b08: Time spent starting tablet: real 0.011s user 0.007s sys 0.005s
I20260808 11:31:11.852139 27997 raft_consensus.cc:348] T 0c9fe29cff29460fbd61e24c34cc3b76 P b1b8c5d9e97a4f6093943358b1aa9eed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4801330cc5c4c5388cbd0baae91d2aa" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34439 } } peers { permanent_uuid: "516afafe5ed94cefa0de9a0f302b0b08" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 45587 } } peers { permanent_uuid: "b1b8c5d9e97a4f6093943358b1aa9eed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 46451 } }
I20260808 11:31:11.852485 27997 raft_consensus.cc:374] T 0c9fe29cff29460fbd61e24c34cc3b76 P b1b8c5d9e97a4f6093943358b1aa9eed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:11.852598 27997 raft_consensus.cc:729] T 0c9fe29cff29460fbd61e24c34cc3b76 P b1b8c5d9e97a4f6093943358b1aa9eed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1b8c5d9e97a4f6093943358b1aa9eed, State: Initialized, Role: FOLLOWER
I20260808 11:31:11.853181 27997 consensus_queue.cc:260] T 0c9fe29cff29460fbd61e24c34cc3b76 P b1b8c5d9e97a4f6093943358b1aa9eed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4801330cc5c4c5388cbd0baae91d2aa" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34439 } } peers { permanent_uuid: "516afafe5ed94cefa0de9a0f302b0b08" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 45587 } } peers { permanent_uuid: "b1b8c5d9e97a4f6093943358b1aa9eed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 46451 } }
I20260808 11:31:11.854141 27974 heartbeater.cc:503] Master 127.26.66.190:35107 was elected leader, sending a full tablet report...
I20260808 11:31:11.854758 27997 ts_tablet_manager.cc:1428] T 0c9fe29cff29460fbd61e24c34cc3b76 P b1b8c5d9e97a4f6093943358b1aa9eed: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260808 11:31:11.892326 28001 raft_consensus.cc:482] T 0c9fe29cff29460fbd61e24c34cc3b76 P f4801330cc5c4c5388cbd0baae91d2aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:31:11.892679 28001 raft_consensus.cc:504] T 0c9fe29cff29460fbd61e24c34cc3b76 P f4801330cc5c4c5388cbd0baae91d2aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4801330cc5c4c5388cbd0baae91d2aa" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34439 } } peers { permanent_uuid: "516afafe5ed94cefa0de9a0f302b0b08" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 45587 } } peers { permanent_uuid: "b1b8c5d9e97a4f6093943358b1aa9eed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 46451 } }
I20260808 11:31:11.894758 28001 leader_election.cc:288] T 0c9fe29cff29460fbd61e24c34cc3b76 P f4801330cc5c4c5388cbd0baae91d2aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 516afafe5ed94cefa0de9a0f302b0b08 (127.26.66.130:45587), b1b8c5d9e97a4f6093943358b1aa9eed (127.26.66.131:46451)
I20260808 11:31:11.902333 27991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:11.895407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:57689 (local address 127.26.66.130:45587)
0808 11:31:11.895635 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:11.895643 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:11.896269 (+ 626us) server_negotiation.cc:407] Connection header received
0808 11:31:11.896520 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:11.896526 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:11.896599 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:11.896696 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:31:11.897262 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.898039 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.900367 (+ 2328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.901452 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.901607 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:11.901684 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:11.901947 (+ 263us) server_negotiation.cc:299] Negotiation successful
0808 11:31:11.902087 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 11:31:11.902364 28004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:11.895404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:45587 (local address 127.26.66.129:57689)
0808 11:31:11.896147 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:11.896168 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:11.896362 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:11.896714 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:11.896718 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:11.896745 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:31:11.897109 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:11.897118 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.898185 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.898191 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:11.900186 (+ 1995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:11.900201 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.901631 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.901635 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:11.901781 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:11.901805 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 11:31:11.901881 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 11:31:11.901965 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"thread_start_us":612,"threads_started":1}
I20260808 11:31:11.903077 28005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:11.895799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:46451 (local address 127.26.66.129:35205)
0808 11:31:11.896529 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:11.896543 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:11.896708 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:11.897067 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:11.897071 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:11.897099 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:31:11.897455 (+ 356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:11.897464 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.898550 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.898555 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:11.900591 (+ 2036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:11.900606 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.902186 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.902192 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:11.902362 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:11.902403 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 11:31:11.902638 (+ 235us) client_negotiation.cc:240] Negotiation successful
0808 11:31:11.902726 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"mutex_wait_us":1,"thread_start_us":462,"threads_started":1}
I20260808 11:31:11.903110 27993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:11.895358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:35205 (local address 127.26.66.131:46451)
0808 11:31:11.895572 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:11.895576 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:11.896647 (+ 1071us) server_negotiation.cc:407] Connection header received
0808 11:31:11.896859 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:11.896864 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:11.896934 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:11.897034 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:31:11.897615 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.898407 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.900755 (+ 2348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.901950 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.902104 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:11.902171 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:11.902773 (+ 602us) server_negotiation.cc:299] Negotiation successful
0808 11:31:11.902912 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 11:31:11.903481 27789 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c9fe29cff29460fbd61e24c34cc3b76" candidate_uuid: "f4801330cc5c4c5388cbd0baae91d2aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "516afafe5ed94cefa0de9a0f302b0b08" is_pre_election: true
I20260808 11:31:11.904042 27789 raft_consensus.cc:2454] T 0c9fe29cff29460fbd61e24c34cc3b76 P 516afafe5ed94cefa0de9a0f302b0b08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4801330cc5c4c5388cbd0baae91d2aa in term 0.
I20260808 11:31:11.904078 27927 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c9fe29cff29460fbd61e24c34cc3b76" candidate_uuid: "f4801330cc5c4c5388cbd0baae91d2aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1b8c5d9e97a4f6093943358b1aa9eed" is_pre_election: true
I20260808 11:31:11.904635 27927 raft_consensus.cc:2454] T 0c9fe29cff29460fbd61e24c34cc3b76 P b1b8c5d9e97a4f6093943358b1aa9eed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4801330cc5c4c5388cbd0baae91d2aa in term 0.
I20260808 11:31:11.904747 27584 leader_election.cc:302] T 0c9fe29cff29460fbd61e24c34cc3b76 P f4801330cc5c4c5388cbd0baae91d2aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 516afafe5ed94cefa0de9a0f302b0b08, f4801330cc5c4c5388cbd0baae91d2aa; no voters:
I20260808 11:31:11.905169 28001 raft_consensus.cc:2781] T 0c9fe29cff29460fbd61e24c34cc3b76 P f4801330cc5c4c5388cbd0baae91d2aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:31:11.905331 28001 raft_consensus.cc:482] T 0c9fe29cff29460fbd61e24c34cc3b76 P f4801330cc5c4c5388cbd0baae91d2aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:31:11.905458 28001 raft_consensus.cc:3037] T 0c9fe29cff29460fbd61e24c34cc3b76 P f4801330cc5c4c5388cbd0baae91d2aa [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:11.907687 28001 raft_consensus.cc:504] T 0c9fe29cff29460fbd61e24c34cc3b76 P f4801330cc5c4c5388cbd0baae91d2aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4801330cc5c4c5388cbd0baae91d2aa" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34439 } } peers { permanent_uuid: "516afafe5ed94cefa0de9a0f302b0b08" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 45587 } } peers { permanent_uuid: "b1b8c5d9e97a4f6093943358b1aa9eed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 46451 } }
I20260808 11:31:11.908277 28001 leader_election.cc:288] T 0c9fe29cff29460fbd61e24c34cc3b76 P f4801330cc5c4c5388cbd0baae91d2aa [CANDIDATE]: Term 1 election: Requested vote from peers 516afafe5ed94cefa0de9a0f302b0b08 (127.26.66.130:45587), b1b8c5d9e97a4f6093943358b1aa9eed (127.26.66.131:46451)
I20260808 11:31:11.908740 27789 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c9fe29cff29460fbd61e24c34cc3b76" candidate_uuid: "f4801330cc5c4c5388cbd0baae91d2aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "516afafe5ed94cefa0de9a0f302b0b08"
I20260808 11:31:11.908959 27789 raft_consensus.cc:3037] T 0c9fe29cff29460fbd61e24c34cc3b76 P 516afafe5ed94cefa0de9a0f302b0b08 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:11.908941 27927 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c9fe29cff29460fbd61e24c34cc3b76" candidate_uuid: "f4801330cc5c4c5388cbd0baae91d2aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1b8c5d9e97a4f6093943358b1aa9eed"
I20260808 11:31:11.909148 27927 raft_consensus.cc:3037] T 0c9fe29cff29460fbd61e24c34cc3b76 P b1b8c5d9e97a4f6093943358b1aa9eed [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:11.912382 27927 raft_consensus.cc:2454] T 0c9fe29cff29460fbd61e24c34cc3b76 P b1b8c5d9e97a4f6093943358b1aa9eed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4801330cc5c4c5388cbd0baae91d2aa in term 1.
I20260808 11:31:11.912382 27789 raft_consensus.cc:2454] T 0c9fe29cff29460fbd61e24c34cc3b76 P 516afafe5ed94cefa0de9a0f302b0b08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4801330cc5c4c5388cbd0baae91d2aa in term 1.
I20260808 11:31:11.912825 27581 leader_election.cc:302] T 0c9fe29cff29460fbd61e24c34cc3b76 P f4801330cc5c4c5388cbd0baae91d2aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1b8c5d9e97a4f6093943358b1aa9eed, f4801330cc5c4c5388cbd0baae91d2aa; no voters:
I20260808 11:31:11.913167 28001 raft_consensus.cc:2781] T 0c9fe29cff29460fbd61e24c34cc3b76 P f4801330cc5c4c5388cbd0baae91d2aa [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:31:11.913640 28001 raft_consensus.cc:686] T 0c9fe29cff29460fbd61e24c34cc3b76 P f4801330cc5c4c5388cbd0baae91d2aa [term 1 LEADER]: Becoming Leader. State: Replica: f4801330cc5c4c5388cbd0baae91d2aa, State: Running, Role: LEADER
I20260808 11:31:11.914202 28001 consensus_queue.cc:237] T 0c9fe29cff29460fbd61e24c34cc3b76 P f4801330cc5c4c5388cbd0baae91d2aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4801330cc5c4c5388cbd0baae91d2aa" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34439 } } peers { permanent_uuid: "516afafe5ed94cefa0de9a0f302b0b08" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 45587 } } peers { permanent_uuid: "b1b8c5d9e97a4f6093943358b1aa9eed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 46451 } }
I20260808 11:31:11.919050 27496 catalog_manager.cc:5495] T 0c9fe29cff29460fbd61e24c34cc3b76 P f4801330cc5c4c5388cbd0baae91d2aa reported cstate change: term changed from 0 to 1, leader changed from <none> to f4801330cc5c4c5388cbd0baae91d2aa (127.26.66.129). New cstate: current_term: 1 leader_uuid: "f4801330cc5c4c5388cbd0baae91d2aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4801330cc5c4c5388cbd0baae91d2aa" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "516afafe5ed94cefa0de9a0f302b0b08" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 45587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1b8c5d9e97a4f6093943358b1aa9eed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 46451 } health_report { overall_health: UNKNOWN } } }
W20260808 11:31:11.936980 27837 tablet.cc:2369] T 0c9fe29cff29460fbd61e24c34cc3b76 P 516afafe5ed94cefa0de9a0f302b0b08: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 11:31:11 dist-test-slave-zkpd krb5kdc[27446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188669, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.129@KRBTEST.COM
W20260808 11:31:11.941705 27697 tablet.cc:2369] T 0c9fe29cff29460fbd61e24c34cc3b76 P f4801330cc5c4c5388cbd0baae91d2aa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:31:11.947824 27988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:11.932249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38914 (local address 127.26.66.129:34439)
0808 11:31:11.932497 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:11.932505 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:11.933191 (+ 686us) server_negotiation.cc:407] Connection header received
0808 11:31:11.933373 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:11.933377 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:11.933439 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:11.933588 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:11.935738 (+ 2150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.936660 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.937962 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.938364 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.938458 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:11.942479 (+ 4021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:11.942489 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:11.942502 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:11.942531 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:11.945492 (+ 2961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:11.946069 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:11.946075 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:11.946077 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:11.946233 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:11.946541 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:11.946544 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:11.946546 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:11.946862 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:11.947078 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:11.947272 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 11:31:11.947459 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
W20260808 11:31:11.955193 27975 tablet.cc:2369] T 0c9fe29cff29460fbd61e24c34cc3b76 P b1b8c5d9e97a4f6093943358b1aa9eed: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 11:31:11 dist-test-slave-zkpd krb5kdc[27446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188671, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 11:31:11 dist-test-slave-zkpd krb5kdc[27446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188671, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.66.129@KRBTEST.COM
I20260808 11:31:12.000312 27988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:11.985937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38922 (local address 127.26.66.129:34439)
0808 11:31:11.986158 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:11.986165 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:11.986509 (+ 344us) server_negotiation.cc:407] Connection header received
0808 11:31:11.986718 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:11.986722 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:11.986791 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:11.986898 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:11.988328 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.989078 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.990364 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:11.990816 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:11.990952 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:11.995055 (+ 4103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:11.995061 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:11.995064 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:11.995100 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:11.997615 (+ 2515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:11.998260 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:11.998266 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:11.998269 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:11.998411 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:11.998830 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:11.998835 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:11.998838 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:11.999117 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:11.999422 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:11.999693 (+ 271us) server_negotiation.cc:299] Negotiation successful
0808 11:31:11.999969 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
Aug 08 11:31:12 dist-test-slave-zkpd krb5kdc[27446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188672, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 11:31:12 dist-test-slave-zkpd krb5kdc[27446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188672, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.129@KRBTEST.COM
I20260808 11:31:12.052888 27988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:12.038652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38934 (local address 127.26.66.129:34439)
0808 11:31:12.038886 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:12.038896 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:12.039232 (+ 336us) server_negotiation.cc:407] Connection header received
0808 11:31:12.039474 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:12.039479 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:12.039561 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:12.039675 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:12.041276 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:12.042071 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:12.043359 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:12.043813 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:12.043979 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:12.048174 (+ 4195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:12.048187 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:12.048191 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:12.048224 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:12.050682 (+ 2458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:12.051269 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:12.051273 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:12.051275 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:12.051405 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:12.051709 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:12.051712 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:12.051714 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:12.052037 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:12.052235 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:12.052467 (+ 232us) server_negotiation.cc:299] Negotiation successful
0808 11:31:12.052626 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
W20260808 11:31:12.054716 27608 tablet_service.cc:2908] Rejecting scan request for tablet 0c9fe29cff29460fbd61e24c34cc3b76: Uninitialized: clean time has not yet been initialized
I20260808 11:31:12.057621 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 27563
I20260808 11:31:12.069839 27988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:12.058665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38936 (local address 127.26.66.129:34439)
0808 11:31:12.058817 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:12.058823 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:12.059148 (+ 325us) server_negotiation.cc:407] Connection header received
0808 11:31:12.059260 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:12.059264 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:12.059326 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:12.059401 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:12.060636 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:12.061288 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:12.062461 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:12.062849 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:12.062936 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:12.065209 (+ 2273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:12.065213 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:12.065216 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:12.065245 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:12.067635 (+ 2390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:12.068304 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:12.068308 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:12.068310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:12.068426 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:12.068736 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:12.068739 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:12.068741 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:12.068985 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:12.069156 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:12.069409 (+ 253us) server_negotiation.cc:299] Negotiation successful
0808 11:31:12.069590 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 11:31:12.070506 27691 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:12.166836 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 27563
I20260808 11:31:12.189500 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 27702
Aug 08 11:31:12 dist-test-slave-zkpd krb5kdc[27446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188672, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.130@KRBTEST.COM
I20260808 11:31:12.204253 27991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:12.190312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48800 (local address 127.26.66.130:45587)
0808 11:31:12.190499 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:12.190507 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:12.190530 (+ 23us) server_negotiation.cc:407] Connection header received
0808 11:31:12.190780 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:12.190785 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:12.190877 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:12.190999 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:12.192224 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:12.193074 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:12.194353 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:12.194755 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:12.194893 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:12.198762 (+ 3869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:12.198772 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:12.198801 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:12.198832 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:12.201694 (+ 2862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:12.202269 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:12.202276 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:12.202278 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:12.202393 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:12.202857 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:12.202860 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:12.202862 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:12.203196 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:12.203434 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:12.203651 (+ 217us) server_negotiation.cc:299] Negotiation successful
0808 11:31:12.203813 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 11:31:12.204916 27831 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:12.295817 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 27702
I20260808 11:31:12.318913 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 27841
Aug 08 11:31:12 dist-test-slave-zkpd krb5kdc[27446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188672, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.131@KRBTEST.COM
I20260808 11:31:12.335702 27993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:12.319854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34908 (local address 127.26.66.131:46451)
0808 11:31:12.320106 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:12.320113 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:12.320138 (+ 25us) server_negotiation.cc:407] Connection header received
0808 11:31:12.320308 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:12.320314 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:12.320409 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:12.320533 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:12.321913 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:12.322759 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:12.324272 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:12.324738 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:12.324893 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:12.329492 (+ 4599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:12.329509 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:12.329526 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:12.329562 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:12.332910 (+ 3348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:12.333596 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:12.333604 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:12.333607 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:12.333810 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:12.334162 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:12.334166 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:12.334168 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:12.334603 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:12.334940 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:12.335195 (+ 255us) server_negotiation.cc:299] Negotiation successful
0808 11:31:12.335408 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260808 11:31:12.336472 27968 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:12.424189 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 27841
I20260808 11:31:12.445448 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 27461
I20260808 11:31:12.446624 27530 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:12.560421 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 27461
2026-08-08T11:31:12Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4247 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:31:12 dist-test-slave-zkpd krb5kdc[28026](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:31:12 dist-test-slave-zkpd krb5kdc[28026](info): set up 2 sockets
Aug 08 11:31:12 dist-test-slave-zkpd krb5kdc[28026](info): commencing operation
krb5kdc: starting...
W20260808 11:31:13.736714 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.000s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:31:13 dist-test-slave-zkpd krb5kdc[28026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188673, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:31:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:31:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:31:13.947782 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:36747
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:43255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:36747
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:14.277362 28040 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:14.277696 28040 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:14.277872 28040 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:14.285359 28040 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:31:14.285526 28040 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 11:31:14.285625 28040 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:14.285750 28040 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:14.285836 28040 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:31:14.285930 28040 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:31:14.296285 28040 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:43255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:36747
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:36747
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:14.297634 28040 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:14.298997 28040 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:14.311046 28045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:14.311069 28046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:14.311142 28048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:14.311685 28040 server_base.cc:1034] running on GCE node
I20260808 11:31:14.312626 28040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:14.314021 28040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:14.315274 28040 hybrid_clock.cc:648] HybridClock initialized: now 1786188674315208 us; error 38 us; skew 500 ppm
I20260808 11:31:14.315646 28040 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:14 dist-test-slave-zkpd krb5kdc[28026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188674, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:14.318849 28040 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:31:14.320377 28040 webserver.cc:460] Webserver started at http://127.26.66.190:41665/ using document root <none> and password file <none>
I20260808 11:31:14.321092 28040 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:14.321213 28040 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:14.321574 28040 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:14.324671 28040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "3c5c900c91ec47d0acbbcb9c700a77e0"
format_stamp: "Formatted at 2026-08-08 11:31:14 on dist-test-slave-zkpd"
server_key: "c8a3718d793f279dacb354ea87babaf0"
server_key_iv: "0b727ee394a4b95aed8c2ccd83c0ff10"
server_key_version: "encryptionkey@0"
I20260808 11:31:14.325482 28040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "3c5c900c91ec47d0acbbcb9c700a77e0"
format_stamp: "Formatted at 2026-08-08 11:31:14 on dist-test-slave-zkpd"
server_key: "c8a3718d793f279dacb354ea87babaf0"
server_key_iv: "0b727ee394a4b95aed8c2ccd83c0ff10"
server_key_version: "encryptionkey@0"
I20260808 11:31:14.330785 28040 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 11:31:14.334223 28055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:14.335472 28040 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 11:31:14.335644 28040 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "3c5c900c91ec47d0acbbcb9c700a77e0"
format_stamp: "Formatted at 2026-08-08 11:31:14 on dist-test-slave-zkpd"
server_key: "c8a3718d793f279dacb354ea87babaf0"
server_key_iv: "0b727ee394a4b95aed8c2ccd83c0ff10"
server_key_version: "encryptionkey@0"
I20260808 11:31:14.335870 28040 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:14.350271 28040 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:14.354120 28040 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:14.354408 28040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:14.376802 28040 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:36747
I20260808 11:31:14.376834 28120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:36747 every 8 connection(s)
I20260808 11:31:14.378177 28040 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:31:14.381896 28121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:14.386868 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 28040
I20260808 11:31:14.387130 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:31:14.387778 26890 external_mini_cluster.cc:1428] Setting key e2895ba753150db786997ec0ad9090da
I20260808 11:31:14.392832 28121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c5c900c91ec47d0acbbcb9c700a77e0: Bootstrap starting.
I20260808 11:31:14.396692 28121 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c5c900c91ec47d0acbbcb9c700a77e0: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:14.397950 28121 log.cc:824] T 00000000000000000000000000000000 P 3c5c900c91ec47d0acbbcb9c700a77e0: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:14.401777 28121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c5c900c91ec47d0acbbcb9c700a77e0: No bootstrap required, opened a new log
Aug 08 11:31:14 dist-test-slave-zkpd krb5kdc[28026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188673, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:14.413350 28124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:14.389761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51546 (local address 127.26.66.190:36747)
0808 11:31:14.390593 (+ 832us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:14.390604 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:14.390648 (+ 44us) server_negotiation.cc:407] Connection header received
0808 11:31:14.392458 (+ 1810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:14.392479 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:14.392827 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:14.393185 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:14.395008 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:14.396379 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:14.398219 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:14.399326 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:14.399492 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:14.404612 (+ 5120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:14.404623 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:14.404642 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:14.404694 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:14.408800 (+ 4106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:14.409470 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:14.409478 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:14.409486 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:14.409700 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:14.410054 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:14.410059 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:14.410062 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:14.410790 (+ 728us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:14.411138 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:14.411496 (+ 358us) server_negotiation.cc:299] Negotiation successful
0808 11:31:14.411992 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":637,"thread_start_us":417,"threads_started":1}
I20260808 11:31:14.413345 28121 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c5c900c91ec47d0acbbcb9c700a77e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c5c900c91ec47d0acbbcb9c700a77e0" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 36747 } }
I20260808 11:31:14.413841 28121 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c5c900c91ec47d0acbbcb9c700a77e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:14.413960 28121 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c5c900c91ec47d0acbbcb9c700a77e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c5c900c91ec47d0acbbcb9c700a77e0, State: Initialized, Role: FOLLOWER
I20260808 11:31:14.414597 28121 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c5c900c91ec47d0acbbcb9c700a77e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c5c900c91ec47d0acbbcb9c700a77e0" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 36747 } }
I20260808 11:31:14.414856 28121 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c5c900c91ec47d0acbbcb9c700a77e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:31:14.415015 28121 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c5c900c91ec47d0acbbcb9c700a77e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:31:14.415195 28121 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c5c900c91ec47d0acbbcb9c700a77e0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:14.417550 28121 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c5c900c91ec47d0acbbcb9c700a77e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c5c900c91ec47d0acbbcb9c700a77e0" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 36747 } }
I20260808 11:31:14.418041 28121 leader_election.cc:302] T 00000000000000000000000000000000 P 3c5c900c91ec47d0acbbcb9c700a77e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c5c900c91ec47d0acbbcb9c700a77e0; no voters:
I20260808 11:31:14.418614 28121 leader_election.cc:288] T 00000000000000000000000000000000 P 3c5c900c91ec47d0acbbcb9c700a77e0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:31:14.418776 28126 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c5c900c91ec47d0acbbcb9c700a77e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:31:14.419528 28126 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c5c900c91ec47d0acbbcb9c700a77e0 [term 1 LEADER]: Becoming Leader. State: Replica: 3c5c900c91ec47d0acbbcb9c700a77e0, State: Running, Role: LEADER
I20260808 11:31:14.420112 28126 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c5c900c91ec47d0acbbcb9c700a77e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c5c900c91ec47d0acbbcb9c700a77e0" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 36747 } }
I20260808 11:31:14.420790 28121 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c5c900c91ec47d0acbbcb9c700a77e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:31:14.423647 28128 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c5c900c91ec47d0acbbcb9c700a77e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c5c900c91ec47d0acbbcb9c700a77e0. Latest consensus state: current_term: 1 leader_uuid: "3c5c900c91ec47d0acbbcb9c700a77e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c5c900c91ec47d0acbbcb9c700a77e0" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 36747 } } }
I20260808 11:31:14.424016 28128 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c5c900c91ec47d0acbbcb9c700a77e0 [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:14.424099 28127 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c5c900c91ec47d0acbbcb9c700a77e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c5c900c91ec47d0acbbcb9c700a77e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c5c900c91ec47d0acbbcb9c700a77e0" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 36747 } } }
I20260808 11:31:14.424412 28127 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c5c900c91ec47d0acbbcb9c700a77e0 [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:14.429602 28134 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:31:14.435389 28134 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:31:14.444468 28134 catalog_manager.cc:1347] Generated new cluster ID: 9a47d1462dc9418caf734470d808440f
I20260808 11:31:14.444574 28134 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:31:14.481467 28134 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:31:14.483390 28134 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:31:14.501976 28134 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c5c900c91ec47d0acbbcb9c700a77e0: Generated new TSK 0
I20260808 11:31:14.502964 28134 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.66.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
I20260808 11:31:14.571669 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:0
--local_ip_for_outbound_sockets=127.26.66.129
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:36747
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:43255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:14.938999 28150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:14.939312 28150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:14.939495 28150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:14.946630 28150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:14.946779 28150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:14.946910 28150 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 11:31:14.947067 28150 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:31:14.956452 28150 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:43255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.66.190:36747
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:14.957638 28150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:14.958949 28150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:14.972534 28155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:14.972508 28156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:14.972576 28158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:14.973631 28150 server_base.cc:1034] running on GCE node
I20260808 11:31:14.974308 28150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:14.975211 28150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:14.976452 28150 hybrid_clock.cc:648] HybridClock initialized: now 1786188674976393 us; error 35 us; skew 500 ppm
I20260808 11:31:14.976758 28150 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:14 dist-test-slave-zkpd krb5kdc[28026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188674, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:14.979933 28150 init.cc:377] Logged in from keytab as kudu/127.26.66.129@KRBTEST.COM (short username kudu)
I20260808 11:31:14.981463 28150 webserver.cc:460] Webserver started at http://127.26.66.129:45029/ using document root <none> and password file <none>
I20260808 11:31:14.982126 28150 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:14.982214 28150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:14.982475 28150 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:14.985420 28150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-0/data/instance:
uuid: "a76de7b6df7048c2afe9bc496e0e09e1"
format_stamp: "Formatted at 2026-08-08 11:31:14 on dist-test-slave-zkpd"
server_key: "1d6dd7837c1aaa42589560e0f1c31401"
server_key_iv: "aca57927c073f1f5b7e03751e63f55ba"
server_key_version: "encryptionkey@0"
I20260808 11:31:14.986176 28150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance:
uuid: "a76de7b6df7048c2afe9bc496e0e09e1"
format_stamp: "Formatted at 2026-08-08 11:31:14 on dist-test-slave-zkpd"
server_key: "1d6dd7837c1aaa42589560e0f1c31401"
server_key_iv: "aca57927c073f1f5b7e03751e63f55ba"
server_key_version: "encryptionkey@0"
I20260808 11:31:14.991369 28150 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260808 11:31:14.994944 28165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:14.996369 28150 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:31:14.996542 28150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "a76de7b6df7048c2afe9bc496e0e09e1"
format_stamp: "Formatted at 2026-08-08 11:31:14 on dist-test-slave-zkpd"
server_key: "1d6dd7837c1aaa42589560e0f1c31401"
server_key_iv: "aca57927c073f1f5b7e03751e63f55ba"
server_key_version: "encryptionkey@0"
I20260808 11:31:14.996763 28150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:15.033432 28150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:15.037467 28150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:15.037751 28150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:15.040822 28150 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:15.040930 28150 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:15.041067 28150 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:15.041154 28150 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 11:31:15 dist-test-slave-zkpd krb5kdc[28026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188674, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:15.063563 28176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:15.041421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:42477 (local address 127.26.66.190:36747)
0808 11:31:15.042126 (+ 705us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:15.042130 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:15.043129 (+ 999us) server_negotiation.cc:407] Connection header received
0808 11:31:15.045183 (+ 2054us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:15.045189 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:15.045275 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:15.045405 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:15.047541 (+ 2136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:15.048913 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:15.051610 (+ 2697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:15.052084 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:15.052225 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:15.057346 (+ 5121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:15.057350 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:15.057354 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:15.057387 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:15.060027 (+ 2640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:15.061130 (+ 1103us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:15.061137 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:15.061143 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:15.061334 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:15.061775 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:15.061781 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:15.061784 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:15.062074 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:15.062232 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:15.062963 (+ 731us) server_negotiation.cc:299] Negotiation successful
0808 11:31:15.063188 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":599,"thread_start_us":490,"threads_started":1}
I20260808 11:31:15.064654 28177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:15.042155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:36747 (local address 127.26.66.129:42477)
0808 11:31:15.042968 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:15.043006 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:15.044912 (+ 1906us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:15.045633 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:15.045642 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:15.046431 (+ 789us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:15.047317 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:15.047350 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:15.049220 (+ 1870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:15.049226 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:15.051420 (+ 2194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:15.051436 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:15.052347 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:15.052355 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:15.052582 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:15.053343 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:15.053368 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:15.057076 (+ 3708us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:15.060176 (+ 3100us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:15.060184 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:15.060199 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:15.060927 (+ 728us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:15.061464 (+ 537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:15.061467 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:15.061470 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:15.061656 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:15.062218 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:15.062226 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:15.062588 (+ 362us) client_negotiation.cc:769] Sending connection context
0808 11:31:15.062872 (+ 284us) client_negotiation.cc:240] Negotiation successful
0808 11:31:15.063387 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":372,"threads_started":1}
I20260808 11:31:15.086645 28228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:15.070687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:36747 (local address 127.26.66.129:33235)
0808 11:31:15.071947 (+ 1260us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:15.071973 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:15.072153 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:15.072481 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:15.072486 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:15.073274 (+ 788us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:15.073790 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:15.073808 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:15.075140 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:15.075149 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:15.076717 (+ 1568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:15.076730 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:15.077514 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:15.077521 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:15.077705 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:15.078573 (+ 868us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:15.078590 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:15.079369 (+ 779us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:15.082916 (+ 3547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:15.082923 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:15.082932 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:15.083696 (+ 764us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:15.084322 (+ 626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:15.084329 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:15.084335 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:15.084534 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:15.085305 (+ 771us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:15.085309 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:15.085556 (+ 247us) client_negotiation.cc:769] Sending connection context
0808 11:31:15.085741 (+ 185us) client_negotiation.cc:240] Negotiation successful
0808 11:31:15.086087 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1047,"thread_start_us":691,"threads_started":1}
I20260808 11:31:15.086956 28176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:15.070681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:33235 (local address 127.26.66.190:36747)
0808 11:31:15.070907 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:15.070915 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:15.072076 (+ 1161us) server_negotiation.cc:407] Connection header received
0808 11:31:15.072270 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:15.072273 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:15.072334 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:15.072444 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:15.073952 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:15.074973 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:15.076861 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:15.077294 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:15.077446 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:15.079573 (+ 2127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:15.079579 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:15.079582 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:15.079610 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:15.082758 (+ 3148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:15.083977 (+ 1219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:15.083985 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:15.083991 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:15.084157 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:15.084673 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:15.084681 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:15.084684 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:15.085087 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:15.085247 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:15.086166 (+ 919us) server_negotiation.cc:299] Negotiation successful
0808 11:31:15.086465 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 11:31:15.096596 28150 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:42995
I20260808 11:31:15.096635 28294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:42995 every 8 connection(s)
I20260808 11:31:15.097770 28150 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:31:15.099833 28295 heartbeater.cc:347] Connected to a master server at 127.26.66.190:36747
I20260808 11:31:15.100080 28295 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:15.100724 28295 heartbeater.cc:511] Master 127.26.66.190:36747 requested a full tablet report, sending...
I20260808 11:31:15.102819 28073 ts_manager.cc:194] Registered new tserver with Master: a76de7b6df7048c2afe9bc496e0e09e1 (127.26.66.129:42995)
I20260808 11:31:15.104348 28073 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.129@KRBTEST.COM'} at 127.26.66.129:42477
I20260808 11:31:15.104620 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 28150
I20260808 11:31:15.104843 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance
I20260808 11:31:15.105683 26890 external_mini_cluster.cc:1428] Setting key 3747fda95630806872bf4acadbe93e2b
WARNING: no policy specified for kudu/127.26.66.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
I20260808 11:31:15.153759 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:0
--local_ip_for_outbound_sockets=127.26.66.130
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:36747
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:43255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:15.513146 28299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:15.513411 28299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:15.513613 28299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:15.520862 28299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:15.520999 28299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:15.521162 28299 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 11:31:15.521281 28299 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:31:15.531574 28299 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:43255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.66.190:36747
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:15.532945 28299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:15.534375 28299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:15.548039 28305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:15.547998 28307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:15.548084 28304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:15.548913 28299 server_base.cc:1034] running on GCE node
I20260808 11:31:15.549608 28299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:15.550515 28299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:15.551718 28299 hybrid_clock.cc:648] HybridClock initialized: now 1786188675551658 us; error 29 us; skew 500 ppm
I20260808 11:31:15.552052 28299 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:15 dist-test-slave-zkpd krb5kdc[28026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188675, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:15.555203 28299 init.cc:377] Logged in from keytab as kudu/127.26.66.130@KRBTEST.COM (short username kudu)
I20260808 11:31:15.556855 28299 webserver.cc:460] Webserver started at http://127.26.66.130:43219/ using document root <none> and password file <none>
I20260808 11:31:15.557570 28299 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:15.557659 28299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:15.557929 28299 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:15.560913 28299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-1/data/instance:
uuid: "21c23ce1954e4f1c92b41c45da21e351"
format_stamp: "Formatted at 2026-08-08 11:31:15 on dist-test-slave-zkpd"
server_key: "76b8c8b39cc2e87e81d5b5b793d8932e"
server_key_iv: "d1e81c95235bd6fac55c266ba79ab66e"
server_key_version: "encryptionkey@0"
I20260808 11:31:15.561769 28299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance:
uuid: "21c23ce1954e4f1c92b41c45da21e351"
format_stamp: "Formatted at 2026-08-08 11:31:15 on dist-test-slave-zkpd"
server_key: "76b8c8b39cc2e87e81d5b5b793d8932e"
server_key_iv: "d1e81c95235bd6fac55c266ba79ab66e"
server_key_version: "encryptionkey@0"
I20260808 11:31:15.568161 28299 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260808 11:31:15.571853 28315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:15.573300 28299 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:31:15.573480 28299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "21c23ce1954e4f1c92b41c45da21e351"
format_stamp: "Formatted at 2026-08-08 11:31:15 on dist-test-slave-zkpd"
server_key: "76b8c8b39cc2e87e81d5b5b793d8932e"
server_key_iv: "d1e81c95235bd6fac55c266ba79ab66e"
server_key_version: "encryptionkey@0"
I20260808 11:31:15.573727 28299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:15.599542 28299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:15.604087 28299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:15.604370 28299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:15.607158 28299 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:15.607267 28299 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:15.607419 28299 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:15.607496 28299 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 11:31:15 dist-test-slave-zkpd krb5kdc[28026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188675, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:15.633102 28325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:15.607871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:47693 (local address 127.26.66.190:36747)
0808 11:31:15.608661 (+ 790us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:15.608668 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:15.609604 (+ 936us) server_negotiation.cc:407] Connection header received
0808 11:31:15.611701 (+ 2097us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:15.611711 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:15.611841 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:15.612007 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:15.614273 (+ 2266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:15.615761 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:15.618133 (+ 2372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:15.619082 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:15.619258 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:15.624889 (+ 5631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:15.624900 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:15.624907 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:15.624994 (+ 87us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:15.629486 (+ 4492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:15.630274 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:15.630282 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:15.630288 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:15.630499 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:15.631011 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:15.631018 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:15.631024 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:15.631492 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:15.631691 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:15.632447 (+ 756us) server_negotiation.cc:299] Negotiation successful
0808 11:31:15.632675 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":652,"thread_start_us":281,"threads_started":1}
I20260808 11:31:15.634577 28326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:15.608428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:36747 (local address 127.26.66.130:47693)
0808 11:31:15.609405 (+ 977us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:15.609461 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:15.611415 (+ 1954us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:15.612243 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:15.612255 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:15.613034 (+ 779us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:15.614032 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:15.614081 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:15.615972 (+ 1891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:15.615979 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:15.617967 (+ 1988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:15.617980 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:15.619321 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:15.619326 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:15.619505 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:15.620369 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:15.620402 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:15.624379 (+ 3977us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:15.629673 (+ 5294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:15.629680 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:15.629692 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:15.630135 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:15.630613 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:15.630617 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:15.630619 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:15.630866 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:15.631617 (+ 751us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:15.631623 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:15.632034 (+ 411us) client_negotiation.cc:769] Sending connection context
0808 11:31:15.632323 (+ 289us) client_negotiation.cc:240] Negotiation successful
0808 11:31:15.632877 (+ 554us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":710,"thread_start_us":439,"threads_started":1}
I20260808 11:31:15.655014 28387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:15.642098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:36747 (local address 127.26.66.130:40501)
0808 11:31:15.642729 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:15.642745 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:15.642916 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:15.643300 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:15.643305 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:15.643781 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:15.644203 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:15.644217 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:15.645213 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:15.645218 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:15.646213 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:15.646225 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:15.646977 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:15.646983 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:15.647144 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:15.647756 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:15.647772 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:15.648798 (+ 1026us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:15.652347 (+ 3549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:15.652352 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:15.652356 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:15.652985 (+ 629us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:15.653369 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:15.653373 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:15.653377 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:15.653510 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:15.654083 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:15.654088 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:15.654269 (+ 181us) client_negotiation.cc:769] Sending connection context
0808 11:31:15.654432 (+ 163us) client_negotiation.cc:240] Negotiation successful
0808 11:31:15.654697 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":375,"threads_started":1}
I20260808 11:31:15.655700 28325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:15.642044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:40501 (local address 127.26.66.190:36747)
0808 11:31:15.642203 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:15.642207 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:15.642843 (+ 636us) server_negotiation.cc:407] Connection header received
0808 11:31:15.643058 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:15.643069 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:15.643161 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:15.643262 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:15.644365 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:15.645077 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:15.646361 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:15.646765 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:15.646901 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:15.649001 (+ 2100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:15.649006 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:15.649009 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:15.649038 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:15.652212 (+ 3174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:15.653121 (+ 909us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:15.653130 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:15.653134 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:15.653255 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:15.653618 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:15.653624 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:15.653627 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:15.653958 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:15.654132 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:15.654843 (+ 711us) server_negotiation.cc:299] Negotiation successful
0808 11:31:15.655167 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 11:31:15.676066 28299 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:36133
I20260808 11:31:15.676067 28439 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:36133 every 8 connection(s)
I20260808 11:31:15.677443 28299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:31:15.679759 28440 heartbeater.cc:347] Connected to a master server at 127.26.66.190:36747
I20260808 11:31:15.680029 28440 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:15.680698 28440 heartbeater.cc:511] Master 127.26.66.190:36747 requested a full tablet report, sending...
I20260808 11:31:15.682127 28073 ts_manager.cc:194] Registered new tserver with Master: 21c23ce1954e4f1c92b41c45da21e351 (127.26.66.130:36133)
I20260808 11:31:15.683139 28073 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.130@KRBTEST.COM'} at 127.26.66.130:47693
I20260808 11:31:15.685245 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 28299
I20260808 11:31:15.685462 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance
I20260808 11:31:15.685935 26890 external_mini_cluster.cc:1428] Setting key 5c92e299b6e8c254abff9f9db9f2b904
WARNING: no policy specified for kudu/127.26.66.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.131@KRBTEST.COM" created.
I20260808 11:31:16.107250 28295 heartbeater.cc:503] Master 127.26.66.190:36747 was elected leader, sending a full tablet report...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
W20260808 11:31:16.474426 26890 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.26.66.131: real 0.786s user 0.005s sys 0.008s
I20260808 11:31:16.475178 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:0
--local_ip_for_outbound_sockets=127.26.66.131
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:36747
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:43255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 11:31:16.685830 28440 heartbeater.cc:503] Master 127.26.66.190:36747 was elected leader, sending a full tablet report...
W20260808 11:31:16.819533 28444 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:16.819875 28444 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:16.820096 28444 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:16.827450 28444 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:16.827606 28444 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:16.827746 28444 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 11:31:16.827884 28444 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:31:16.838550 28444 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:43255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.66.190:36747
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:16.840132 28444 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:16.841873 28444 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:16.856272 28449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:16.856186 28452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:16.856231 28450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:16.857458 28444 server_base.cc:1034] running on GCE node
I20260808 11:31:16.858258 28444 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:16.859193 28444 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:16.860436 28444 hybrid_clock.cc:648] HybridClock initialized: now 1786188676860376 us; error 40 us; skew 500 ppm
I20260808 11:31:16.860733 28444 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:16 dist-test-slave-zkpd krb5kdc[28026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188676, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:16.863847 28444 init.cc:377] Logged in from keytab as kudu/127.26.66.131@KRBTEST.COM (short username kudu)
I20260808 11:31:16.865409 28444 webserver.cc:460] Webserver started at http://127.26.66.131:35389/ using document root <none> and password file <none>
I20260808 11:31:16.866074 28444 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:16.866160 28444 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:16.866549 28444 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:16.869544 28444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-2/data/instance:
uuid: "d6ea43b94bf44c50afba25c18707e98b"
format_stamp: "Formatted at 2026-08-08 11:31:16 on dist-test-slave-zkpd"
server_key: "e8d440422201e20bf3a4493a53cf5bb7"
server_key_iv: "b42626c5adbf82713f136fd91cbe5b7c"
server_key_version: "encryptionkey@0"
I20260808 11:31:16.870339 28444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance:
uuid: "d6ea43b94bf44c50afba25c18707e98b"
format_stamp: "Formatted at 2026-08-08 11:31:16 on dist-test-slave-zkpd"
server_key: "e8d440422201e20bf3a4493a53cf5bb7"
server_key_iv: "b42626c5adbf82713f136fd91cbe5b7c"
server_key_version: "encryptionkey@0"
I20260808 11:31:16.875412 28444 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 11:31:16.878995 28460 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:16.880348 28444 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:31:16.880517 28444 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "d6ea43b94bf44c50afba25c18707e98b"
format_stamp: "Formatted at 2026-08-08 11:31:16 on dist-test-slave-zkpd"
server_key: "e8d440422201e20bf3a4493a53cf5bb7"
server_key_iv: "b42626c5adbf82713f136fd91cbe5b7c"
server_key_version: "encryptionkey@0"
I20260808 11:31:16.880741 28444 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:16.904379 28444 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:16.908485 28444 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:16.908768 28444 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:16.911733 28444 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:16.911849 28444 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:16.912032 28444 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:16.912112 28444 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 11:31:16 dist-test-slave-zkpd krb5kdc[28026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188676, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:16.938485 28470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:16.912262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:36173 (local address 127.26.66.190:36747)
0808 11:31:16.913217 (+ 955us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:16.913221 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:16.913935 (+ 714us) server_negotiation.cc:407] Connection header received
0808 11:31:16.916343 (+ 2408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:16.916349 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:16.916442 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:16.916582 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:16.919271 (+ 2689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:16.920610 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:16.923785 (+ 3175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:16.924899 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:16.925051 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:16.929883 (+ 4832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:16.929890 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:16.929895 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:16.929940 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:16.934312 (+ 4372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:16.935559 (+ 1247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:16.935567 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:16.935573 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:16.935760 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:16.936609 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:16.936617 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:16.936621 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:16.936930 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:16.937081 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:16.937824 (+ 743us) server_negotiation.cc:299] Negotiation successful
0808 11:31:16.938056 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":845,"thread_start_us":719,"threads_started":1}
I20260808 11:31:16.940037 28471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:16.912921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:36747 (local address 127.26.66.131:36173)
0808 11:31:16.913755 (+ 834us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:16.913800 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:16.916073 (+ 2273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:16.916948 (+ 875us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:16.916965 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:16.917700 (+ 735us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:16.919012 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:16.919042 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:16.920837 (+ 1795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:16.920845 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:16.923604 (+ 2759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:16.923628 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:16.925159 (+ 1531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:16.925169 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:16.925539 (+ 370us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:16.926360 (+ 821us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:16.926381 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:16.929600 (+ 3219us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:16.934514 (+ 4914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:16.934526 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:16.934547 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:16.935412 (+ 865us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:16.936028 (+ 616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:16.936033 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:16.936043 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:16.936451 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:16.937084 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:16.937094 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:16.937455 (+ 361us) client_negotiation.cc:769] Sending connection context
0808 11:31:16.937719 (+ 264us) client_negotiation.cc:240] Negotiation successful
0808 11:31:16.938309 (+ 590us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":361,"threads_started":1}
I20260808 11:31:16.957851 28444 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:45167
I20260808 11:31:16.957935 28585 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:45167 every 8 connection(s)
I20260808 11:31:16.959528 28444 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:31:16.965250 28586 heartbeater.cc:347] Connected to a master server at 127.26.66.190:36747
I20260808 11:31:16.965497 28586 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:16.966269 28586 heartbeater.cc:511] Master 127.26.66.190:36747 requested a full tablet report, sending...
I20260808 11:31:16.967058 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 28444
I20260808 11:31:16.967249 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance
I20260808 11:31:16.967856 28073 ts_manager.cc:194] Registered new tserver with Master: d6ea43b94bf44c50afba25c18707e98b (127.26.66.131:45167)
I20260808 11:31:16.967985 26890 external_mini_cluster.cc:1428] Setting key c2fe6a68082bc821d98e631079e5719d
I20260808 11:31:16.968930 28073 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.131@KRBTEST.COM'} at 127.26.66.131:36173
I20260808 11:31:16.971372 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 11:31:16.972951 28470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:16.956084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:43287 (local address 127.26.66.190:36747)
0808 11:31:16.956328 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:16.956337 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:16.957033 (+ 696us) server_negotiation.cc:407] Connection header received
0808 11:31:16.957384 (+ 351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:16.957389 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:16.957490 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:16.957593 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:16.958985 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:16.959819 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:16.961686 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:16.962093 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:16.962224 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:16.965160 (+ 2936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:16.965164 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:16.965168 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:16.965201 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:16.969175 (+ 3974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:16.970087 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:16.970092 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:16.970095 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:16.970252 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:16.970696 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:16.970701 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:16.970705 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:16.971062 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:16.972013 (+ 951us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:16.972548 (+ 535us) server_negotiation.cc:299] Negotiation successful
0808 11:31:16.972715 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 11:31:16.973224 28583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:16.956197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:36747 (local address 127.26.66.131:43287)
0808 11:31:16.956898 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:16.956922 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:16.957171 (+ 249us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:16.957861 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:16.957868 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:16.958539 (+ 671us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:16.958843 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:16.958853 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:16.959986 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:16.959991 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:16.961532 (+ 1541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:16.961544 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:16.962291 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:16.962298 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:16.962513 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:16.963390 (+ 877us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:16.963419 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:16.964930 (+ 1511us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:16.969336 (+ 4406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:16.969341 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:16.969345 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:16.969921 (+ 576us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:16.970399 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:16.970404 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:16.970409 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:16.970581 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:16.972086 (+ 1505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:16.972091 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:16.972288 (+ 197us) client_negotiation.cc:769] Sending connection context
0808 11:31:16.972450 (+ 162us) client_negotiation.cc:240] Negotiation successful
0808 11:31:16.972774 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":376,"threads_started":1}
Aug 08 11:31:17 dist-test-slave-zkpd krb5kdc[28026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188677, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 11:31:17 dist-test-slave-zkpd krb5kdc[28026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188677, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:17.065281 28470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:17.051363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51552 (local address 127.26.66.190:36747)
0808 11:31:17.051605 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:17.051613 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:17.052030 (+ 417us) server_negotiation.cc:407] Connection header received
0808 11:31:17.052261 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:17.052265 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:17.052338 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:17.052452 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:17.053877 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.054609 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.055987 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.056389 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.056533 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:17.060408 (+ 3875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:17.060413 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:17.060417 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:17.060450 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:17.062921 (+ 2471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:17.063534 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:17.063537 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:17.063540 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:17.063667 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:17.064091 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:17.064095 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:17.064096 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:17.064362 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:17.064570 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:17.064833 (+ 263us) server_negotiation.cc:299] Negotiation successful
0808 11:31:17.064996 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 11:31:17.069550 28073 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51552:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 11:31:17.076550 28073 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:31:17.102170 28603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:17.093069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41344 (local address 127.26.66.129:42995)
0808 11:31:17.093633 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:17.093641 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:17.094662 (+ 1021us) server_negotiation.cc:407] Connection header received
0808 11:31:17.094823 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:17.094832 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:17.095071 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:17.095267 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:31:17.095826 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.097386 (+ 1560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.099149 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.100719 (+ 1570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.100976 (+ 257us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:17.101217 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:17.101579 (+ 362us) server_negotiation.cc:299] Negotiation successful
0808 11:31:17.101758 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":252,"threads_started":1}
I20260808 11:31:17.102150 28604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:17.093633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:42995 (local address 127.0.0.1:41344)
0808 11:31:17.094535 (+ 902us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:17.094553 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:17.094688 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:17.095273 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:17.095277 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:17.095302 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:31:17.095637 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:17.095647 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.097499 (+ 1852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.097506 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:17.098991 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:17.099003 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.101121 (+ 2118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.101127 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:17.101353 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:17.101391 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 11:31:17.101525 (+ 134us) client_negotiation.cc:240] Negotiation successful
0808 11:31:17.101776 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":728,"thread_start_us":444,"threads_started":1}
I20260808 11:31:17.103734 28601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:17.088825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:36133 (local address 127.0.0.1:33854)
0808 11:31:17.090520 (+ 1695us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:17.090576 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:17.090790 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:17.093582 (+ 2792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:17.093589 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:17.093637 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:31:17.094375 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:17.094397 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.096180 (+ 1783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.096185 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:17.098652 (+ 2467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:17.098666 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.102806 (+ 4140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.102816 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:17.102997 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:17.103028 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 11:31:17.103126 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 11:31:17.103264 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1377,"mutex_wait_us":1,"spinlock_wait_cycles":4992,"thread_start_us":3570,"threads_started":1}
I20260808 11:31:17.104024 28602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:17.090293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40540 (local address 127.26.66.131:45167)
0808 11:31:17.092266 (+ 1973us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:17.092276 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:17.092961 (+ 685us) server_negotiation.cc:407] Connection header received
0808 11:31:17.093065 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:17.093072 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:17.093367 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:17.093552 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:31:17.094794 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.097174 (+ 2380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.101367 (+ 4193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.102894 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.103038 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:17.103274 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:17.103504 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 11:31:17.103659 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1788,"thread_start_us":1615,"threads_started":1}
I20260808 11:31:17.104352 28599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:17.089555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:45167 (local address 127.0.0.1:40540)
0808 11:31:17.092687 (+ 3132us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:17.092708 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:17.092831 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:17.093892 (+ 1061us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:17.093899 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:17.093932 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:31:17.094551 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:17.094562 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.097361 (+ 2799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.097371 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:17.101160 (+ 3789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:17.101178 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.103116 (+ 1938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.103122 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:17.103310 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:17.103340 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 11:31:17.103461 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 11:31:17.103596 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2997,"mutex_wait_us":1347,"thread_start_us":1020,"threads_started":1}
I20260808 11:31:17.105042 28600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:17.089009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33854 (local address 127.26.66.130:36133)
0808 11:31:17.092711 (+ 3702us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:17.092868 (+ 157us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:17.092997 (+ 129us) server_negotiation.cc:407] Connection header received
0808 11:31:17.093090 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:17.093095 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:17.093329 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:17.094313 (+ 984us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:31:17.094548 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.096037 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.099525 (+ 3488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.102186 (+ 2661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.102701 (+ 515us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:17.102956 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:17.104562 (+ 1606us) server_negotiation.cc:299] Negotiation successful
0808 11:31:17.104758 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2639,"thread_start_us":2503,"threads_started":1}
I20260808 11:31:17.106634 28221 tablet_service.cc:1467] Processing CreateTablet for tablet 29b24bece0174a178f1443a03838e9f1 (DEFAULT_TABLE table=test-table [id=171aa00560b1466ea8574c62d4d61747]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:31:17.108505 28221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29b24bece0174a178f1443a03838e9f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:17.107996 28512 tablet_service.cc:1467] Processing CreateTablet for tablet 29b24bece0174a178f1443a03838e9f1 (DEFAULT_TABLE table=test-table [id=171aa00560b1466ea8574c62d4d61747]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:31:17.108330 28368 tablet_service.cc:1467] Processing CreateTablet for tablet 29b24bece0174a178f1443a03838e9f1 (DEFAULT_TABLE table=test-table [id=171aa00560b1466ea8574c62d4d61747]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:31:17.109397 28512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29b24bece0174a178f1443a03838e9f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:17.109573 28368 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29b24bece0174a178f1443a03838e9f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:17.121382 28605 tablet_bootstrap.cc:492] T 29b24bece0174a178f1443a03838e9f1 P 21c23ce1954e4f1c92b41c45da21e351: Bootstrap starting.
I20260808 11:31:17.124444 28606 tablet_bootstrap.cc:492] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b: Bootstrap starting.
I20260808 11:31:17.125033 28605 tablet_bootstrap.cc:654] T 29b24bece0174a178f1443a03838e9f1 P 21c23ce1954e4f1c92b41c45da21e351: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:17.126462 28605 log.cc:824] T 29b24bece0174a178f1443a03838e9f1 P 21c23ce1954e4f1c92b41c45da21e351: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:17.128769 28606 tablet_bootstrap.cc:654] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:17.130262 28606 log.cc:824] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:17.130662 28607 tablet_bootstrap.cc:492] T 29b24bece0174a178f1443a03838e9f1 P a76de7b6df7048c2afe9bc496e0e09e1: Bootstrap starting.
I20260808 11:31:17.133937 28606 tablet_bootstrap.cc:492] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b: No bootstrap required, opened a new log
I20260808 11:31:17.134220 28606 ts_tablet_manager.cc:1397] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.004s
I20260808 11:31:17.134512 28607 tablet_bootstrap.cc:654] T 29b24bece0174a178f1443a03838e9f1 P a76de7b6df7048c2afe9bc496e0e09e1: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:17.135439 28605 tablet_bootstrap.cc:492] T 29b24bece0174a178f1443a03838e9f1 P 21c23ce1954e4f1c92b41c45da21e351: No bootstrap required, opened a new log
I20260808 11:31:17.135489 28607 log.cc:824] T 29b24bece0174a178f1443a03838e9f1 P a76de7b6df7048c2afe9bc496e0e09e1: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:17.135699 28605 ts_tablet_manager.cc:1397] T 29b24bece0174a178f1443a03838e9f1 P 21c23ce1954e4f1c92b41c45da21e351: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.008s
I20260808 11:31:17.138442 28607 tablet_bootstrap.cc:492] T 29b24bece0174a178f1443a03838e9f1 P a76de7b6df7048c2afe9bc496e0e09e1: No bootstrap required, opened a new log
I20260808 11:31:17.138751 28607 ts_tablet_manager.cc:1397] T 29b24bece0174a178f1443a03838e9f1 P a76de7b6df7048c2afe9bc496e0e09e1: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.004s
I20260808 11:31:17.145051 28606 raft_consensus.cc:348] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } }
I20260808 11:31:17.145551 28606 raft_consensus.cc:374] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:17.145658 28606 raft_consensus.cc:729] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6ea43b94bf44c50afba25c18707e98b, State: Initialized, Role: FOLLOWER
I20260808 11:31:17.146302 28606 consensus_queue.cc:260] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } }
I20260808 11:31:17.146417 28605 raft_consensus.cc:348] T 29b24bece0174a178f1443a03838e9f1 P 21c23ce1954e4f1c92b41c45da21e351 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } }
I20260808 11:31:17.146876 28605 raft_consensus.cc:374] T 29b24bece0174a178f1443a03838e9f1 P 21c23ce1954e4f1c92b41c45da21e351 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:17.147011 28605 raft_consensus.cc:729] T 29b24bece0174a178f1443a03838e9f1 P 21c23ce1954e4f1c92b41c45da21e351 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c23ce1954e4f1c92b41c45da21e351, State: Initialized, Role: FOLLOWER
I20260808 11:31:17.147260 28607 raft_consensus.cc:348] T 29b24bece0174a178f1443a03838e9f1 P a76de7b6df7048c2afe9bc496e0e09e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } }
I20260808 11:31:17.147710 28607 raft_consensus.cc:374] T 29b24bece0174a178f1443a03838e9f1 P a76de7b6df7048c2afe9bc496e0e09e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:17.147840 28607 raft_consensus.cc:729] T 29b24bece0174a178f1443a03838e9f1 P a76de7b6df7048c2afe9bc496e0e09e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a76de7b6df7048c2afe9bc496e0e09e1, State: Initialized, Role: FOLLOWER
I20260808 11:31:17.147706 28605 consensus_queue.cc:260] T 29b24bece0174a178f1443a03838e9f1 P 21c23ce1954e4f1c92b41c45da21e351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } }
I20260808 11:31:17.148588 28586 heartbeater.cc:503] Master 127.26.66.190:36747 was elected leader, sending a full tablet report...
I20260808 11:31:17.149307 28606 ts_tablet_manager.cc:1428] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b: Time spent starting tablet: real 0.015s user 0.006s sys 0.009s
I20260808 11:31:17.151674 28607 consensus_queue.cc:260] T 29b24bece0174a178f1443a03838e9f1 P a76de7b6df7048c2afe9bc496e0e09e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } }
I20260808 11:31:17.153524 28607 ts_tablet_manager.cc:1428] T 29b24bece0174a178f1443a03838e9f1 P a76de7b6df7048c2afe9bc496e0e09e1: Time spent starting tablet: real 0.015s user 0.009s sys 0.002s
I20260808 11:31:17.155205 28605 ts_tablet_manager.cc:1428] T 29b24bece0174a178f1443a03838e9f1 P 21c23ce1954e4f1c92b41c45da21e351: Time spent starting tablet: real 0.019s user 0.014s sys 0.003s
W20260808 11:31:17.180182 28441 tablet.cc:2369] T 29b24bece0174a178f1443a03838e9f1 P 21c23ce1954e4f1c92b41c45da21e351: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 11:31:17.214923 28587 tablet.cc:2369] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:31:17.265954 28611 raft_consensus.cc:482] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:31:17.266317 28611 raft_consensus.cc:504] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } }
I20260808 11:31:17.268386 28611 leader_election.cc:288] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c23ce1954e4f1c92b41c45da21e351 (127.26.66.130:36133), a76de7b6df7048c2afe9bc496e0e09e1 (127.26.66.129:42995)
I20260808 11:31:17.274649 28471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:17.268722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:36133 (local address 127.26.66.131:45443)
0808 11:31:17.268947 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:17.268968 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:17.269120 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:17.269696 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:17.269701 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:17.269734 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:31:17.269969 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:17.269985 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.271467 (+ 1482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.271472 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:17.272955 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:17.272967 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.274121 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.274125 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:17.274264 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:17.274289 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 11:31:17.274366 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 11:31:17.274456 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 11:31:17.274802 28600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:17.268922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:45443 (local address 127.26.66.130:36133)
0808 11:31:17.269164 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:17.269170 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:17.269212 (+ 42us) server_negotiation.cc:407] Connection header received
0808 11:31:17.269332 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:17.269339 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:17.269445 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:17.269548 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:31:17.270155 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.271310 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.273124 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.273980 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.274151 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:17.274228 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:17.274415 (+ 187us) server_negotiation.cc:299] Negotiation successful
0808 11:31:17.274549 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 11:31:17.275941 28394 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29b24bece0174a178f1443a03838e9f1" candidate_uuid: "d6ea43b94bf44c50afba25c18707e98b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c23ce1954e4f1c92b41c45da21e351" is_pre_election: true
I20260808 11:31:17.276187 28603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:17.269451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:45743 (local address 127.26.66.129:42995)
0808 11:31:17.269682 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:17.269686 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:17.269902 (+ 216us) server_negotiation.cc:407] Connection header received
0808 11:31:17.270113 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:17.270118 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:17.270189 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:17.270284 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:31:17.270830 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.271620 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.273963 (+ 2343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.275236 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.275418 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:17.275502 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:17.275855 (+ 353us) server_negotiation.cc:299] Negotiation successful
0808 11:31:17.276014 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 11:31:17.276400 28614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:17.269135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:42995 (local address 127.26.66.131:45743)
0808 11:31:17.269793 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:17.269807 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:17.269964 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:17.270305 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:17.270309 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:17.270334 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:31:17.270662 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:17.270670 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.271778 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.271786 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:17.273793 (+ 2007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:17.273806 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.275499 (+ 1693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.275508 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:17.275681 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:17.275711 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 11:31:17.275824 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 11:31:17.276009 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"mutex_wait_us":1,"thread_start_us":341,"threads_started":1}
I20260808 11:31:17.276582 28394 raft_consensus.cc:2454] T 29b24bece0174a178f1443a03838e9f1 P 21c23ce1954e4f1c92b41c45da21e351 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6ea43b94bf44c50afba25c18707e98b in term 0.
I20260808 11:31:17.277429 28461 leader_election.cc:302] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c23ce1954e4f1c92b41c45da21e351, d6ea43b94bf44c50afba25c18707e98b; no voters:
I20260808 11:31:17.277426 28248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29b24bece0174a178f1443a03838e9f1" candidate_uuid: "d6ea43b94bf44c50afba25c18707e98b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" is_pre_election: true
I20260808 11:31:17.277869 28611 raft_consensus.cc:2781] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:31:17.278038 28611 raft_consensus.cc:482] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:31:17.278031 28248 raft_consensus.cc:2454] T 29b24bece0174a178f1443a03838e9f1 P a76de7b6df7048c2afe9bc496e0e09e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6ea43b94bf44c50afba25c18707e98b in term 0.
I20260808 11:31:17.278163 28611 raft_consensus.cc:3037] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:17.280704 28611 raft_consensus.cc:504] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } }
I20260808 11:31:17.281214 28611 leader_election.cc:288] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b [CANDIDATE]: Term 1 election: Requested vote from peers 21c23ce1954e4f1c92b41c45da21e351 (127.26.66.130:36133), a76de7b6df7048c2afe9bc496e0e09e1 (127.26.66.129:42995)
I20260808 11:31:17.281764 28394 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29b24bece0174a178f1443a03838e9f1" candidate_uuid: "d6ea43b94bf44c50afba25c18707e98b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c23ce1954e4f1c92b41c45da21e351"
I20260808 11:31:17.281850 28248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29b24bece0174a178f1443a03838e9f1" candidate_uuid: "d6ea43b94bf44c50afba25c18707e98b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a76de7b6df7048c2afe9bc496e0e09e1"
I20260808 11:31:17.282004 28394 raft_consensus.cc:3037] T 29b24bece0174a178f1443a03838e9f1 P 21c23ce1954e4f1c92b41c45da21e351 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:17.282042 28248 raft_consensus.cc:3037] T 29b24bece0174a178f1443a03838e9f1 P a76de7b6df7048c2afe9bc496e0e09e1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:17.285395 28394 raft_consensus.cc:2454] T 29b24bece0174a178f1443a03838e9f1 P 21c23ce1954e4f1c92b41c45da21e351 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6ea43b94bf44c50afba25c18707e98b in term 1.
I20260808 11:31:17.285390 28248 raft_consensus.cc:2454] T 29b24bece0174a178f1443a03838e9f1 P a76de7b6df7048c2afe9bc496e0e09e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6ea43b94bf44c50afba25c18707e98b in term 1.
I20260808 11:31:17.285786 28461 leader_election.cc:302] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c23ce1954e4f1c92b41c45da21e351, d6ea43b94bf44c50afba25c18707e98b; no voters:
I20260808 11:31:17.286098 28611 raft_consensus.cc:2781] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:31:17.286550 28611 raft_consensus.cc:686] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b [term 1 LEADER]: Becoming Leader. State: Replica: d6ea43b94bf44c50afba25c18707e98b, State: Running, Role: LEADER
I20260808 11:31:17.287014 28611 consensus_queue.cc:237] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } }
I20260808 11:31:17.292042 28072 catalog_manager.cc:5495] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b reported cstate change: term changed from 0 to 1, leader changed from <none> to d6ea43b94bf44c50afba25c18707e98b (127.26.66.131). New cstate: current_term: 1 leader_uuid: "d6ea43b94bf44c50afba25c18707e98b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } health_report { overall_health: HEALTHY } } }
I20260808 11:31:17.342787 28602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:17.337317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40556 (local address 127.26.66.131:45167)
0808 11:31:17.337564 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:17.337571 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:17.337599 (+ 28us) server_negotiation.cc:407] Connection header received
0808 11:31:17.337883 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:17.337887 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:17.338040 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:17.338159 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:31:17.338484 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.339256 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.340745 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.341164 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.341259 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:17.341700 (+ 441us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:31:17.342180 (+ 480us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:31:17.342285 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:17.342403 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 11:31:17.342467 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 11:31:17.351007 28394 raft_consensus.cc:1261] T 29b24bece0174a178f1443a03838e9f1 P 21c23ce1954e4f1c92b41c45da21e351 [term 1 FOLLOWER]: Refusing update from remote peer d6ea43b94bf44c50afba25c18707e98b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:31:17.351001 28248 raft_consensus.cc:1261] T 29b24bece0174a178f1443a03838e9f1 P a76de7b6df7048c2afe9bc496e0e09e1 [term 1 FOLLOWER]: Refusing update from remote peer d6ea43b94bf44c50afba25c18707e98b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260808 11:31:17.351024 28296 tablet.cc:2369] T 29b24bece0174a178f1443a03838e9f1 P a76de7b6df7048c2afe9bc496e0e09e1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:31:17.352028 28616 consensus_queue.cc:1035] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:31:17.352397 28611 consensus_queue.cc:1035] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:31:17.363613 28621 mvcc.cc:205] Tried to move back new op lower bound from 7316228822419324928 to 7316228822172250112. Current Snapshot: MvccSnapshot[applied={T|T < 7316228822419324928}]
I20260808 11:31:17.391234 28073 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51552:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:31:17.391518 28073 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51552:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:31:17.395121 28073 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3c5c900c91ec47d0acbbcb9c700a77e0: Sending DeleteTablet for 3 replicas of tablet 29b24bece0174a178f1443a03838e9f1
I20260808 11:31:17.396339 28512 tablet_service.cc:1514] Processing DeleteTablet for tablet 29b24bece0174a178f1443a03838e9f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:31:17 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:40540
I20260808 11:31:17.396374 28368 tablet_service.cc:1514] Processing DeleteTablet for tablet 29b24bece0174a178f1443a03838e9f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:31:17 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:33854
I20260808 11:31:17.396690 28221 tablet_service.cc:1514] Processing DeleteTablet for tablet 29b24bece0174a178f1443a03838e9f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:31:17 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:41344
I20260808 11:31:17.397667 28072 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51552:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 11:31:17.398535 28072 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:31:17.409021 28219 tablet_service.cc:1467] Processing CreateTablet for tablet 8380c85978004b2d874fbf33f8c9c9b2 (DEFAULT_TABLE table=test-table [id=48b4c2147bfb488c8abb341782f10d7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:31:17.409231 28367 tablet_service.cc:1467] Processing CreateTablet for tablet 8380c85978004b2d874fbf33f8c9c9b2 (DEFAULT_TABLE table=test-table [id=48b4c2147bfb488c8abb341782f10d7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:31:17.409785 28219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8380c85978004b2d874fbf33f8c9c9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:17.409991 28367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8380c85978004b2d874fbf33f8c9c9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:17.412591 28511 tablet_service.cc:1467] Processing CreateTablet for tablet 8380c85978004b2d874fbf33f8c9c9b2 (DEFAULT_TABLE table=test-table [id=48b4c2147bfb488c8abb341782f10d7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:31:17.413177 28511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8380c85978004b2d874fbf33f8c9c9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:17.417865 28607 tablet_bootstrap.cc:492] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1: Bootstrap starting.
I20260808 11:31:17.420327 28607 tablet_bootstrap.cc:654] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:17.420429 28606 tablet_bootstrap.cc:492] T 8380c85978004b2d874fbf33f8c9c9b2 P d6ea43b94bf44c50afba25c18707e98b: Bootstrap starting.
I20260808 11:31:17.420657 28629 tablet_replica.cc:330] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b: stopping tablet replica
I20260808 11:31:17.421365 28629 raft_consensus.cc:2229] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b [term 1 LEADER]: Raft consensus shutting down.
I20260808 11:31:17.422163 28606 tablet_bootstrap.cc:654] T 8380c85978004b2d874fbf33f8c9c9b2 P d6ea43b94bf44c50afba25c18707e98b: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:17.422338 28629 raft_consensus.cc:2258] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:31:17.423162 28630 tablet_replica.cc:330] T 29b24bece0174a178f1443a03838e9f1 P 21c23ce1954e4f1c92b41c45da21e351: stopping tablet replica
I20260808 11:31:17.423847 28630 raft_consensus.cc:2229] T 29b24bece0174a178f1443a03838e9f1 P 21c23ce1954e4f1c92b41c45da21e351 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:31:17.426169 28629 ts_tablet_manager.cc:1905] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:31:17.426901 28630 raft_consensus.cc:2258] T 29b24bece0174a178f1443a03838e9f1 P 21c23ce1954e4f1c92b41c45da21e351 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:31:17.430493 28606 tablet_bootstrap.cc:492] T 8380c85978004b2d874fbf33f8c9c9b2 P d6ea43b94bf44c50afba25c18707e98b: No bootstrap required, opened a new log
I20260808 11:31:17.430711 28606 ts_tablet_manager.cc:1397] T 8380c85978004b2d874fbf33f8c9c9b2 P d6ea43b94bf44c50afba25c18707e98b: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.008s
I20260808 11:31:17.431646 28606 raft_consensus.cc:348] T 8380c85978004b2d874fbf33f8c9c9b2 P d6ea43b94bf44c50afba25c18707e98b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } }
I20260808 11:31:17.431918 28606 raft_consensus.cc:374] T 8380c85978004b2d874fbf33f8c9c9b2 P d6ea43b94bf44c50afba25c18707e98b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:17.432019 28606 raft_consensus.cc:729] T 8380c85978004b2d874fbf33f8c9c9b2 P d6ea43b94bf44c50afba25c18707e98b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6ea43b94bf44c50afba25c18707e98b, State: Initialized, Role: FOLLOWER
I20260808 11:31:17.432319 28606 consensus_queue.cc:260] T 8380c85978004b2d874fbf33f8c9c9b2 P d6ea43b94bf44c50afba25c18707e98b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } }
I20260808 11:31:17.432495 28630 ts_tablet_manager.cc:1905] T 29b24bece0174a178f1443a03838e9f1 P 21c23ce1954e4f1c92b41c45da21e351: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:31:17.432905 28606 ts_tablet_manager.cc:1428] T 8380c85978004b2d874fbf33f8c9c9b2 P d6ea43b94bf44c50afba25c18707e98b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 11:31:17.435422 28605 tablet_bootstrap.cc:492] T 8380c85978004b2d874fbf33f8c9c9b2 P 21c23ce1954e4f1c92b41c45da21e351: Bootstrap starting.
I20260808 11:31:17.437865 28605 tablet_bootstrap.cc:654] T 8380c85978004b2d874fbf33f8c9c9b2 P 21c23ce1954e4f1c92b41c45da21e351: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:17.441921 28631 tablet_replica.cc:330] T 29b24bece0174a178f1443a03838e9f1 P a76de7b6df7048c2afe9bc496e0e09e1: stopping tablet replica
I20260808 11:31:17.442358 28605 tablet_bootstrap.cc:492] T 8380c85978004b2d874fbf33f8c9c9b2 P 21c23ce1954e4f1c92b41c45da21e351: No bootstrap required, opened a new log
I20260808 11:31:17.442476 28607 tablet_bootstrap.cc:492] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1: No bootstrap required, opened a new log
I20260808 11:31:17.442529 28605 ts_tablet_manager.cc:1397] T 8380c85978004b2d874fbf33f8c9c9b2 P 21c23ce1954e4f1c92b41c45da21e351: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 11:31:17.442471 28631 raft_consensus.cc:2229] T 29b24bece0174a178f1443a03838e9f1 P a76de7b6df7048c2afe9bc496e0e09e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:31:17.442687 28607 ts_tablet_manager.cc:1397] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1: Time spent bootstrapping tablet: real 0.025s user 0.007s sys 0.001s
I20260808 11:31:17.443095 28631 raft_consensus.cc:2258] T 29b24bece0174a178f1443a03838e9f1 P a76de7b6df7048c2afe9bc496e0e09e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:31:17.443473 28605 raft_consensus.cc:348] T 8380c85978004b2d874fbf33f8c9c9b2 P 21c23ce1954e4f1c92b41c45da21e351 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } }
I20260808 11:31:17.443722 28605 raft_consensus.cc:374] T 8380c85978004b2d874fbf33f8c9c9b2 P 21c23ce1954e4f1c92b41c45da21e351 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:17.443588 28607 raft_consensus.cc:348] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } }
I20260808 11:31:17.443830 28605 raft_consensus.cc:729] T 8380c85978004b2d874fbf33f8c9c9b2 P 21c23ce1954e4f1c92b41c45da21e351 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c23ce1954e4f1c92b41c45da21e351, State: Initialized, Role: FOLLOWER
I20260808 11:31:17.443836 28607 raft_consensus.cc:374] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:17.444250 28607 raft_consensus.cc:729] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a76de7b6df7048c2afe9bc496e0e09e1, State: Initialized, Role: FOLLOWER
I20260808 11:31:17.444224 28605 consensus_queue.cc:260] T 8380c85978004b2d874fbf33f8c9c9b2 P 21c23ce1954e4f1c92b41c45da21e351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } }
I20260808 11:31:17.444484 28607 consensus_queue.cc:260] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } }
I20260808 11:31:17.445037 28607 ts_tablet_manager.cc:1428] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260808 11:31:17.445391 28629 ts_tablet_manager.cc:1918] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:31:17.446204 28630 ts_tablet_manager.cc:1918] T 29b24bece0174a178f1443a03838e9f1 P 21c23ce1954e4f1c92b41c45da21e351: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:31:17.446364 28630 log.cc:1196] T 29b24bece0174a178f1443a03838e9f1 P 21c23ce1954e4f1c92b41c45da21e351: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-1/wal/wals/29b24bece0174a178f1443a03838e9f1
I20260808 11:31:17.446615 28631 ts_tablet_manager.cc:1905] T 29b24bece0174a178f1443a03838e9f1 P a76de7b6df7048c2afe9bc496e0e09e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:31:17.446908 28630 ts_tablet_manager.cc:1939] T 29b24bece0174a178f1443a03838e9f1 P 21c23ce1954e4f1c92b41c45da21e351: Deleting consensus metadata
I20260808 11:31:17.447111 28629 log.cc:1196] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-2/wal/wals/29b24bece0174a178f1443a03838e9f1
I20260808 11:31:17.447832 28629 ts_tablet_manager.cc:1939] T 29b24bece0174a178f1443a03838e9f1 P d6ea43b94bf44c50afba25c18707e98b: Deleting consensus metadata
I20260808 11:31:17.449738 28059 catalog_manager.cc:4841] TS d6ea43b94bf44c50afba25c18707e98b (127.26.66.131:45167): tablet 29b24bece0174a178f1443a03838e9f1 (table test-table [id=171aa00560b1466ea8574c62d4d61747]) successfully deleted
I20260808 11:31:17.451315 28057 catalog_manager.cc:4841] TS 21c23ce1954e4f1c92b41c45da21e351 (127.26.66.130:36133): tablet 29b24bece0174a178f1443a03838e9f1 (table test-table [id=171aa00560b1466ea8574c62d4d61747]) successfully deleted
I20260808 11:31:17.452124 28605 ts_tablet_manager.cc:1428] T 8380c85978004b2d874fbf33f8c9c9b2 P 21c23ce1954e4f1c92b41c45da21e351: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260808 11:31:17.454017 28631 ts_tablet_manager.cc:1918] T 29b24bece0174a178f1443a03838e9f1 P a76de7b6df7048c2afe9bc496e0e09e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:31:17.454214 28631 log.cc:1196] T 29b24bece0174a178f1443a03838e9f1 P a76de7b6df7048c2afe9bc496e0e09e1: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-0/wal/wals/29b24bece0174a178f1443a03838e9f1
I20260808 11:31:17.454679 28631 ts_tablet_manager.cc:1939] T 29b24bece0174a178f1443a03838e9f1 P a76de7b6df7048c2afe9bc496e0e09e1: Deleting consensus metadata
I20260808 11:31:17.455987 28057 catalog_manager.cc:4841] TS a76de7b6df7048c2afe9bc496e0e09e1 (127.26.66.129:42995): tablet 29b24bece0174a178f1443a03838e9f1 (table test-table [id=171aa00560b1466ea8574c62d4d61747]) successfully deleted
I20260808 11:31:17.469359 28613 raft_consensus.cc:482] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:31:17.469576 28613 raft_consensus.cc:504] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } }
I20260808 11:31:17.471521 28613 leader_election.cc:288] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c23ce1954e4f1c92b41c45da21e351 (127.26.66.130:36133), d6ea43b94bf44c50afba25c18707e98b (127.26.66.131:45167)
I20260808 11:31:17.493896 28602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:17.472040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:56525 (local address 127.26.66.131:45167)
0808 11:31:17.472291 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:17.472299 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:17.483082 (+ 10783us) server_negotiation.cc:407] Connection header received
0808 11:31:17.483710 (+ 628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:17.483718 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:17.483857 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:17.483957 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:31:17.485369 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.486958 (+ 1589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.491265 (+ 4307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.492623 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.492749 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:17.492836 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:17.493416 (+ 580us) server_negotiation.cc:299] Negotiation successful
0808 11:31:17.493543 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 11:31:17.494688 28636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:17.471778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:45167 (local address 127.26.66.129:56525)
0808 11:31:17.482932 (+ 11154us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:17.482959 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:17.483491 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:17.484406 (+ 915us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:17.484415 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:17.484454 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:31:17.485015 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:17.485031 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.487240 (+ 2209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.487248 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:17.490332 (+ 3084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:17.490353 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.493031 (+ 2678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.493037 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:17.493209 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:17.493243 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 11:31:17.494152 (+ 909us) client_negotiation.cc:240] Negotiation successful
0808 11:31:17.494289 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10961,"thread_start_us":18889,"threads_started":1}
I20260808 11:31:17.495594 28533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8380c85978004b2d874fbf33f8c9c9b2" candidate_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6ea43b94bf44c50afba25c18707e98b" is_pre_election: true
I20260808 11:31:17.496076 28533 raft_consensus.cc:2454] T 8380c85978004b2d874fbf33f8c9c9b2 P d6ea43b94bf44c50afba25c18707e98b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a76de7b6df7048c2afe9bc496e0e09e1 in term 0.
I20260808 11:31:17.496724 28168 leader_election.cc:302] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a76de7b6df7048c2afe9bc496e0e09e1, d6ea43b94bf44c50afba25c18707e98b; no voters:
I20260808 11:31:17.497402 28613 raft_consensus.cc:2781] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:31:17.497538 28613 raft_consensus.cc:482] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:31:17.497642 28613 raft_consensus.cc:3037] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:17.499147 28600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:17.473005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:37481 (local address 127.26.66.130:36133)
0808 11:31:17.473229 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:17.473238 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:17.491078 (+ 17840us) server_negotiation.cc:407] Connection header received
0808 11:31:17.491235 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:17.491240 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:17.491330 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:17.491414 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:31:17.492163 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.493301 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.496958 (+ 3657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.497985 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.498091 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:17.498139 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:17.498704 (+ 565us) server_negotiation.cc:299] Negotiation successful
0808 11:31:17.498857 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 11:31:17.499190 28635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:17.472588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:36133 (local address 127.26.66.129:37481)
0808 11:31:17.490952 (+ 18364us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:17.490972 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:17.491115 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:17.491572 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:17.491577 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:17.491602 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:31:17.491979 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:17.491991 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.494745 (+ 2754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.494751 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:17.496767 (+ 2016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:17.496782 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.498319 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.498324 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:17.498446 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:17.498519 (+ 73us) client_negotiation.cc:769] Sending connection context
0808 11:31:17.498653 (+ 134us) client_negotiation.cc:240] Negotiation successful
0808 11:31:17.498791 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18222,"thread_start_us":10511,"threads_started":1}
I20260808 11:31:17.499953 28394 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8380c85978004b2d874fbf33f8c9c9b2" candidate_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c23ce1954e4f1c92b41c45da21e351" is_pre_election: true
I20260808 11:31:17.500262 28394 raft_consensus.cc:2454] T 8380c85978004b2d874fbf33f8c9c9b2 P 21c23ce1954e4f1c92b41c45da21e351 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a76de7b6df7048c2afe9bc496e0e09e1 in term 0.
I20260808 11:31:17.501260 28613 raft_consensus.cc:504] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } }
I20260808 11:31:17.502010 28613 leader_election.cc:288] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1 [CANDIDATE]: Term 1 election: Requested vote from peers 21c23ce1954e4f1c92b41c45da21e351 (127.26.66.130:36133), d6ea43b94bf44c50afba25c18707e98b (127.26.66.131:45167)
I20260808 11:31:17.502398 28394 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8380c85978004b2d874fbf33f8c9c9b2" candidate_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c23ce1954e4f1c92b41c45da21e351"
I20260808 11:31:17.502607 28394 raft_consensus.cc:3037] T 8380c85978004b2d874fbf33f8c9c9b2 P 21c23ce1954e4f1c92b41c45da21e351 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:17.502696 28533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8380c85978004b2d874fbf33f8c9c9b2" candidate_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6ea43b94bf44c50afba25c18707e98b"
I20260808 11:31:17.502920 28533 raft_consensus.cc:3037] T 8380c85978004b2d874fbf33f8c9c9b2 P d6ea43b94bf44c50afba25c18707e98b [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:17.505620 28394 raft_consensus.cc:2454] T 8380c85978004b2d874fbf33f8c9c9b2 P 21c23ce1954e4f1c92b41c45da21e351 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a76de7b6df7048c2afe9bc496e0e09e1 in term 1.
I20260808 11:31:17.506059 28166 leader_election.cc:302] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c23ce1954e4f1c92b41c45da21e351, a76de7b6df7048c2afe9bc496e0e09e1; no voters:
I20260808 11:31:17.506350 28613 raft_consensus.cc:2781] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:31:17.506645 28533 raft_consensus.cc:2454] T 8380c85978004b2d874fbf33f8c9c9b2 P d6ea43b94bf44c50afba25c18707e98b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a76de7b6df7048c2afe9bc496e0e09e1 in term 1.
I20260808 11:31:17.506877 28613 raft_consensus.cc:686] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1 [term 1 LEADER]: Becoming Leader. State: Replica: a76de7b6df7048c2afe9bc496e0e09e1, State: Running, Role: LEADER
I20260808 11:31:17.507650 28613 consensus_queue.cc:237] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } }
I20260808 11:31:17.511521 28072 catalog_manager.cc:5495] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a76de7b6df7048c2afe9bc496e0e09e1 (127.26.66.129). New cstate: current_term: 1 leader_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } health_report { overall_health: UNKNOWN } } }
Aug 08 11:31:17 dist-test-slave-zkpd krb5kdc[28026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188674, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:17.570446 28470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:17.554390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51564 (local address 127.26.66.190:36747)
0808 11:31:17.554656 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:17.554665 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:17.555294 (+ 629us) server_negotiation.cc:407] Connection header received
0808 11:31:17.555469 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:17.555473 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:17.555534 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:17.555616 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:17.557167 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.557916 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.559853 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.560365 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.560459 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:17.564613 (+ 4154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:17.564618 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:17.564621 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:17.564652 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:17.567442 (+ 2790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:17.568352 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:17.568355 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:17.568358 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:17.568482 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:17.568911 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:17.568914 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:17.568916 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:17.569177 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:17.569297 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:17.569800 (+ 503us) server_negotiation.cc:299] Negotiation successful
0808 11:31:17.570151 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":163,"server-negotiator.queue_time_us":71}
I20260808 11:31:17.570531 28645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:17.554422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:36747 (local address 127.0.0.1:51564)
0808 11:31:17.555158 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:17.555185 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:17.555355 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:17.555693 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:17.555699 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:17.556651 (+ 952us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:17.557000 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:17.557014 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.558046 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.558052 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:17.559701 (+ 1649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:17.559720 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.560549 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.560556 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:17.560736 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:17.561467 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:17.561492 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:17.564410 (+ 2918us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:17.567578 (+ 3168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:17.567592 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:17.567600 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:17.568232 (+ 632us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:17.568592 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:17.568597 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:17.568600 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:17.568794 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:17.569308 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:17.569317 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:17.569528 (+ 211us) client_negotiation.cc:769] Sending connection context
0808 11:31:17.569717 (+ 189us) client_negotiation.cc:240] Negotiation successful
0808 11:31:17.570031 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":583,"thread_start_us":388,"threads_started":1}
I20260808 11:31:17.576134 28072 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:51564:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 11:31:17.577451 28072 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:31:17.584540 28367 tablet_service.cc:1467] Processing CreateTablet for tablet 856f02ee864149efa84a26e71379c5c1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=db14031f00bb4afcbac65be8baa81c9f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 11:31:17.584519 28221 tablet_service.cc:1467] Processing CreateTablet for tablet 856f02ee864149efa84a26e71379c5c1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=db14031f00bb4afcbac65be8baa81c9f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 11:31:17.584796 28511 tablet_service.cc:1467] Processing CreateTablet for tablet 856f02ee864149efa84a26e71379c5c1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=db14031f00bb4afcbac65be8baa81c9f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 11:31:17.585103 28367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 856f02ee864149efa84a26e71379c5c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:17.585106 28221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 856f02ee864149efa84a26e71379c5c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:17.585404 28511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 856f02ee864149efa84a26e71379c5c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:17.592528 28607 tablet_bootstrap.cc:492] T 856f02ee864149efa84a26e71379c5c1 P a76de7b6df7048c2afe9bc496e0e09e1: Bootstrap starting.
I20260808 11:31:17.592617 28605 tablet_bootstrap.cc:492] T 856f02ee864149efa84a26e71379c5c1 P 21c23ce1954e4f1c92b41c45da21e351: Bootstrap starting.
I20260808 11:31:17.592741 28606 tablet_bootstrap.cc:492] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b: Bootstrap starting.
I20260808 11:31:17.594334 28607 tablet_bootstrap.cc:654] T 856f02ee864149efa84a26e71379c5c1 P a76de7b6df7048c2afe9bc496e0e09e1: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:17.594344 28605 tablet_bootstrap.cc:654] T 856f02ee864149efa84a26e71379c5c1 P 21c23ce1954e4f1c92b41c45da21e351: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:17.594492 28606 tablet_bootstrap.cc:654] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:17.606648 28605 tablet_bootstrap.cc:492] T 856f02ee864149efa84a26e71379c5c1 P 21c23ce1954e4f1c92b41c45da21e351: No bootstrap required, opened a new log
I20260808 11:31:17.606897 28605 ts_tablet_manager.cc:1397] T 856f02ee864149efa84a26e71379c5c1 P 21c23ce1954e4f1c92b41c45da21e351: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.005s
I20260808 11:31:17.607306 28607 tablet_bootstrap.cc:492] T 856f02ee864149efa84a26e71379c5c1 P a76de7b6df7048c2afe9bc496e0e09e1: No bootstrap required, opened a new log
I20260808 11:31:17.607548 28607 ts_tablet_manager.cc:1397] T 856f02ee864149efa84a26e71379c5c1 P a76de7b6df7048c2afe9bc496e0e09e1: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.007s
I20260808 11:31:17.608024 28605 raft_consensus.cc:348] T 856f02ee864149efa84a26e71379c5c1 P 21c23ce1954e4f1c92b41c45da21e351 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } }
I20260808 11:31:17.608362 28605 raft_consensus.cc:374] T 856f02ee864149efa84a26e71379c5c1 P 21c23ce1954e4f1c92b41c45da21e351 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:17.608506 28605 raft_consensus.cc:729] T 856f02ee864149efa84a26e71379c5c1 P 21c23ce1954e4f1c92b41c45da21e351 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c23ce1954e4f1c92b41c45da21e351, State: Initialized, Role: FOLLOWER
I20260808 11:31:17.608413 28607 raft_consensus.cc:348] T 856f02ee864149efa84a26e71379c5c1 P a76de7b6df7048c2afe9bc496e0e09e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } }
I20260808 11:31:17.608727 28607 raft_consensus.cc:374] T 856f02ee864149efa84a26e71379c5c1 P a76de7b6df7048c2afe9bc496e0e09e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:17.608860 28607 raft_consensus.cc:729] T 856f02ee864149efa84a26e71379c5c1 P a76de7b6df7048c2afe9bc496e0e09e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a76de7b6df7048c2afe9bc496e0e09e1, State: Initialized, Role: FOLLOWER
I20260808 11:31:17.609025 28606 tablet_bootstrap.cc:492] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b: No bootstrap required, opened a new log
I20260808 11:31:17.608870 28605 consensus_queue.cc:260] T 856f02ee864149efa84a26e71379c5c1 P 21c23ce1954e4f1c92b41c45da21e351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } }
I20260808 11:31:17.609180 28607 consensus_queue.cc:260] T 856f02ee864149efa84a26e71379c5c1 P a76de7b6df7048c2afe9bc496e0e09e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } }
I20260808 11:31:17.609534 28605 ts_tablet_manager.cc:1428] T 856f02ee864149efa84a26e71379c5c1 P 21c23ce1954e4f1c92b41c45da21e351: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260808 11:31:17.609431 28612 tablet_replica.cc:439] T 856f02ee864149efa84a26e71379c5c1 P 21c23ce1954e4f1c92b41c45da21e351: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } } }
I20260808 11:31:17.609822 28612 tablet_replica.cc:442] T 856f02ee864149efa84a26e71379c5c1 P 21c23ce1954e4f1c92b41c45da21e351: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 11:31:17.609833 28613 tablet_replica.cc:439] T 856f02ee864149efa84a26e71379c5c1 P a76de7b6df7048c2afe9bc496e0e09e1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } } }
I20260808 11:31:17.610090 28613 tablet_replica.cc:442] T 856f02ee864149efa84a26e71379c5c1 P a76de7b6df7048c2afe9bc496e0e09e1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 11:31:17.610574 28607 ts_tablet_manager.cc:1428] T 856f02ee864149efa84a26e71379c5c1 P a76de7b6df7048c2afe9bc496e0e09e1: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 11:31:17.612123 28606 ts_tablet_manager.cc:1397] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.005s
I20260808 11:31:17.613044 28606 raft_consensus.cc:348] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } }
I20260808 11:31:17.613318 28606 raft_consensus.cc:374] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:17.613425 28606 raft_consensus.cc:729] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6ea43b94bf44c50afba25c18707e98b, State: Initialized, Role: FOLLOWER
I20260808 11:31:17.613767 28606 consensus_queue.cc:260] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } }
I20260808 11:31:17.614435 28606 ts_tablet_manager.cc:1428] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260808 11:31:17.614291 28626 tablet_replica.cc:439] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } } }
I20260808 11:31:17.614671 28626 tablet_replica.cc:442] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 11:31:17.808475 28626 raft_consensus.cc:482] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:31:17.808768 28626 raft_consensus.cc:504] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } }
I20260808 11:31:17.809657 28626 leader_election.cc:288] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a76de7b6df7048c2afe9bc496e0e09e1 (127.26.66.129:42995), 21c23ce1954e4f1c92b41c45da21e351 (127.26.66.130:36133)
I20260808 11:31:17.810384 28394 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "856f02ee864149efa84a26e71379c5c1" candidate_uuid: "d6ea43b94bf44c50afba25c18707e98b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c23ce1954e4f1c92b41c45da21e351" is_pre_election: true
I20260808 11:31:17.810447 28248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "856f02ee864149efa84a26e71379c5c1" candidate_uuid: "d6ea43b94bf44c50afba25c18707e98b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" is_pre_election: true
I20260808 11:31:17.810685 28394 raft_consensus.cc:2454] T 856f02ee864149efa84a26e71379c5c1 P 21c23ce1954e4f1c92b41c45da21e351 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6ea43b94bf44c50afba25c18707e98b in term 0.
I20260808 11:31:17.810732 28248 raft_consensus.cc:2454] T 856f02ee864149efa84a26e71379c5c1 P a76de7b6df7048c2afe9bc496e0e09e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6ea43b94bf44c50afba25c18707e98b in term 0.
I20260808 11:31:17.811291 28461 leader_election.cc:302] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a76de7b6df7048c2afe9bc496e0e09e1, d6ea43b94bf44c50afba25c18707e98b; no voters:
I20260808 11:31:17.811580 28626 raft_consensus.cc:2781] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:31:17.811709 28626 raft_consensus.cc:482] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:31:17.811856 28626 raft_consensus.cc:3037] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:17.814707 28626 raft_consensus.cc:504] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } }
I20260808 11:31:17.815235 28626 leader_election.cc:288] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b [CANDIDATE]: Term 1 election: Requested vote from peers a76de7b6df7048c2afe9bc496e0e09e1 (127.26.66.129:42995), 21c23ce1954e4f1c92b41c45da21e351 (127.26.66.130:36133)
I20260808 11:31:17.815797 28394 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "856f02ee864149efa84a26e71379c5c1" candidate_uuid: "d6ea43b94bf44c50afba25c18707e98b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c23ce1954e4f1c92b41c45da21e351"
I20260808 11:31:17.815838 28248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "856f02ee864149efa84a26e71379c5c1" candidate_uuid: "d6ea43b94bf44c50afba25c18707e98b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a76de7b6df7048c2afe9bc496e0e09e1"
I20260808 11:31:17.816071 28394 raft_consensus.cc:3037] T 856f02ee864149efa84a26e71379c5c1 P 21c23ce1954e4f1c92b41c45da21e351 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:17.816090 28248 raft_consensus.cc:3037] T 856f02ee864149efa84a26e71379c5c1 P a76de7b6df7048c2afe9bc496e0e09e1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:17.818032 28394 raft_consensus.cc:2454] T 856f02ee864149efa84a26e71379c5c1 P 21c23ce1954e4f1c92b41c45da21e351 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6ea43b94bf44c50afba25c18707e98b in term 1.
I20260808 11:31:17.818461 28461 leader_election.cc:302] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c23ce1954e4f1c92b41c45da21e351, d6ea43b94bf44c50afba25c18707e98b; no voters:
I20260808 11:31:17.818737 28626 raft_consensus.cc:2781] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:31:17.818902 28626 raft_consensus.cc:686] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b [term 1 LEADER]: Becoming Leader. State: Replica: d6ea43b94bf44c50afba25c18707e98b, State: Running, Role: LEADER
I20260808 11:31:17.819195 28248 raft_consensus.cc:2454] T 856f02ee864149efa84a26e71379c5c1 P a76de7b6df7048c2afe9bc496e0e09e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6ea43b94bf44c50afba25c18707e98b in term 1.
I20260808 11:31:17.819231 28626 consensus_queue.cc:237] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } }
I20260808 11:31:17.821063 28611 tablet_replica.cc:439] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b: TxnStatusTablet state changed. Reason: New leader d6ea43b94bf44c50afba25c18707e98b. Latest consensus state: current_term: 1 leader_uuid: "d6ea43b94bf44c50afba25c18707e98b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } } }
I20260808 11:31:17.821367 28611 tablet_replica.cc:442] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b: This TxnStatusTablet replica's current role is: LEADER
I20260808 11:31:17.822113 28650 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 11:31:17.822371 28650 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 11:31:17.822926 28072 catalog_manager.cc:5495] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b reported cstate change: term changed from 0 to 1, leader changed from <none> to d6ea43b94bf44c50afba25c18707e98b (127.26.66.131). New cstate: current_term: 1 leader_uuid: "d6ea43b94bf44c50afba25c18707e98b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } health_report { overall_health: HEALTHY } } }
I20260808 11:31:17.853919 28645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:17.847966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:45167 (local address 127.0.0.1:40564)
0808 11:31:17.848197 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:17.848215 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:17.848331 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:17.848769 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:17.848772 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:17.848782 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 11:31:17.848955 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:17.848963 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.850419 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.850423 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:17.851614 (+ 1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:17.851632 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.852704 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.852708 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:17.852944 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:17.853015 (+ 71us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 11:31:17.853470 (+ 455us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 11:31:17.853487 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 11:31:17.853552 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 11:31:17.853669 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 11:31:17.853992 28602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:17.848008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40564 (local address 127.26.66.131:45167)
0808 11:31:17.848211 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:17.848217 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:17.848259 (+ 42us) server_negotiation.cc:407] Connection header received
0808 11:31:17.848507 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:17.848512 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:17.848610 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:17.848721 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:31:17.849084 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.850302 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.851770 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.852555 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.852696 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:17.853216 (+ 520us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:31:17.853366 (+ 150us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:31:17.853464 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:17.853609 (+ 145us) server_negotiation.cc:299] Negotiation successful
0808 11:31:17.853707 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 11:31:17.857678 28248 raft_consensus.cc:1261] T 856f02ee864149efa84a26e71379c5c1 P a76de7b6df7048c2afe9bc496e0e09e1 [term 1 FOLLOWER]: Refusing update from remote peer d6ea43b94bf44c50afba25c18707e98b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:31:17.857754 28394 raft_consensus.cc:1261] T 856f02ee864149efa84a26e71379c5c1 P 21c23ce1954e4f1c92b41c45da21e351 [term 1 FOLLOWER]: Refusing update from remote peer d6ea43b94bf44c50afba25c18707e98b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:31:17.858255 28611 consensus_queue.cc:1035] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:31:17.858561 28626 consensus_queue.cc:1035] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:31:17.861270 28612 tablet_replica.cc:439] T 856f02ee864149efa84a26e71379c5c1 P 21c23ce1954e4f1c92b41c45da21e351: TxnStatusTablet state changed. Reason: New leader d6ea43b94bf44c50afba25c18707e98b. Latest consensus state: current_term: 1 leader_uuid: "d6ea43b94bf44c50afba25c18707e98b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } } }
I20260808 11:31:17.861589 28612 tablet_replica.cc:442] T 856f02ee864149efa84a26e71379c5c1 P 21c23ce1954e4f1c92b41c45da21e351: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 11:31:17.863111 28616 tablet_replica.cc:439] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d6ea43b94bf44c50afba25c18707e98b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } } }
I20260808 11:31:17.863401 28616 tablet_replica.cc:442] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b: This TxnStatusTablet replica's current role is: LEADER
I20260808 11:31:17.863587 28619 mvcc.cc:205] Tried to move back new op lower bound from 7316228824498880512 to 7316228824350322688. Current Snapshot: MvccSnapshot[applied={T|T < 7316228824498880512}]
I20260808 11:31:17.866500 28612 tablet_replica.cc:439] T 856f02ee864149efa84a26e71379c5c1 P 21c23ce1954e4f1c92b41c45da21e351: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d6ea43b94bf44c50afba25c18707e98b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } } }
I20260808 11:31:17.866743 28612 tablet_replica.cc:442] T 856f02ee864149efa84a26e71379c5c1 P 21c23ce1954e4f1c92b41c45da21e351: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 11:31:17.869163 28613 tablet_replica.cc:439] T 856f02ee864149efa84a26e71379c5c1 P a76de7b6df7048c2afe9bc496e0e09e1: TxnStatusTablet state changed. Reason: New leader d6ea43b94bf44c50afba25c18707e98b. Latest consensus state: current_term: 1 leader_uuid: "d6ea43b94bf44c50afba25c18707e98b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } } }
I20260808 11:31:17.869448 28613 tablet_replica.cc:442] T 856f02ee864149efa84a26e71379c5c1 P a76de7b6df7048c2afe9bc496e0e09e1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 11:31:17.869467 28626 tablet_replica.cc:439] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d6ea43b94bf44c50afba25c18707e98b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } } }
I20260808 11:31:17.869733 28626 tablet_replica.cc:442] T 856f02ee864149efa84a26e71379c5c1 P d6ea43b94bf44c50afba25c18707e98b: This TxnStatusTablet replica's current role is: LEADER
I20260808 11:31:17.870106 28620 mvcc.cc:205] Tried to move back new op lower bound from 7316228824498880512 to 7316228824350322688. Current Snapshot: MvccSnapshot[applied={T|T < 7316228824498880512}]
I20260808 11:31:17.872254 28613 tablet_replica.cc:439] T 856f02ee864149efa84a26e71379c5c1 P a76de7b6df7048c2afe9bc496e0e09e1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d6ea43b94bf44c50afba25c18707e98b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a76de7b6df7048c2afe9bc496e0e09e1" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42995 } } peers { permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 } } peers { permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 } } }
I20260808 11:31:17.872505 28613 tablet_replica.cc:442] T 856f02ee864149efa84a26e71379c5c1 P a76de7b6df7048c2afe9bc496e0e09e1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 11:31:17.883147 28657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:17.875313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41358 (local address 127.26.66.129:42995)
0808 11:31:17.877075 (+ 1762us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:17.877079 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:17.877098 (+ 19us) server_negotiation.cc:407] Connection header received
0808 11:31:17.877168 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:17.877172 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:17.877240 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:17.877409 (+ 169us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:31:17.878026 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.878958 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.880865 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.881275 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.881378 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:17.881873 (+ 495us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:31:17.882459 (+ 586us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:31:17.882562 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:17.882721 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 11:31:17.882786 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1609,"thread_start_us":1478,"threads_started":1}
I20260808 11:31:17.900092 28660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:17.893661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:45167 (local address 127.26.66.129:57281)
0808 11:31:17.894357 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:17.894373 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:17.894492 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:17.894841 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:17.894845 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:17.894855 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 11:31:17.895139 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:17.895147 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.896619 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.896622 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:17.897740 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:17.897751 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.898724 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.898728 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:17.898868 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:17.898919 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 11:31:17.899383 (+ 464us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 11:31:17.899399 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 11:31:17.899496 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 11:31:17.899641 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":382,"threads_started":1}
I20260808 11:31:17.900604 28602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:17.893854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:57281 (local address 127.26.66.131:45167)
0808 11:31:17.894110 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:17.894116 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:17.894461 (+ 345us) server_negotiation.cc:407] Connection header received
0808 11:31:17.894620 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:17.894628 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:17.894716 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:17.894819 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:31:17.895310 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.896503 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.897893 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.898561 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.898677 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:17.899081 (+ 404us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:31:17.899241 (+ 160us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:31:17.899323 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:17.899606 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 11:31:17.899735 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 11:31:17.910257 28394 raft_consensus.cc:1261] T 8380c85978004b2d874fbf33f8c9c9b2 P 21c23ce1954e4f1c92b41c45da21e351 [term 1 FOLLOWER]: Refusing update from remote peer a76de7b6df7048c2afe9bc496e0e09e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:31:17.910326 28533 raft_consensus.cc:1261] T 8380c85978004b2d874fbf33f8c9c9b2 P d6ea43b94bf44c50afba25c18707e98b [term 1 FOLLOWER]: Refusing update from remote peer a76de7b6df7048c2afe9bc496e0e09e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:31:17.910966 28637 consensus_queue.cc:1035] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c23ce1954e4f1c92b41c45da21e351" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:31:17.911321 28613 consensus_queue.cc:1035] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6ea43b94bf44c50afba25c18707e98b" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:31:17.951838 28657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:17.944124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:60599 (local address 127.26.66.129:42995)
0808 11:31:17.944323 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:17.944329 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:17.945116 (+ 787us) server_negotiation.cc:407] Connection header received
0808 11:31:17.945382 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:17.945388 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:17.945485 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:17.945607 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:31:17.946353 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.947481 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.949703 (+ 2222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.950370 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.950502 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:17.951033 (+ 531us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:31:17.951167 (+ 134us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:31:17.951284 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:17.951442 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 11:31:17.951529 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 11:31:17.952129 28665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:17.944289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:42995 (local address 127.26.66.131:60599)
0808 11:31:17.945011 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:17.945040 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:17.945211 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:17.945647 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:17.945652 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:17.945666 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 11:31:17.946131 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:17.946145 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.947678 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.947687 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:17.949548 (+ 1861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:17.949565 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:17.950575 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:17.950581 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:17.950775 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:17.950847 (+ 72us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 11:31:17.951294 (+ 447us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 11:31:17.951306 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 11:31:17.951391 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 11:31:17.951490 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":342,"threads_started":1}
I20260808 11:31:18.011381 28073 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51552:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:31:18.011648 28073 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51552:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:31:18.015363 28073 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3c5c900c91ec47d0acbbcb9c700a77e0: Sending DeleteTablet for 3 replicas of tablet 8380c85978004b2d874fbf33f8c9c9b2
I20260808 11:31:18.016566 28367 tablet_service.cc:1514] Processing DeleteTablet for tablet 8380c85978004b2d874fbf33f8c9c9b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:31:18 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:33854
I20260808 11:31:18.017364 28221 tablet_service.cc:1514] Processing DeleteTablet for tablet 8380c85978004b2d874fbf33f8c9c9b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:31:18 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:41344
I20260808 11:31:18.018522 28668 tablet_replica.cc:330] T 8380c85978004b2d874fbf33f8c9c9b2 P 21c23ce1954e4f1c92b41c45da21e351: stopping tablet replica
I20260808 11:31:18.018791 28668 raft_consensus.cc:2229] T 8380c85978004b2d874fbf33f8c9c9b2 P 21c23ce1954e4f1c92b41c45da21e351 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:31:18.019071 28668 raft_consensus.cc:2258] T 8380c85978004b2d874fbf33f8c9c9b2 P 21c23ce1954e4f1c92b41c45da21e351 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:31:18.020279 28668 ts_tablet_manager.cc:1905] T 8380c85978004b2d874fbf33f8c9c9b2 P 21c23ce1954e4f1c92b41c45da21e351: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:31:18.023464 28511 tablet_service.cc:1514] Processing DeleteTablet for tablet 8380c85978004b2d874fbf33f8c9c9b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:31:18 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:40540
I20260808 11:31:18.024247 28669 tablet_replica.cc:330] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1: stopping tablet replica
I20260808 11:31:18.024499 28669 raft_consensus.cc:2229] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1 [term 1 LEADER]: Raft consensus shutting down.
I20260808 11:31:18.025049 28669 raft_consensus.cc:2258] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:31:18.026230 28669 ts_tablet_manager.cc:1905] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:31:18.028062 28668 ts_tablet_manager.cc:1918] T 8380c85978004b2d874fbf33f8c9c9b2 P 21c23ce1954e4f1c92b41c45da21e351: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 11:31:18.028262 28668 log.cc:1196] T 8380c85978004b2d874fbf33f8c9c9b2 P 21c23ce1954e4f1c92b41c45da21e351: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-1/wal/wals/8380c85978004b2d874fbf33f8c9c9b2
I20260808 11:31:18.028833 28668 ts_tablet_manager.cc:1939] T 8380c85978004b2d874fbf33f8c9c9b2 P 21c23ce1954e4f1c92b41c45da21e351: Deleting consensus metadata
I20260808 11:31:18.030129 28057 catalog_manager.cc:4841] TS 21c23ce1954e4f1c92b41c45da21e351 (127.26.66.130:36133): tablet 8380c85978004b2d874fbf33f8c9c9b2 (table test-table [id=48b4c2147bfb488c8abb341782f10d7d]) successfully deleted
I20260808 11:31:18.034940 28669 ts_tablet_manager.cc:1918] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 11:31:18.035149 28669 log.cc:1196] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-0/wal/wals/8380c85978004b2d874fbf33f8c9c9b2
I20260808 11:31:18.035717 28669 ts_tablet_manager.cc:1939] T 8380c85978004b2d874fbf33f8c9c9b2 P a76de7b6df7048c2afe9bc496e0e09e1: Deleting consensus metadata
I20260808 11:31:18.036957 28057 catalog_manager.cc:4841] TS a76de7b6df7048c2afe9bc496e0e09e1 (127.26.66.129:42995): tablet 8380c85978004b2d874fbf33f8c9c9b2 (table test-table [id=48b4c2147bfb488c8abb341782f10d7d]) successfully deleted
I20260808 11:31:18.037546 28671 tablet_replica.cc:330] T 8380c85978004b2d874fbf33f8c9c9b2 P d6ea43b94bf44c50afba25c18707e98b: stopping tablet replica
I20260808 11:31:18.037829 28671 raft_consensus.cc:2229] T 8380c85978004b2d874fbf33f8c9c9b2 P d6ea43b94bf44c50afba25c18707e98b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:31:18.038169 28671 raft_consensus.cc:2258] T 8380c85978004b2d874fbf33f8c9c9b2 P d6ea43b94bf44c50afba25c18707e98b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:31:18.039436 28671 ts_tablet_manager.cc:1905] T 8380c85978004b2d874fbf33f8c9c9b2 P d6ea43b94bf44c50afba25c18707e98b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:31:18.047029 28671 ts_tablet_manager.cc:1918] T 8380c85978004b2d874fbf33f8c9c9b2 P d6ea43b94bf44c50afba25c18707e98b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 11:31:18.047240 28671 log.cc:1196] T 8380c85978004b2d874fbf33f8c9c9b2 P d6ea43b94bf44c50afba25c18707e98b: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786188664137852-26890-0/minicluster-data/ts-2/wal/wals/8380c85978004b2d874fbf33f8c9c9b2
I20260808 11:31:18.047863 28671 ts_tablet_manager.cc:1939] T 8380c85978004b2d874fbf33f8c9c9b2 P d6ea43b94bf44c50afba25c18707e98b: Deleting consensus metadata
I20260808 11:31:18.049109 28059 catalog_manager.cc:4841] TS d6ea43b94bf44c50afba25c18707e98b (127.26.66.131:45167): tablet 8380c85978004b2d874fbf33f8c9c9b2 (table test-table [id=48b4c2147bfb488c8abb341782f10d7d]) successfully deleted
Aug 08 11:31:18 dist-test-slave-zkpd krb5kdc[28026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188677, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.66.129@KRBTEST.COM
I20260808 11:31:18.065974 28657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:18.038217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41368 (local address 127.26.66.129:42995)
0808 11:31:18.038458 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:18.038464 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:18.045891 (+ 7427us) server_negotiation.cc:407] Connection header received
0808 11:31:18.046171 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:18.046177 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:18.046276 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:18.046378 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:18.048592 (+ 2214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:18.049726 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:18.051728 (+ 2002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:18.052520 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:18.052647 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:18.058201 (+ 5554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:18.058215 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:18.058240 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:18.058281 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:18.062622 (+ 4341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:18.063497 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:18.063507 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:18.063511 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:18.063692 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:18.064159 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:18.064165 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:18.064169 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:18.064661 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:18.064983 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:18.065310 (+ 327us) server_negotiation.cc:299] Negotiation successful
0808 11:31:18.065537 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
W20260808 11:31:18.066907 28289 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41368
I20260808 11:31:18.092053 28470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:18.070725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51580 (local address 127.26.66.190:36747)
0808 11:31:18.070940 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:18.070946 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:18.076413 (+ 5467us) server_negotiation.cc:407] Connection header received
0808 11:31:18.076576 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:18.076583 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:18.076668 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:18.076773 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:18.078500 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:18.079631 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:18.081480 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:18.082180 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:18.082328 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:18.085279 (+ 2951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:18.085294 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:18.085300 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:18.085342 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:18.089030 (+ 3688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:18.089852 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:18.089858 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:18.089861 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:18.090024 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:18.090431 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:18.090438 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:18.090441 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:18.090785 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:18.091022 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:18.091407 (+ 385us) server_negotiation.cc:299] Negotiation successful
0808 11:31:18.091635 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260808 11:31:18.092953 28073 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51580
I20260808 11:31:18.095204 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 28150
I20260808 11:31:18.126127 28657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:18.099563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41372 (local address 127.26.66.129:42995)
0808 11:31:18.099762 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:18.099768 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:18.109282 (+ 9514us) server_negotiation.cc:407] Connection header received
0808 11:31:18.109741 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:18.109748 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:18.109832 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:18.109912 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:18.111645 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:18.112824 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:18.114661 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:18.115464 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:18.115561 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:18.118718 (+ 3157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:18.118724 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:18.118729 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:18.118779 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:18.122612 (+ 3833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:18.123513 (+ 901us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:18.123518 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:18.123522 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:18.123724 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:18.124204 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:18.124209 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:18.124213 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:18.124570 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:18.124828 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:18.125429 (+ 601us) server_negotiation.cc:299] Negotiation successful
0808 11:31:18.125672 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260808 11:31:18.127511 28289 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41372
W20260808 11:31:18.128151 26890 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 28150: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 11:31:18.128386 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 28150
I20260808 11:31:18.153084 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 28299
Aug 08 11:31:18 dist-test-slave-zkpd krb5kdc[28026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188677, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.66.130@KRBTEST.COM
I20260808 11:31:18.168479 28676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:18.153930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33870 (local address 127.26.66.130:36133)
0808 11:31:18.154453 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:18.154458 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:18.154473 (+ 15us) server_negotiation.cc:407] Connection header received
0808 11:31:18.154527 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:18.154531 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:18.154595 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:18.154721 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:18.155957 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:18.156637 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:18.157885 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:18.158329 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:18.158469 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:18.162570 (+ 4101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:18.162585 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:18.162601 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:18.162637 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:18.165628 (+ 2991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:18.166308 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:18.166316 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:18.166318 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:18.166448 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:18.166835 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:18.166842 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:18.166847 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:18.167195 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:18.167498 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:18.167818 (+ 320us) server_negotiation.cc:299] Negotiation successful
0808 11:31:18.168081 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":280,"threads_started":1}
W20260808 11:31:18.169207 28435 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33870
W20260808 11:31:18.169886 26890 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 28299: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 11:31:18.170061 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 28299
I20260808 11:31:18.199424 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 28444
Aug 08 11:31:18 dist-test-slave-zkpd krb5kdc[28026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188677, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.66.131@KRBTEST.COM
I20260808 11:31:18.216661 28602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:18.200357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40580 (local address 127.26.66.131:45167)
0808 11:31:18.200531 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:18.200535 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:18.200553 (+ 18us) server_negotiation.cc:407] Connection header received
0808 11:31:18.200720 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:18.200723 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:18.200797 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:18.200896 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:18.202456 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:18.203212 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:18.205029 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:18.205461 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:18.205556 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:18.210624 (+ 5068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:18.210638 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:18.210654 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:18.210689 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:18.213873 (+ 3184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:18.214544 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:18.214552 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:18.214554 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:18.214685 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:18.215079 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:18.215094 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:18.215096 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:18.215465 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:18.215822 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:18.216059 (+ 237us) server_negotiation.cc:299] Negotiation successful
0808 11:31:18.216326 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260808 11:31:18.217585 28580 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40580
W20260808 11:31:18.218279 26890 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 28444: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 11:31:18.218477 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 28444
I20260808 11:31:18.247102 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 28040
I20260808 11:31:18.248315 28116 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:18.369612 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 28040
2026-08-08T11:31:18Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5811 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:31:18 dist-test-slave-zkpd krb5kdc[28680](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:31:18 dist-test-slave-zkpd krb5kdc[28680](info): set up 2 sockets
Aug 08 11:31:18 dist-test-slave-zkpd krb5kdc[28680](info): commencing operation
krb5kdc: starting...
W20260808 11:31:19.525331 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.106s user 0.000s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:31:19 dist-test-slave-zkpd krb5kdc[28680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:31:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:31:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:31:19.737534 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:37989
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:40491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:37989
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:20.067456 28695 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:20.067765 28695 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:20.067863 28695 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:20.075491 28695 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:31:20.075632 28695 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 11:31:20.075701 28695 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:20.075799 28695 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:20.075878 28695 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:31:20.076001 28695 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:31:20.085879 28695 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:40491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:37989
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:37989
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:20.087095 28695 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:20.088477 28695 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:20.100271 28700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:20.100399 28701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:20.100462 28703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:20.101508 28695 server_base.cc:1034] running on GCE node
I20260808 11:31:20.102334 28695 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:20.103688 28695 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:20.104913 28695 hybrid_clock.cc:648] HybridClock initialized: now 1786188680104840 us; error 41 us; skew 500 ppm
I20260808 11:31:20.105202 28695 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:20 dist-test-slave-zkpd krb5kdc[28680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188680, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:20.112532 28695 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:31:20.114135 28695 webserver.cc:460] Webserver started at http://127.26.66.190:44167/ using document root <none> and password file <none>
I20260808 11:31:20.114826 28695 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:20.114917 28695 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:20.115195 28695 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:20.118216 28695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "57a5ece6fd4547c3a36eeb103b903be7"
format_stamp: "Formatted at 2026-08-08 11:31:20 on dist-test-slave-zkpd"
server_key: "ad8ab7e2676b1590c929c7d3663985a0"
server_key_iv: "61843f128994061f2e8d91ae005ad7e9"
server_key_version: "encryptionkey@0"
I20260808 11:31:20.119014 28695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "57a5ece6fd4547c3a36eeb103b903be7"
format_stamp: "Formatted at 2026-08-08 11:31:20 on dist-test-slave-zkpd"
server_key: "ad8ab7e2676b1590c929c7d3663985a0"
server_key_iv: "61843f128994061f2e8d91ae005ad7e9"
server_key_version: "encryptionkey@0"
I20260808 11:31:20.124228 28695 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 11:31:20.127600 28710 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:20.128960 28695 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:31:20.129148 28695 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "57a5ece6fd4547c3a36eeb103b903be7"
format_stamp: "Formatted at 2026-08-08 11:31:20 on dist-test-slave-zkpd"
server_key: "ad8ab7e2676b1590c929c7d3663985a0"
server_key_iv: "61843f128994061f2e8d91ae005ad7e9"
server_key_version: "encryptionkey@0"
I20260808 11:31:20.129359 28695 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:20.142566 28695 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:20.146692 28695 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:20.147003 28695 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:20.169632 28695 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:37989
I20260808 11:31:20.169638 28773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:37989 every 8 connection(s)
I20260808 11:31:20.171075 28695 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:31:20.174963 28774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:20.175060 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 28695
I20260808 11:31:20.175328 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:31:20.176069 26890 external_mini_cluster.cc:1428] Setting key 87a09dc84d413fbae303edf94c13af8a
I20260808 11:31:20.188957 28774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57a5ece6fd4547c3a36eeb103b903be7: Bootstrap starting.
Aug 08 11:31:20 dist-test-slave-zkpd krb5kdc[28680](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:20.192685 28774 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57a5ece6fd4547c3a36eeb103b903be7: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:20.193949 28774 log.cc:824] T 00000000000000000000000000000000 P 57a5ece6fd4547c3a36eeb103b903be7: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:20.196766 28774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57a5ece6fd4547c3a36eeb103b903be7: No bootstrap required, opened a new log
I20260808 11:31:20.199846 28777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:20.178049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36428 (local address 127.26.66.190:37989)
0808 11:31:20.178880 (+ 831us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:20.178895 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:20.178940 (+ 45us) server_negotiation.cc:407] Connection header received
0808 11:31:20.181176 (+ 2236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:20.181200 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:20.181603 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:20.181946 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:20.183749 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:20.185093 (+ 1344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:20.186910 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:20.187554 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:20.187678 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:20.192472 (+ 4794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:20.192480 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:20.192494 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:20.192528 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:20.195808 (+ 3280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:20.196533 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:20.196546 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:20.196551 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:20.196735 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:20.197139 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:20.197147 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:20.197154 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:20.197682 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:20.197988 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:20.198476 (+ 488us) server_negotiation.cc:299] Negotiation successful
0808 11:31:20.198877 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":621,"thread_start_us":415,"threads_started":1}
I20260808 11:31:20.204722 28774 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57a5ece6fd4547c3a36eeb103b903be7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57a5ece6fd4547c3a36eeb103b903be7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 37989 } }
I20260808 11:31:20.205078 28774 raft_consensus.cc:374] T 00000000000000000000000000000000 P 57a5ece6fd4547c3a36eeb103b903be7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:20.205219 28774 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57a5ece6fd4547c3a36eeb103b903be7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57a5ece6fd4547c3a36eeb103b903be7, State: Initialized, Role: FOLLOWER
I20260808 11:31:20.205801 28774 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57a5ece6fd4547c3a36eeb103b903be7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57a5ece6fd4547c3a36eeb103b903be7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 37989 } }
I20260808 11:31:20.206033 28774 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57a5ece6fd4547c3a36eeb103b903be7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:31:20.206166 28774 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57a5ece6fd4547c3a36eeb103b903be7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:31:20.206339 28774 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57a5ece6fd4547c3a36eeb103b903be7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:20.208704 28774 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57a5ece6fd4547c3a36eeb103b903be7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57a5ece6fd4547c3a36eeb103b903be7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 37989 } }
I20260808 11:31:20.209230 28774 leader_election.cc:302] T 00000000000000000000000000000000 P 57a5ece6fd4547c3a36eeb103b903be7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57a5ece6fd4547c3a36eeb103b903be7; no voters:
I20260808 11:31:20.209757 28774 leader_election.cc:288] T 00000000000000000000000000000000 P 57a5ece6fd4547c3a36eeb103b903be7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:31:20.209913 28779 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57a5ece6fd4547c3a36eeb103b903be7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:31:20.210616 28779 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57a5ece6fd4547c3a36eeb103b903be7 [term 1 LEADER]: Becoming Leader. State: Replica: 57a5ece6fd4547c3a36eeb103b903be7, State: Running, Role: LEADER
I20260808 11:31:20.211134 28779 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57a5ece6fd4547c3a36eeb103b903be7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57a5ece6fd4547c3a36eeb103b903be7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 37989 } }
I20260808 11:31:20.211773 28774 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57a5ece6fd4547c3a36eeb103b903be7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:31:20.215991 28782 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57a5ece6fd4547c3a36eeb103b903be7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57a5ece6fd4547c3a36eeb103b903be7. Latest consensus state: current_term: 1 leader_uuid: "57a5ece6fd4547c3a36eeb103b903be7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57a5ece6fd4547c3a36eeb103b903be7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 37989 } } }
I20260808 11:31:20.216022 28781 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57a5ece6fd4547c3a36eeb103b903be7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57a5ece6fd4547c3a36eeb103b903be7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57a5ece6fd4547c3a36eeb103b903be7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 37989 } } }
I20260808 11:31:20.216511 28781 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57a5ece6fd4547c3a36eeb103b903be7 [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:20.216516 28782 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57a5ece6fd4547c3a36eeb103b903be7 [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:20.217440 28787 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:31:20.223542 28787 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:31:20.232134 28787 catalog_manager.cc:1347] Generated new cluster ID: a53b793dd65e4d9697f7ec72ca25ea6f
I20260808 11:31:20.232244 28787 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:31:20.241235 28787 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:31:20.242545 28787 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:31:20.252482 28787 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 57a5ece6fd4547c3a36eeb103b903be7: Generated new TSK 0
I20260808 11:31:20.253360 28787 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.66.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
I20260808 11:31:20.319587 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:0
--local_ip_for_outbound_sockets=127.26.66.129
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:37989
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:40491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:20.660125 28802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:20.660392 28802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:20.660563 28802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:20.667726 28802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:20.667827 28802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:20.667999 28802 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 11:31:20.668072 28802 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 11:31:20.668213 28802 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:31:20.677716 28802 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:40491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.66.190:37989
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:20.679029 28802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:20.680424 28802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:20.693413 28807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:20.693466 28812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:20.693493 28809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:20.694613 28802 server_base.cc:1034] running on GCE node
I20260808 11:31:20.695237 28802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:20.696321 28802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:20.697546 28802 hybrid_clock.cc:648] HybridClock initialized: now 1786188680697478 us; error 61 us; skew 500 ppm
I20260808 11:31:20.697878 28802 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:20 dist-test-slave-zkpd krb5kdc[28680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188680, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:20.701363 28802 init.cc:377] Logged in from keytab as kudu/127.26.66.129@KRBTEST.COM (short username kudu)
I20260808 11:31:20.702935 28802 webserver.cc:460] Webserver started at http://127.26.66.129:37587/ using document root <none> and password file <none>
I20260808 11:31:20.703617 28802 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:20.703753 28802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:20.704136 28802 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:20.707113 28802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-0/data/instance:
uuid: "ad11bfd2f76b4a008496a2d703fcf8fe"
format_stamp: "Formatted at 2026-08-08 11:31:20 on dist-test-slave-zkpd"
server_key: "cf86b5c5c12047b76ab26d1ead397dec"
server_key_iv: "439d2556225916a702388aad367abe83"
server_key_version: "encryptionkey@0"
I20260808 11:31:20.707883 28802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance:
uuid: "ad11bfd2f76b4a008496a2d703fcf8fe"
format_stamp: "Formatted at 2026-08-08 11:31:20 on dist-test-slave-zkpd"
server_key: "cf86b5c5c12047b76ab26d1ead397dec"
server_key_iv: "439d2556225916a702388aad367abe83"
server_key_version: "encryptionkey@0"
I20260808 11:31:20.713143 28802 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260808 11:31:20.716699 28820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:20.718112 28802 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260808 11:31:20.718243 28802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "ad11bfd2f76b4a008496a2d703fcf8fe"
format_stamp: "Formatted at 2026-08-08 11:31:20 on dist-test-slave-zkpd"
server_key: "cf86b5c5c12047b76ab26d1ead397dec"
server_key_iv: "439d2556225916a702388aad367abe83"
server_key_version: "encryptionkey@0"
I20260808 11:31:20.718415 28802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:20.738416 28802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:20.742146 28802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:20.742395 28802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:20.745155 28802 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:20.745330 28802 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:20.745494 28802 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:20.745611 28802 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 11:31:20 dist-test-slave-zkpd krb5kdc[28680](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188680, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:20.769328 28828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:20.745529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:57635 (local address 127.26.66.190:37989)
0808 11:31:20.746124 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:20.746130 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:20.747394 (+ 1264us) server_negotiation.cc:407] Connection header received
0808 11:31:20.749537 (+ 2143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:20.749543 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:20.749645 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:20.749822 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:20.752078 (+ 2256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:20.753035 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:20.755411 (+ 2376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:20.756247 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:20.756385 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:20.761009 (+ 4624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:20.761018 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:20.761022 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:20.761064 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:20.765335 (+ 4271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:20.766247 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:20.766255 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:20.766262 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:20.766431 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:20.766908 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:20.766913 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:20.766916 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:20.767360 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:20.767527 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:20.768740 (+ 1213us) server_negotiation.cc:299] Negotiation successful
0808 11:31:20.768960 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":283,"threads_started":1}
I20260808 11:31:20.770393 28830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:20.746244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:37989 (local address 127.26.66.129:57635)
0808 11:31:20.747192 (+ 948us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:20.747243 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:20.749255 (+ 2012us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:20.750103 (+ 848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:20.750114 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:20.750928 (+ 814us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:20.751830 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:20.751862 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:20.753205 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:20.753216 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:20.755226 (+ 2010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:20.755249 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:20.756556 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:20.756566 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:20.756864 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:20.757603 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:20.757652 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:20.760764 (+ 3112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:20.765486 (+ 4722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:20.765492 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:20.765504 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:20.766072 (+ 568us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:20.766559 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:20.766563 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:20.766565 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:20.766769 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:20.767509 (+ 740us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:20.767517 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:20.768045 (+ 528us) client_negotiation.cc:769] Sending connection context
0808 11:31:20.768358 (+ 313us) client_negotiation.cc:240] Negotiation successful
0808 11:31:20.768954 (+ 596us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":672,"thread_start_us":374,"threads_started":1}
I20260808 11:31:20.794286 28828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:20.778210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:39409 (local address 127.26.66.190:37989)
0808 11:31:20.778406 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:20.778414 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:20.779158 (+ 744us) server_negotiation.cc:407] Connection header received
0808 11:31:20.779402 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:20.779410 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:20.779512 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:20.779625 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:20.781120 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:20.782170 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:20.783948 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:20.784532 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:20.784667 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:20.787068 (+ 2401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:20.787078 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:20.787085 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:20.787127 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:20.790942 (+ 3815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:20.791991 (+ 1049us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:20.791995 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:20.791997 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:20.792149 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:20.792623 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:20.792627 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:20.792628 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:20.792893 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:20.793009 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:20.793609 (+ 600us) server_negotiation.cc:299] Negotiation successful
0808 11:31:20.793901 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 11:31:20.794543 28904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:20.778207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:37989 (local address 127.26.66.129:39409)
0808 11:31:20.779024 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:20.779051 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:20.779234 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:20.779663 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:20.779671 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:20.780432 (+ 761us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:20.780967 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:20.780981 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:20.782306 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:20.782319 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:20.783771 (+ 1452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:20.783784 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:20.784734 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:20.784742 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:20.784905 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:20.785634 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:20.785667 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:20.786844 (+ 1177us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:20.791108 (+ 4264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:20.791116 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:20.791123 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:20.791777 (+ 654us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:20.792267 (+ 490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:20.792275 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:20.792281 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:20.792498 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:20.793012 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:20.793020 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:20.793282 (+ 262us) client_negotiation.cc:769] Sending connection context
0808 11:31:20.793484 (+ 202us) client_negotiation.cc:240] Negotiation successful
0808 11:31:20.794014 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"thread_start_us":404,"threads_started":1}
I20260808 11:31:20.798431 28802 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:33407
I20260808 11:31:20.798539 28945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:33407 every 8 connection(s)
I20260808 11:31:20.799758 28802 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:31:20.801899 28946 heartbeater.cc:347] Connected to a master server at 127.26.66.190:37989
I20260808 11:31:20.802093 28946 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:20.802677 28946 heartbeater.cc:511] Master 127.26.66.190:37989 requested a full tablet report, sending...
I20260808 11:31:20.803800 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 28802
I20260808 11:31:20.804070 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance
I20260808 11:31:20.804610 28728 ts_manager.cc:194] Registered new tserver with Master: ad11bfd2f76b4a008496a2d703fcf8fe (127.26.66.129:33407)
I20260808 11:31:20.804700 26890 external_mini_cluster.cc:1428] Setting key e5ac9fefeb0a6d9d40984734871357c6
I20260808 11:31:20.806376 28728 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.129@KRBTEST.COM'} at 127.26.66.129:57635
WARNING: no policy specified for kudu/127.26.66.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
I20260808 11:31:20.855013 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:0
--local_ip_for_outbound_sockets=127.26.66.130
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:37989
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:40491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:21.191850 28950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:21.192225 28950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:21.192396 28950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:21.199524 28950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:21.199672 28950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:21.199819 28950 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 11:31:21.199927 28950 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 11:31:21.200069 28950 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:31:21.209779 28950 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:40491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.66.190:37989
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:21.211050 28950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:21.212478 28950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:21.225682 28959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:21.225761 28957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:21.225732 28956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:21.226773 28950 server_base.cc:1034] running on GCE node
I20260808 11:31:21.227419 28950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:21.228390 28950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:21.229595 28950 hybrid_clock.cc:648] HybridClock initialized: now 1786188681229544 us; error 31 us; skew 500 ppm
I20260808 11:31:21.229911 28950 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:21 dist-test-slave-zkpd krb5kdc[28680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188681, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:21.233146 28950 init.cc:377] Logged in from keytab as kudu/127.26.66.130@KRBTEST.COM (short username kudu)
I20260808 11:31:21.234665 28950 webserver.cc:460] Webserver started at http://127.26.66.130:33169/ using document root <none> and password file <none>
I20260808 11:31:21.235364 28950 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:21.235523 28950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:21.235853 28950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:21.238854 28950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-1/data/instance:
uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6"
format_stamp: "Formatted at 2026-08-08 11:31:21 on dist-test-slave-zkpd"
server_key: "2764088c72d433ea3195d8195448f532"
server_key_iv: "268164d07d84f6220d500e7f0ff1ba4e"
server_key_version: "encryptionkey@0"
I20260808 11:31:21.239636 28950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance:
uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6"
format_stamp: "Formatted at 2026-08-08 11:31:21 on dist-test-slave-zkpd"
server_key: "2764088c72d433ea3195d8195448f532"
server_key_iv: "268164d07d84f6220d500e7f0ff1ba4e"
server_key_version: "encryptionkey@0"
I20260808 11:31:21.244912 28950 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260808 11:31:21.248451 28967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:21.249781 28950 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 11:31:21.249954 28950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6"
format_stamp: "Formatted at 2026-08-08 11:31:21 on dist-test-slave-zkpd"
server_key: "2764088c72d433ea3195d8195448f532"
server_key_iv: "268164d07d84f6220d500e7f0ff1ba4e"
server_key_version: "encryptionkey@0"
I20260808 11:31:21.250154 28950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:21.276417 28950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:21.280421 28950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:21.280723 28950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:21.283383 28950 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:21.283522 28950 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:21.283684 28950 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:21.283771 28950 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 11:31:21 dist-test-slave-zkpd krb5kdc[28680](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188681, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:21.307073 28828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:21.283869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:42871 (local address 127.26.66.190:37989)
0808 11:31:21.284110 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:21.284119 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:21.285637 (+ 1518us) server_negotiation.cc:407] Connection header received
0808 11:31:21.287672 (+ 2035us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:21.287681 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:21.287798 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:21.287964 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:21.290584 (+ 2620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.291907 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.294260 (+ 2353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.294838 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.294985 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:21.299572 (+ 4587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:21.299580 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:21.299588 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:21.299637 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:21.303575 (+ 3938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:21.304707 (+ 1132us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:21.304713 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:21.304718 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:21.304876 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:21.305344 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:21.305355 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:21.305357 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:21.305636 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:21.305804 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:21.306483 (+ 679us) server_negotiation.cc:299] Negotiation successful
0808 11:31:21.306713 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117}
I20260808 11:31:21.308115 28977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:21.284515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:37989 (local address 127.26.66.130:42871)
0808 11:31:21.285429 (+ 914us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:21.285477 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:21.287382 (+ 1905us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:21.288259 (+ 877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:21.288680 (+ 421us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:21.289501 (+ 821us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:21.290351 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:21.290375 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.292118 (+ 1743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.292129 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:21.294094 (+ 1965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:21.294107 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.295089 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.295099 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:21.295482 (+ 383us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:21.296387 (+ 905us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:21.296412 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:21.299257 (+ 2845us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:21.303766 (+ 4509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:21.303776 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:21.303797 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:21.304574 (+ 777us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:21.305002 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:21.305007 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:21.305011 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:21.305215 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:21.305779 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:21.305786 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:21.306109 (+ 323us) client_negotiation.cc:769] Sending connection context
0808 11:31:21.306373 (+ 264us) client_negotiation.cc:240] Negotiation successful
0808 11:31:21.306876 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"thread_start_us":416,"threads_started":1}
I20260808 11:31:21.329738 28828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:21.314081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:59317 (local address 127.26.66.190:37989)
0808 11:31:21.314297 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:21.314305 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:21.315111 (+ 806us) server_negotiation.cc:407] Connection header received
0808 11:31:21.315293 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:21.315297 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:21.315370 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:21.315452 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:21.317066 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.318100 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.320167 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.320969 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.321117 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:21.323261 (+ 2144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:21.323267 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:21.323271 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:21.323303 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:21.326635 (+ 3332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:21.327608 (+ 973us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:21.327616 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:21.327619 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:21.327789 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:21.328197 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:21.328205 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:21.328210 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:21.328547 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:21.328730 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:21.329135 (+ 405us) server_negotiation.cc:299] Negotiation successful
0808 11:31:21.329396 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 11:31:21.329977 29041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:21.314220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:37989 (local address 127.26.66.130:59317)
0808 11:31:21.314990 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:21.315014 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:21.315178 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:21.315516 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:21.315524 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:21.316257 (+ 733us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:21.316880 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:21.316901 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.318244 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.318250 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:21.319971 (+ 1721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:21.319995 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.321213 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.321221 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:21.321367 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:21.322045 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:21.322071 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:21.322890 (+ 819us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:21.326787 (+ 3897us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:21.326792 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:21.326796 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:21.327464 (+ 668us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:21.327928 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:21.327933 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:21.327937 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:21.328077 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:21.328679 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:21.328684 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:21.328887 (+ 203us) client_negotiation.cc:769] Sending connection context
0808 11:31:21.329029 (+ 142us) client_negotiation.cc:240] Negotiation successful
0808 11:31:21.329489 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":365,"threads_started":1}
I20260808 11:31:21.342480 28950 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:34005
I20260808 11:31:21.342530 29097 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:34005 every 8 connection(s)
I20260808 11:31:21.343683 28950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:31:21.345716 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 28950
I20260808 11:31:21.345953 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance
I20260808 11:31:21.345954 29098 heartbeater.cc:347] Connected to a master server at 127.26.66.190:37989
I20260808 11:31:21.346176 29098 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:21.346562 26890 external_mini_cluster.cc:1428] Setting key 0d4e22a658fe19c01bbff2337e62df18
I20260808 11:31:21.346946 29098 heartbeater.cc:511] Master 127.26.66.190:37989 requested a full tablet report, sending...
I20260808 11:31:21.348470 28727 ts_manager.cc:194] Registered new tserver with Master: 87a1b69a40fe4199b8ef4e3e5700b6a6 (127.26.66.130:34005)
I20260808 11:31:21.349341 28727 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.130@KRBTEST.COM'} at 127.26.66.130:42871
WARNING: no policy specified for kudu/127.26.66.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
I20260808 11:31:21.393493 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:0
--local_ip_for_outbound_sockets=127.26.66.131
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:37989
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:40491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:21.729424 29102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:21.729678 29102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:21.729864 29102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:21.737287 29102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:21.737394 29102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:21.737502 29102 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 11:31:21.737583 29102 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 11:31:21.737712 29102 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:31:21.747052 29102 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:40491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.66.190:37989
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:21.748446 29102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:21.749719 29102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:21.763262 29109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:21.763294 29110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:21.763346 29113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:21.764063 29102 server_base.cc:1034] running on GCE node
I20260808 11:31:21.764704 29102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:21.765578 29102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:21.766779 29102 hybrid_clock.cc:648] HybridClock initialized: now 1786188681766731 us; error 34 us; skew 500 ppm
I20260808 11:31:21.767108 29102 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:21 dist-test-slave-zkpd krb5kdc[28680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188681, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:21.770248 29102 init.cc:377] Logged in from keytab as kudu/127.26.66.131@KRBTEST.COM (short username kudu)
I20260808 11:31:21.771653 29102 webserver.cc:460] Webserver started at http://127.26.66.131:33229/ using document root <none> and password file <none>
I20260808 11:31:21.772406 29102 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:21.772549 29102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:21.772902 29102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:21.775854 29102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-2/data/instance:
uuid: "d0a20562723a4500bf4dcda28c2baed5"
format_stamp: "Formatted at 2026-08-08 11:31:21 on dist-test-slave-zkpd"
server_key: "0b92d565426c2e2c5ef169b941e1dbd2"
server_key_iv: "097e05fc37dea4e8773fdbf8af11da5d"
server_key_version: "encryptionkey@0"
I20260808 11:31:21.776672 29102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance:
uuid: "d0a20562723a4500bf4dcda28c2baed5"
format_stamp: "Formatted at 2026-08-08 11:31:21 on dist-test-slave-zkpd"
server_key: "0b92d565426c2e2c5ef169b941e1dbd2"
server_key_iv: "097e05fc37dea4e8773fdbf8af11da5d"
server_key_version: "encryptionkey@0"
I20260808 11:31:21.781765 29102 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 11:31:21.785105 29120 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:21.786355 29102 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:31:21.786530 29102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "d0a20562723a4500bf4dcda28c2baed5"
format_stamp: "Formatted at 2026-08-08 11:31:21 on dist-test-slave-zkpd"
server_key: "0b92d565426c2e2c5ef169b941e1dbd2"
server_key_iv: "097e05fc37dea4e8773fdbf8af11da5d"
server_key_version: "encryptionkey@0"
I20260808 11:31:21.786728 29102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:21.802455 29102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:21.806771 29102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:21.807072 29102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:21.809811 29102 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:21.809840 28946 heartbeater.cc:503] Master 127.26.66.190:37989 was elected leader, sending a full tablet report...
I20260808 11:31:21.809952 29102 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:21.810101 29102 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:21.810245 29102 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 11:31:21 dist-test-slave-zkpd krb5kdc[28680](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188681, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:21.834566 28828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:21.810805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:57947 (local address 127.26.66.190:37989)
0808 11:31:21.811040 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:21.811047 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:21.812741 (+ 1694us) server_negotiation.cc:407] Connection header received
0808 11:31:21.814911 (+ 2170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:21.814920 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:21.815007 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:21.815120 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:21.817178 (+ 2058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.818662 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.820539 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.821349 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.821504 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:21.826114 (+ 4610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:21.826121 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:21.826126 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:21.826178 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:21.829967 (+ 3789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:21.831020 (+ 1053us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:21.831029 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:21.831035 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:21.831220 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:21.831882 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:21.831911 (+ 29us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:21.831917 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:21.832375 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:21.832610 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:21.833799 (+ 1189us) server_negotiation.cc:299] Negotiation successful
0808 11:31:21.834106 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260808 11:31:21.836858 29131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:21.811702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:37989 (local address 127.26.66.131:57947)
0808 11:31:21.812591 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:21.812628 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:21.814606 (+ 1978us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:21.815376 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:21.815384 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:21.816075 (+ 691us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:21.816963 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:21.816998 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.818817 (+ 1819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.818821 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:21.820321 (+ 1500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:21.820346 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.821605 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.821611 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:21.821780 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:21.822609 (+ 829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:21.822651 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:21.825859 (+ 3208us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:21.830131 (+ 4272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:21.830159 (+ 28us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:21.830178 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:21.830835 (+ 657us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:21.831363 (+ 528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:21.831370 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:21.831376 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:21.831733 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:21.832532 (+ 799us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:21.832546 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:21.833152 (+ 606us) client_negotiation.cc:769] Sending connection context
0808 11:31:21.833539 (+ 387us) client_negotiation.cc:240] Negotiation successful
0808 11:31:21.834253 (+ 714us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"thread_start_us":427,"threads_started":1}
I20260808 11:31:21.858495 29102 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:43845
I20260808 11:31:21.858536 29247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:43845 every 8 connection(s)
I20260808 11:31:21.859814 29102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:31:21.861274 29212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:21.844984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:37989 (local address 127.26.66.131:46719)
0808 11:31:21.845875 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:21.845895 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:21.846023 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:21.846423 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:21.846430 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:21.847211 (+ 781us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:21.847749 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:21.847769 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.849347 (+ 1578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.849351 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:21.850940 (+ 1589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:21.850953 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.852084 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.852098 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:21.852355 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:21.853054 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:21.853084 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:21.854393 (+ 1309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:21.858239 (+ 3846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:21.858244 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:21.858248 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:21.858893 (+ 645us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:21.859281 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:21.859286 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:21.859289 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:21.859435 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:21.860010 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:21.860015 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:21.860208 (+ 193us) client_negotiation.cc:769] Sending connection context
0808 11:31:21.860388 (+ 180us) client_negotiation.cc:240] Negotiation successful
0808 11:31:21.860776 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":734,"thread_start_us":601,"threads_started":1}
I20260808 11:31:21.861351 28828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:21.845559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:46719 (local address 127.26.66.190:37989)
0808 11:31:21.845801 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:21.845809 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:21.845995 (+ 186us) server_negotiation.cc:407] Connection header received
0808 11:31:21.846144 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:21.846152 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:21.846246 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:21.846363 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:21.847970 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.849197 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.851098 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.851625 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.851761 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:21.854589 (+ 2828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:21.854602 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:21.854606 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:21.854665 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:21.858096 (+ 3431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:21.859012 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:21.859020 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:21.859024 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:21.859165 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:21.859550 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:21.859558 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:21.859562 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:21.859855 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:21.860049 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:21.860530 (+ 481us) server_negotiation.cc:299] Negotiation successful
0808 11:31:21.860849 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 11:31:21.862517 29248 heartbeater.cc:347] Connected to a master server at 127.26.66.190:37989
I20260808 11:31:21.862730 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 29102
I20260808 11:31:21.862936 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance
I20260808 11:31:21.863009 29248 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:21.863399 26890 external_mini_cluster.cc:1428] Setting key 21b8ff4f6846040674db43936bcbf1f8
I20260808 11:31:21.863914 29248 heartbeater.cc:511] Master 127.26.66.190:37989 requested a full tablet report, sending...
I20260808 11:31:21.865543 28728 ts_manager.cc:194] Registered new tserver with Master: d0a20562723a4500bf4dcda28c2baed5 (127.26.66.131:43845)
I20260808 11:31:21.866496 28728 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.131@KRBTEST.COM'} at 127.26.66.131:57947
I20260808 11:31:21.866555 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 11:31:21 dist-test-slave-zkpd krb5kdc[28680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188681, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 11:31:21 dist-test-slave-zkpd krb5kdc[28680](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188681, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:21.919085 28828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:21.905728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45422 (local address 127.26.66.190:37989)
0808 11:31:21.905910 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:21.905915 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:21.906313 (+ 398us) server_negotiation.cc:407] Connection header received
0808 11:31:21.906473 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:21.906477 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:21.906539 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:21.906633 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:21.907971 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.908711 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.909960 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.910433 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.910526 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:21.914337 (+ 3811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:21.914342 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:21.914345 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:21.914375 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:21.916903 (+ 2528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:21.917512 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:21.917516 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:21.917518 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:21.917633 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:21.917950 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:21.917953 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:21.917955 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:21.918205 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:21.918396 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:21.918649 (+ 253us) server_negotiation.cc:299] Negotiation successful
0808 11:31:21.918821 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 11:31:21.923213 28728 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45422:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 11:31:21.930119 28728 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:31:21.969866 29263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:21.943781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:43845 (local address 127.0.0.1:39150)
0808 11:31:21.961236 (+ 17455us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:21.961259 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:21.961404 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:21.962559 (+ 1155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:21.962567 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:21.962597 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:31:21.963056 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:21.963083 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.964634 (+ 1551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.964641 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:21.966526 (+ 1885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:21.966540 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.968689 (+ 2149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.968695 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:21.968918 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:21.968996 (+ 78us) client_negotiation.cc:769] Sending connection context
0808 11:31:21.969152 (+ 156us) client_negotiation.cc:240] Negotiation successful
0808 11:31:21.969378 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17291,"mutex_wait_us":1,"thread_start_us":14380,"threads_started":1}
I20260808 11:31:21.970911 29268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:21.944206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39150 (local address 127.26.66.131:43845)
0808 11:31:21.962053 (+ 17847us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:21.962060 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:21.962087 (+ 27us) server_negotiation.cc:407] Connection header received
0808 11:31:21.962161 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:21.962167 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:21.962355 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:21.962552 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:31:21.963304 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.964505 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.966751 (+ 2246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.968196 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.968317 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:21.968510 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:21.970415 (+ 1905us) server_negotiation.cc:299] Negotiation successful
0808 11:31:21.970592 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17689,"thread_start_us":17495,"threads_started":1}
I20260808 11:31:21.972751 29266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:21.943716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:34005 (local address 127.0.0.1:57152)
0808 11:31:21.957929 (+ 14213us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:21.957952 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:21.958091 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:21.965801 (+ 7710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:21.965809 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:21.965861 (+ 52us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:31:21.966457 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:21.966473 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.968294 (+ 1821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.968299 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:21.970450 (+ 2151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:21.970466 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.971879 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.971906 (+ 27us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:21.972104 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:21.972145 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 11:31:21.972232 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 11:31:21.972371 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14048,"mutex_wait_us":21,"thread_start_us":9960,"threads_started":1}
I20260808 11:31:21.974467 29265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:21.943213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:33407 (local address 127.0.0.1:36308)
0808 11:31:21.954093 (+ 10880us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:21.954131 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:21.954325 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:21.967501 (+ 13176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:21.967506 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:21.967530 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:31:21.967845 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:21.967854 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.969797 (+ 1943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.969803 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:21.972017 (+ 2214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:21.972033 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.973608 (+ 1575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.973616 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:21.973807 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:21.973843 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 11:31:21.973929 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 11:31:21.974044 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10599,"mutex_wait_us":2,"thread_start_us":19610,"threads_started":1}
I20260808 11:31:21.975160 29264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:21.943366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36308 (local address 127.26.66.129:33407)
0808 11:31:21.967068 (+ 23702us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:21.967074 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:21.967095 (+ 21us) server_negotiation.cc:407] Connection header received
0808 11:31:21.967169 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:21.967173 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:21.967316 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:21.967511 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:31:21.968046 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.969640 (+ 1594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.972188 (+ 2548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.973376 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.973532 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:21.973774 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:21.974709 (+ 935us) server_negotiation.cc:299] Negotiation successful
0808 11:31:21.974866 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23546,"thread_start_us":23403,"threads_started":1}
I20260808 11:31:21.974943 29173 tablet_service.cc:1467] Processing CreateTablet for tablet 0201c6cd25fa4d4aa7aae36145a8faaa (DEFAULT_TABLE table=test-table [id=beb6380d1d6e4b1391142d3f7252d4bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:31:21.976509 29173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0201c6cd25fa4d4aa7aae36145a8faaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:21.976768 29267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:21.943965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57152 (local address 127.26.66.130:34005)
0808 11:31:21.964380 (+ 20415us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:21.964392 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:21.964831 (+ 439us) server_negotiation.cc:407] Connection header received
0808 11:31:21.964963 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:21.964991 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:21.965291 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:21.965513 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:31:21.966663 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.968144 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.970609 (+ 2465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:21.971651 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:21.975978 (+ 4327us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:21.976134 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:21.976225 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 11:31:21.976425 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20221,"thread_start_us":20077,"threads_started":1}
I20260808 11:31:21.978595 28872 tablet_service.cc:1467] Processing CreateTablet for tablet 0201c6cd25fa4d4aa7aae36145a8faaa (DEFAULT_TABLE table=test-table [id=beb6380d1d6e4b1391142d3f7252d4bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:31:21.979928 28872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0201c6cd25fa4d4aa7aae36145a8faaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:21.980099 29021 tablet_service.cc:1467] Processing CreateTablet for tablet 0201c6cd25fa4d4aa7aae36145a8faaa (DEFAULT_TABLE table=test-table [id=beb6380d1d6e4b1391142d3f7252d4bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:31:21.981402 29021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0201c6cd25fa4d4aa7aae36145a8faaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:21.990765 29269 tablet_bootstrap.cc:492] T 0201c6cd25fa4d4aa7aae36145a8faaa P ad11bfd2f76b4a008496a2d703fcf8fe: Bootstrap starting.
I20260808 11:31:21.993955 29269 tablet_bootstrap.cc:654] T 0201c6cd25fa4d4aa7aae36145a8faaa P ad11bfd2f76b4a008496a2d703fcf8fe: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:21.994979 29269 log.cc:824] T 0201c6cd25fa4d4aa7aae36145a8faaa P ad11bfd2f76b4a008496a2d703fcf8fe: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:21.997247 29270 tablet_bootstrap.cc:492] T 0201c6cd25fa4d4aa7aae36145a8faaa P d0a20562723a4500bf4dcda28c2baed5: Bootstrap starting.
I20260808 11:31:21.998795 29272 tablet_bootstrap.cc:492] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6: Bootstrap starting.
I20260808 11:31:22.001394 29270 tablet_bootstrap.cc:654] T 0201c6cd25fa4d4aa7aae36145a8faaa P d0a20562723a4500bf4dcda28c2baed5: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:22.001776 29272 tablet_bootstrap.cc:654] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:22.002662 29270 log.cc:824] T 0201c6cd25fa4d4aa7aae36145a8faaa P d0a20562723a4500bf4dcda28c2baed5: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:22.002718 29269 tablet_bootstrap.cc:492] T 0201c6cd25fa4d4aa7aae36145a8faaa P ad11bfd2f76b4a008496a2d703fcf8fe: No bootstrap required, opened a new log
I20260808 11:31:22.002928 29272 log.cc:824] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:22.002979 29269 ts_tablet_manager.cc:1397] T 0201c6cd25fa4d4aa7aae36145a8faaa P ad11bfd2f76b4a008496a2d703fcf8fe: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.007s
I20260808 11:31:22.005827 29270 tablet_bootstrap.cc:492] T 0201c6cd25fa4d4aa7aae36145a8faaa P d0a20562723a4500bf4dcda28c2baed5: No bootstrap required, opened a new log
I20260808 11:31:22.006073 29270 ts_tablet_manager.cc:1397] T 0201c6cd25fa4d4aa7aae36145a8faaa P d0a20562723a4500bf4dcda28c2baed5: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260808 11:31:22.007978 29272 tablet_bootstrap.cc:492] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6: No bootstrap required, opened a new log
I20260808 11:31:22.008380 29272 ts_tablet_manager.cc:1397] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.002s
I20260808 11:31:22.013797 29269 raft_consensus.cc:348] T 0201c6cd25fa4d4aa7aae36145a8faaa P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:22.014220 29269 raft_consensus.cc:374] T 0201c6cd25fa4d4aa7aae36145a8faaa P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:22.014328 29269 raft_consensus.cc:729] T 0201c6cd25fa4d4aa7aae36145a8faaa P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad11bfd2f76b4a008496a2d703fcf8fe, State: Initialized, Role: FOLLOWER
I20260808 11:31:22.014941 29269 consensus_queue.cc:260] T 0201c6cd25fa4d4aa7aae36145a8faaa P ad11bfd2f76b4a008496a2d703fcf8fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:22.015667 29272 raft_consensus.cc:348] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:22.016021 29272 raft_consensus.cc:374] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:22.016165 29272 raft_consensus.cc:729] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a1b69a40fe4199b8ef4e3e5700b6a6, State: Initialized, Role: FOLLOWER
I20260808 11:31:22.016718 29272 consensus_queue.cc:260] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:22.016886 29270 raft_consensus.cc:348] T 0201c6cd25fa4d4aa7aae36145a8faaa P d0a20562723a4500bf4dcda28c2baed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:22.017390 29270 raft_consensus.cc:374] T 0201c6cd25fa4d4aa7aae36145a8faaa P d0a20562723a4500bf4dcda28c2baed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:22.017508 29270 raft_consensus.cc:729] T 0201c6cd25fa4d4aa7aae36145a8faaa P d0a20562723a4500bf4dcda28c2baed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0a20562723a4500bf4dcda28c2baed5, State: Initialized, Role: FOLLOWER
I20260808 11:31:22.018184 29270 consensus_queue.cc:260] T 0201c6cd25fa4d4aa7aae36145a8faaa P d0a20562723a4500bf4dcda28c2baed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:22.021067 29248 heartbeater.cc:503] Master 127.26.66.190:37989 was elected leader, sending a full tablet report...
I20260808 11:31:22.022375 29270 ts_tablet_manager.cc:1428] T 0201c6cd25fa4d4aa7aae36145a8faaa P d0a20562723a4500bf4dcda28c2baed5: Time spent starting tablet: real 0.016s user 0.017s sys 0.000s
I20260808 11:31:22.024111 29269 ts_tablet_manager.cc:1428] T 0201c6cd25fa4d4aa7aae36145a8faaa P ad11bfd2f76b4a008496a2d703fcf8fe: Time spent starting tablet: real 0.021s user 0.013s sys 0.010s
I20260808 11:31:22.024963 29098 heartbeater.cc:503] Master 127.26.66.190:37989 was elected leader, sending a full tablet report...
I20260808 11:31:22.025566 29272 ts_tablet_manager.cc:1428] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6: Time spent starting tablet: real 0.017s user 0.006s sys 0.010s
W20260808 11:31:22.052304 28947 tablet.cc:2369] T 0201c6cd25fa4d4aa7aae36145a8faaa P ad11bfd2f76b4a008496a2d703fcf8fe: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 11:31:22.095764 29099 tablet.cc:2369] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 11:31:22.115837 29249 tablet.cc:2369] T 0201c6cd25fa4d4aa7aae36145a8faaa P d0a20562723a4500bf4dcda28c2baed5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:31:22.178526 29277 raft_consensus.cc:482] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:31:22.178885 29277 raft_consensus.cc:504] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:22.180688 29277 leader_election.cc:288] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad11bfd2f76b4a008496a2d703fcf8fe (127.26.66.129:33407), d0a20562723a4500bf4dcda28c2baed5 (127.26.66.131:43845)
I20260808 11:31:22.188133 29264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:22.181313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:48645 (local address 127.26.66.129:33407)
0808 11:31:22.181526 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:22.181532 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:22.182219 (+ 687us) server_negotiation.cc:407] Connection header received
0808 11:31:22.182597 (+ 378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:22.182602 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:22.182700 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:22.182810 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:31:22.183438 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.184257 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.186278 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.187061 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.187221 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:22.187307 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:22.187700 (+ 393us) server_negotiation.cc:299] Negotiation successful
0808 11:31:22.187844 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 11:31:22.188133 29268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:22.181244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:45017 (local address 127.26.66.131:43845)
0808 11:31:22.181466 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:22.181473 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:22.182464 (+ 991us) server_negotiation.cc:407] Connection header received
0808 11:31:22.182667 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:22.182672 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:22.182751 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:22.182839 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:31:22.183629 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.184463 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.186336 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.187081 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.187278 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:22.187352 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:22.187660 (+ 308us) server_negotiation.cc:299] Negotiation successful
0808 11:31:22.187803 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 11:31:22.188439 29280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:22.181534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:43845 (local address 127.26.66.130:45017)
0808 11:31:22.182339 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:22.182355 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:22.182515 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:22.183015 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:22.183019 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:22.183041 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:31:22.183439 (+ 398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:22.183450 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.184612 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.184615 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:22.186155 (+ 1540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:22.186167 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.187353 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.187359 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:22.187497 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:22.187526 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 11:31:22.187599 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 11:31:22.187743 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":671,"mutex_wait_us":63,"thread_start_us":514,"threads_started":1}
I20260808 11:31:22.188529 29279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:22.181127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:33407 (local address 127.26.66.130:48645)
0808 11:31:22.182073 (+ 946us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:22.182113 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:22.182352 (+ 239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:22.182842 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:22.182846 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:22.182873 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:31:22.183261 (+ 388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:22.183272 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.184412 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.184418 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:22.186125 (+ 1707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:22.186138 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.187305 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.187319 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:22.187519 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:22.187541 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 11:31:22.187655 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 11:31:22.187777 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":755,"mutex_wait_us":98,"thread_start_us":505,"threads_started":1}
I20260808 11:31:22.189615 29197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0201c6cd25fa4d4aa7aae36145a8faaa" candidate_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a20562723a4500bf4dcda28c2baed5" is_pre_election: true
I20260808 11:31:22.189607 28893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0201c6cd25fa4d4aa7aae36145a8faaa" candidate_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" is_pre_election: true
I20260808 11:31:22.190217 28893 raft_consensus.cc:2454] T 0201c6cd25fa4d4aa7aae36145a8faaa P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a1b69a40fe4199b8ef4e3e5700b6a6 in term 0.
I20260808 11:31:22.190217 29197 raft_consensus.cc:2454] T 0201c6cd25fa4d4aa7aae36145a8faaa P d0a20562723a4500bf4dcda28c2baed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a1b69a40fe4199b8ef4e3e5700b6a6 in term 0.
I20260808 11:31:22.190989 28969 leader_election.cc:302] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a1b69a40fe4199b8ef4e3e5700b6a6, d0a20562723a4500bf4dcda28c2baed5; no voters:
I20260808 11:31:22.191399 29277 raft_consensus.cc:2781] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:31:22.191583 29277 raft_consensus.cc:482] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:31:22.191692 29277 raft_consensus.cc:3037] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:22.194047 29277 raft_consensus.cc:504] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:22.194741 29277 leader_election.cc:288] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6 [CANDIDATE]: Term 1 election: Requested vote from peers ad11bfd2f76b4a008496a2d703fcf8fe (127.26.66.129:33407), d0a20562723a4500bf4dcda28c2baed5 (127.26.66.131:43845)
I20260808 11:31:22.195104 28893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0201c6cd25fa4d4aa7aae36145a8faaa" candidate_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe"
I20260808 11:31:22.195235 29197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0201c6cd25fa4d4aa7aae36145a8faaa" candidate_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a20562723a4500bf4dcda28c2baed5"
I20260808 11:31:22.195326 28893 raft_consensus.cc:3037] T 0201c6cd25fa4d4aa7aae36145a8faaa P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:22.195457 29197 raft_consensus.cc:3037] T 0201c6cd25fa4d4aa7aae36145a8faaa P d0a20562723a4500bf4dcda28c2baed5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:22.198663 29197 raft_consensus.cc:2454] T 0201c6cd25fa4d4aa7aae36145a8faaa P d0a20562723a4500bf4dcda28c2baed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a1b69a40fe4199b8ef4e3e5700b6a6 in term 1.
I20260808 11:31:22.198663 28893 raft_consensus.cc:2454] T 0201c6cd25fa4d4aa7aae36145a8faaa P ad11bfd2f76b4a008496a2d703fcf8fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a1b69a40fe4199b8ef4e3e5700b6a6 in term 1.
I20260808 11:31:22.199113 28970 leader_election.cc:302] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 87a1b69a40fe4199b8ef4e3e5700b6a6, ad11bfd2f76b4a008496a2d703fcf8fe, d0a20562723a4500bf4dcda28c2baed5; no voters:
I20260808 11:31:22.199473 29277 raft_consensus.cc:2781] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:31:22.199954 29277 raft_consensus.cc:686] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 1 LEADER]: Becoming Leader. State: Replica: 87a1b69a40fe4199b8ef4e3e5700b6a6, State: Running, Role: LEADER
I20260808 11:31:22.200449 29277 consensus_queue.cc:237] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:22.204891 28726 catalog_manager.cc:5495] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a1b69a40fe4199b8ef4e3e5700b6a6 (127.26.66.130). New cstate: current_term: 1 leader_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } health_report { overall_health: UNKNOWN } } }
Aug 08 11:31:22 dist-test-slave-zkpd krb5kdc[28680](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188680, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:22.292490 28828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:22.278483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45430 (local address 127.26.66.190:37989)
0808 11:31:22.278700 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:22.278708 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:22.279303 (+ 595us) server_negotiation.cc:407] Connection header received
0808 11:31:22.279443 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:22.279447 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:22.279523 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:22.279612 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:22.280906 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.282152 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.283432 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.283854 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.284026 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:22.287182 (+ 3156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:22.287186 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:22.287190 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:22.287217 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:22.289627 (+ 2410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:22.290324 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:22.290331 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:22.290334 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:22.290470 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:22.290925 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:22.290933 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:22.290936 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:22.291237 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:22.291398 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:22.291801 (+ 403us) server_negotiation.cc:299] Negotiation successful
0808 11:31:22.292165 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":173,"server-negotiator.queue_time_us":78}
I20260808 11:31:22.292522 29288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:22.278566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:37989 (local address 127.0.0.1:45430)
0808 11:31:22.279187 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:22.279209 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:22.279337 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:22.279655 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:22.279658 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:22.280452 (+ 794us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:22.280746 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:22.280759 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.282315 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.282321 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:22.283302 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:22.283314 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.284074 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.284079 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:22.284195 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:22.284844 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:22.284861 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:22.287017 (+ 2156us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:22.289743 (+ 2726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:22.289753 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:22.289760 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:22.290191 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:22.290606 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:22.290612 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:22.290618 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:22.290813 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:22.291384 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:22.291392 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:22.291551 (+ 159us) client_negotiation.cc:769] Sending connection context
0808 11:31:22.291717 (+ 166us) client_negotiation.cc:240] Negotiation successful
0808 11:31:22.292038 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":365,"threads_started":1}
I20260808 11:31:22.297577 28726 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:45430:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 11:31:22.298588 28726 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:31:22.305568 28872 tablet_service.cc:1467] Processing CreateTablet for tablet 76979fe1288646f4aebdbceddd551d18 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=62c9237297db48e4979b838448845924]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 11:31:22.305574 29021 tablet_service.cc:1467] Processing CreateTablet for tablet 76979fe1288646f4aebdbceddd551d18 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=62c9237297db48e4979b838448845924]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 11:31:22.306571 28872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76979fe1288646f4aebdbceddd551d18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:22.306567 29021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76979fe1288646f4aebdbceddd551d18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:22.312695 29173 tablet_service.cc:1467] Processing CreateTablet for tablet 76979fe1288646f4aebdbceddd551d18 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=62c9237297db48e4979b838448845924]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 11:31:22.313467 29173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76979fe1288646f4aebdbceddd551d18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:22.314033 29269 tablet_bootstrap.cc:492] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe: Bootstrap starting.
I20260808 11:31:22.315464 29269 tablet_bootstrap.cc:654] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:22.316758 29272 tablet_bootstrap.cc:492] T 76979fe1288646f4aebdbceddd551d18 P 87a1b69a40fe4199b8ef4e3e5700b6a6: Bootstrap starting.
I20260808 11:31:22.317945 29269 tablet_bootstrap.cc:492] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe: No bootstrap required, opened a new log
I20260808 11:31:22.318104 29269 ts_tablet_manager.cc:1397] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20260808 11:31:22.318308 29272 tablet_bootstrap.cc:654] T 76979fe1288646f4aebdbceddd551d18 P 87a1b69a40fe4199b8ef4e3e5700b6a6: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:22.318971 29269 raft_consensus.cc:348] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:22.319247 29269 raft_consensus.cc:374] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:22.319356 29269 raft_consensus.cc:729] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad11bfd2f76b4a008496a2d703fcf8fe, State: Initialized, Role: FOLLOWER
I20260808 11:31:22.319602 29269 consensus_queue.cc:260] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:22.319952 29270 tablet_bootstrap.cc:492] T 76979fe1288646f4aebdbceddd551d18 P d0a20562723a4500bf4dcda28c2baed5: Bootstrap starting.
I20260808 11:31:22.320269 29269 ts_tablet_manager.cc:1428] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 11:31:22.320176 29276 tablet_replica.cc:439] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } } }
I20260808 11:31:22.320604 29276 tablet_replica.cc:442] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 11:31:22.321698 29270 tablet_bootstrap.cc:654] T 76979fe1288646f4aebdbceddd551d18 P d0a20562723a4500bf4dcda28c2baed5: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:22.321985 29272 tablet_bootstrap.cc:492] T 76979fe1288646f4aebdbceddd551d18 P 87a1b69a40fe4199b8ef4e3e5700b6a6: No bootstrap required, opened a new log
I20260808 11:31:22.322151 29272 ts_tablet_manager.cc:1397] T 76979fe1288646f4aebdbceddd551d18 P 87a1b69a40fe4199b8ef4e3e5700b6a6: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20260808 11:31:22.322981 29272 raft_consensus.cc:348] T 76979fe1288646f4aebdbceddd551d18 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:22.323246 29272 raft_consensus.cc:374] T 76979fe1288646f4aebdbceddd551d18 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:22.323362 29272 raft_consensus.cc:729] T 76979fe1288646f4aebdbceddd551d18 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a1b69a40fe4199b8ef4e3e5700b6a6, State: Initialized, Role: FOLLOWER
I20260808 11:31:22.323607 29272 consensus_queue.cc:260] T 76979fe1288646f4aebdbceddd551d18 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:22.324190 29270 tablet_bootstrap.cc:492] T 76979fe1288646f4aebdbceddd551d18 P d0a20562723a4500bf4dcda28c2baed5: No bootstrap required, opened a new log
I20260808 11:31:22.324208 29272 ts_tablet_manager.cc:1428] T 76979fe1288646f4aebdbceddd551d18 P 87a1b69a40fe4199b8ef4e3e5700b6a6: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 11:31:22.324097 29277 tablet_replica.cc:439] T 76979fe1288646f4aebdbceddd551d18 P 87a1b69a40fe4199b8ef4e3e5700b6a6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } } }
I20260808 11:31:22.324340 29270 ts_tablet_manager.cc:1397] T 76979fe1288646f4aebdbceddd551d18 P d0a20562723a4500bf4dcda28c2baed5: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20260808 11:31:22.324399 29277 tablet_replica.cc:442] T 76979fe1288646f4aebdbceddd551d18 P 87a1b69a40fe4199b8ef4e3e5700b6a6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 11:31:22.324961 29270 raft_consensus.cc:348] T 76979fe1288646f4aebdbceddd551d18 P d0a20562723a4500bf4dcda28c2baed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:22.325145 29270 raft_consensus.cc:374] T 76979fe1288646f4aebdbceddd551d18 P d0a20562723a4500bf4dcda28c2baed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:22.325212 29270 raft_consensus.cc:729] T 76979fe1288646f4aebdbceddd551d18 P d0a20562723a4500bf4dcda28c2baed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0a20562723a4500bf4dcda28c2baed5, State: Initialized, Role: FOLLOWER
I20260808 11:31:22.325428 29270 consensus_queue.cc:260] T 76979fe1288646f4aebdbceddd551d18 P d0a20562723a4500bf4dcda28c2baed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:22.325903 29278 tablet_replica.cc:439] T 76979fe1288646f4aebdbceddd551d18 P d0a20562723a4500bf4dcda28c2baed5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } } }
I20260808 11:31:22.326447 29278 tablet_replica.cc:442] T 76979fe1288646f4aebdbceddd551d18 P d0a20562723a4500bf4dcda28c2baed5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 11:31:22.326963 29270 ts_tablet_manager.cc:1428] T 76979fe1288646f4aebdbceddd551d18 P d0a20562723a4500bf4dcda28c2baed5: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 11:31:22.499471 29276 raft_consensus.cc:482] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:31:22.499725 29276 raft_consensus.cc:504] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:22.501312 29276 leader_election.cc:288] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a1b69a40fe4199b8ef4e3e5700b6a6 (127.26.66.130:34005), d0a20562723a4500bf4dcda28c2baed5 (127.26.66.131:43845)
I20260808 11:31:22.507869 29294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:22.501596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:57985 (local address 127.26.66.130:34005)
0808 11:31:22.502373 (+ 777us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:22.502379 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:22.502397 (+ 18us) server_negotiation.cc:407] Connection header received
0808 11:31:22.502483 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:22.502490 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:22.502564 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:22.502670 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:31:22.503395 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.504327 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.506077 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.506884 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.507081 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:22.507156 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:22.507425 (+ 269us) server_negotiation.cc:299] Negotiation successful
0808 11:31:22.507558 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":638,"thread_start_us":503,"threads_started":1}
I20260808 11:31:22.508231 29293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:22.501521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:34005 (local address 127.26.66.129:57985)
0808 11:31:22.502021 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:22.502044 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:22.502240 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:22.502707 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:22.502711 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:22.502740 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:31:22.503225 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:22.503241 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.504455 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.504462 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:22.505916 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:22.505927 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.507104 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.507110 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:22.507265 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:22.507296 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 11:31:22.507399 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 11:31:22.507537 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"spinlock_wait_cycles":51072,"thread_start_us":275,"threads_started":1}
I20260808 11:31:22.508347 29268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:22.501914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:58277 (local address 127.26.66.131:43845)
0808 11:31:22.502139 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:22.502145 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:22.502864 (+ 719us) server_negotiation.cc:407] Connection header received
0808 11:31:22.503107 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:22.503111 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:22.503170 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:22.503266 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:31:22.503802 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.504714 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.506459 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.507354 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.507534 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:22.507609 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:22.507947 (+ 338us) server_negotiation.cc:299] Negotiation successful
0808 11:31:22.508076 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 11:31:22.508741 29295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:22.501608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:43845 (local address 127.26.66.129:58277)
0808 11:31:22.502712 (+ 1104us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:22.502726 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:22.502938 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:22.503287 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:22.503291 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:22.503314 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:31:22.503633 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:22.503641 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.504867 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.504873 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:22.506301 (+ 1428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:22.506313 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.507576 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.507583 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:22.507737 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:22.507760 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 11:31:22.507906 (+ 146us) client_negotiation.cc:240] Negotiation successful
0808 11:31:22.508117 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":986,"thread_start_us":767,"threads_started":1}
I20260808 11:31:22.509116 29049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76979fe1288646f4aebdbceddd551d18" candidate_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" is_pre_election: true
I20260808 11:31:22.509361 29197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76979fe1288646f4aebdbceddd551d18" candidate_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a20562723a4500bf4dcda28c2baed5" is_pre_election: true
I20260808 11:31:22.509552 29049 raft_consensus.cc:2454] T 76979fe1288646f4aebdbceddd551d18 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad11bfd2f76b4a008496a2d703fcf8fe in term 0.
I20260808 11:31:22.509666 29197 raft_consensus.cc:2454] T 76979fe1288646f4aebdbceddd551d18 P d0a20562723a4500bf4dcda28c2baed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad11bfd2f76b4a008496a2d703fcf8fe in term 0.
I20260808 11:31:22.510104 28821 leader_election.cc:302] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a1b69a40fe4199b8ef4e3e5700b6a6, ad11bfd2f76b4a008496a2d703fcf8fe; no voters:
I20260808 11:31:22.510540 29276 raft_consensus.cc:2781] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:31:22.510659 29276 raft_consensus.cc:482] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:31:22.510726 29276 raft_consensus.cc:3037] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:22.512979 29276 raft_consensus.cc:504] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:22.513744 29276 leader_election.cc:288] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe [CANDIDATE]: Term 1 election: Requested vote from peers 87a1b69a40fe4199b8ef4e3e5700b6a6 (127.26.66.130:34005), d0a20562723a4500bf4dcda28c2baed5 (127.26.66.131:43845)
I20260808 11:31:22.514142 29049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76979fe1288646f4aebdbceddd551d18" candidate_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6"
I20260808 11:31:22.514205 29197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76979fe1288646f4aebdbceddd551d18" candidate_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a20562723a4500bf4dcda28c2baed5"
I20260808 11:31:22.514336 29049 raft_consensus.cc:3037] T 76979fe1288646f4aebdbceddd551d18 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:22.514430 29197 raft_consensus.cc:3037] T 76979fe1288646f4aebdbceddd551d18 P d0a20562723a4500bf4dcda28c2baed5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:22.516522 29197 raft_consensus.cc:2454] T 76979fe1288646f4aebdbceddd551d18 P d0a20562723a4500bf4dcda28c2baed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad11bfd2f76b4a008496a2d703fcf8fe in term 1.
I20260808 11:31:22.516537 29049 raft_consensus.cc:2454] T 76979fe1288646f4aebdbceddd551d18 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad11bfd2f76b4a008496a2d703fcf8fe in term 1.
I20260808 11:31:22.516919 28822 leader_election.cc:302] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad11bfd2f76b4a008496a2d703fcf8fe, d0a20562723a4500bf4dcda28c2baed5; no voters:
I20260808 11:31:22.517230 29276 raft_consensus.cc:2781] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:31:22.517601 29276 raft_consensus.cc:686] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe [term 1 LEADER]: Becoming Leader. State: Replica: ad11bfd2f76b4a008496a2d703fcf8fe, State: Running, Role: LEADER
I20260808 11:31:22.518180 29276 consensus_queue.cc:237] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:22.521581 29296 tablet_replica.cc:439] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe: TxnStatusTablet state changed. Reason: New leader ad11bfd2f76b4a008496a2d703fcf8fe. Latest consensus state: current_term: 1 leader_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } } }
I20260808 11:31:22.521999 29296 tablet_replica.cc:442] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe: This TxnStatusTablet replica's current role is: LEADER
I20260808 11:31:22.522791 29298 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 11:31:22.523092 29298 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 11:31:22.523345 28726 catalog_manager.cc:5495] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe reported cstate change: term changed from 0 to 1, leader changed from <none> to ad11bfd2f76b4a008496a2d703fcf8fe (127.26.66.129). New cstate: current_term: 1 leader_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } health_report { overall_health: UNKNOWN } } }
I20260808 11:31:22.556509 29264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:22.549911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36322 (local address 127.26.66.129:33407)
0808 11:31:22.550102 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:22.550107 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:22.550204 (+ 97us) server_negotiation.cc:407] Connection header received
0808 11:31:22.550478 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:22.550482 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:22.550582 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:22.550713 (+ 131us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:31:22.551189 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.552050 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.554042 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.554635 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.554730 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:22.555325 (+ 595us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:31:22.555929 (+ 604us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:31:22.556047 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:22.556186 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 11:31:22.556251 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 11:31:22.556627 29288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:22.549849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:33407 (local address 127.0.0.1:36322)
0808 11:31:22.550108 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:22.550130 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:22.550284 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:22.550771 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:22.550777 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:22.550824 (+ 47us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 11:31:22.551043 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:22.551055 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.552177 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.552183 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:22.553883 (+ 1700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:22.553898 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.554801 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.554808 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:22.555007 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:22.555082 (+ 75us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 11:31:22.556042 (+ 960us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 11:31:22.556065 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 11:31:22.556158 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 11:31:22.556327 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260808 11:31:22.564895 29049 raft_consensus.cc:1261] T 76979fe1288646f4aebdbceddd551d18 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 1 FOLLOWER]: Refusing update from remote peer ad11bfd2f76b4a008496a2d703fcf8fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:31:22.564918 29197 raft_consensus.cc:1261] T 76979fe1288646f4aebdbceddd551d18 P d0a20562723a4500bf4dcda28c2baed5 [term 1 FOLLOWER]: Refusing update from remote peer ad11bfd2f76b4a008496a2d703fcf8fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:31:22.565835 29276 consensus_queue.cc:1035] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:31:22.566161 29296 consensus_queue.cc:1035] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:31:22.575035 29277 tablet_replica.cc:439] T 76979fe1288646f4aebdbceddd551d18 P 87a1b69a40fe4199b8ef4e3e5700b6a6: TxnStatusTablet state changed. Reason: New leader ad11bfd2f76b4a008496a2d703fcf8fe. Latest consensus state: current_term: 1 leader_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } } }
I20260808 11:31:22.575556 29277 tablet_replica.cc:442] T 76979fe1288646f4aebdbceddd551d18 P 87a1b69a40fe4199b8ef4e3e5700b6a6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 11:31:22.575704 29278 tablet_replica.cc:439] T 76979fe1288646f4aebdbceddd551d18 P d0a20562723a4500bf4dcda28c2baed5: TxnStatusTablet state changed. Reason: New leader ad11bfd2f76b4a008496a2d703fcf8fe. Latest consensus state: current_term: 1 leader_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } } }
I20260808 11:31:22.576009 29278 tablet_replica.cc:442] T 76979fe1288646f4aebdbceddd551d18 P d0a20562723a4500bf4dcda28c2baed5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 11:31:22.578414 29302 mvcc.cc:205] Tried to move back new op lower bound from 7316228843775639552 to 7316228843597844480. Current Snapshot: MvccSnapshot[applied={T|T < 7316228843775639552}]
I20260808 11:31:22.579324 29301 mvcc.cc:205] Tried to move back new op lower bound from 7316228843775639552 to 7316228843597844480. Current Snapshot: MvccSnapshot[applied={T|T < 7316228843775639552}]
I20260808 11:31:22.580790 29277 tablet_replica.cc:439] T 76979fe1288646f4aebdbceddd551d18 P 87a1b69a40fe4199b8ef4e3e5700b6a6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } } }
I20260808 11:31:22.581171 29277 tablet_replica.cc:442] T 76979fe1288646f4aebdbceddd551d18 P 87a1b69a40fe4199b8ef4e3e5700b6a6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 11:31:22.582592 29276 tablet_replica.cc:439] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } } }
I20260808 11:31:22.582952 29276 tablet_replica.cc:442] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe: This TxnStatusTablet replica's current role is: LEADER
I20260808 11:31:22.585173 29276 tablet_replica.cc:439] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } } }
I20260808 11:31:22.585479 29276 tablet_replica.cc:442] T 76979fe1288646f4aebdbceddd551d18 P ad11bfd2f76b4a008496a2d703fcf8fe: This TxnStatusTablet replica's current role is: LEADER
I20260808 11:31:22.586539 29303 mvcc.cc:205] Tried to move back new op lower bound from 7316228843775639552 to 7316228843597844480. Current Snapshot: MvccSnapshot[applied={T|T < 7316228843775639552}]
I20260808 11:31:22.589254 29278 tablet_replica.cc:439] T 76979fe1288646f4aebdbceddd551d18 P d0a20562723a4500bf4dcda28c2baed5: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } } }
I20260808 11:31:22.589512 29278 tablet_replica.cc:442] T 76979fe1288646f4aebdbceddd551d18 P d0a20562723a4500bf4dcda28c2baed5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 11:31:22.599536 29294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:22.593445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57166 (local address 127.26.66.130:34005)
0808 11:31:22.593622 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:22.593628 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:22.594073 (+ 445us) server_negotiation.cc:407] Connection header received
0808 11:31:22.594254 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:22.594259 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:22.594375 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:22.594535 (+ 160us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:31:22.594925 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.596094 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.597481 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.597888 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.598024 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:22.598450 (+ 426us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:31:22.598933 (+ 483us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:31:22.599090 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:22.599191 (+ 101us) server_negotiation.cc:299] Negotiation successful
0808 11:31:22.599275 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 11:31:22.616730 29314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:22.610425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:33407 (local address 127.26.66.130:59039)
0808 11:31:22.611127 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:22.611157 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:22.611267 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:22.611620 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:22.611623 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:22.611632 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 11:31:22.611983 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:22.611994 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.613499 (+ 1505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.613503 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:22.614587 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:22.614598 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.615630 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.615635 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:22.615743 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:22.615790 (+ 47us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 11:31:22.616256 (+ 466us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 11:31:22.616273 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 11:31:22.616347 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 11:31:22.616446 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":399,"threads_started":1}
I20260808 11:31:22.616780 29264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:22.610410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:59039 (local address 127.26.66.129:33407)
0808 11:31:22.610598 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:22.610604 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:22.611240 (+ 636us) server_negotiation.cc:407] Connection header received
0808 11:31:22.611401 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:22.611409 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:22.611506 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:22.611601 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:31:22.612192 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.613372 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.614723 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.615457 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.615585 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:22.616006 (+ 421us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:31:22.616147 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:31:22.616249 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:22.616399 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 11:31:22.616479 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 11:31:22.627528 29197 raft_consensus.cc:1261] T 0201c6cd25fa4d4aa7aae36145a8faaa P d0a20562723a4500bf4dcda28c2baed5 [term 1 FOLLOWER]: Refusing update from remote peer 87a1b69a40fe4199b8ef4e3e5700b6a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:31:22.628079 28893 raft_consensus.cc:1261] T 0201c6cd25fa4d4aa7aae36145a8faaa P ad11bfd2f76b4a008496a2d703fcf8fe [term 1 FOLLOWER]: Refusing update from remote peer 87a1b69a40fe4199b8ef4e3e5700b6a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:31:22.628249 29281 consensus_queue.cc:1035] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:31:22.628890 29277 consensus_queue.cc:1035] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:31:22.667760 29320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:22.660969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:34005 (local address 127.26.66.129:56611)
0808 11:31:22.661749 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:22.661770 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:22.661992 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:22.662403 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:22.662408 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:22.662422 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 11:31:22.662824 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:22.662846 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.663926 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.663935 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:22.665523 (+ 1588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:22.665535 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.666495 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.666499 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:22.666683 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:22.666757 (+ 74us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 11:31:22.667240 (+ 483us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 11:31:22.667253 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 11:31:22.667329 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 11:31:22.667441 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":395,"threads_started":1}
I20260808 11:31:22.667754 29294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:22.660870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:56611 (local address 127.26.66.130:34005)
0808 11:31:22.661046 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:22.661053 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:22.661866 (+ 813us) server_negotiation.cc:407] Connection header received
0808 11:31:22.662151 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:22.662158 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:22.662267 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:22.662375 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:31:22.663003 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.663763 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.665675 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.666317 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.666445 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:22.667000 (+ 555us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:31:22.667137 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:31:22.667231 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:22.667367 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 11:31:22.667453 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 11:31:22.708804 28726 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45422:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:31:22.709095 28726 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45422:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:31:22.713409 28726 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 57a5ece6fd4547c3a36eeb103b903be7: Sending DeleteTablet for 3 replicas of tablet 0201c6cd25fa4d4aa7aae36145a8faaa
I20260808 11:31:22.714542 28872 tablet_service.cc:1514] Processing DeleteTablet for tablet 0201c6cd25fa4d4aa7aae36145a8faaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:31:22 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:36308
I20260808 11:31:22.714910 29173 tablet_service.cc:1514] Processing DeleteTablet for tablet 0201c6cd25fa4d4aa7aae36145a8faaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:31:22 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:39150
I20260808 11:31:22.715626 29021 tablet_service.cc:1514] Processing DeleteTablet for tablet 0201c6cd25fa4d4aa7aae36145a8faaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:31:22 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:57152
I20260808 11:31:22.717154 28727 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45422:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 11:31:22.718052 28727 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:31:22.726300 28871 tablet_service.cc:1467] Processing CreateTablet for tablet 8195907915104776b8b1b8c0281f0acf (DEFAULT_TABLE table=test-table [id=eb4118362c384304be5a70b860f50f92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:31:22.726948 28871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8195907915104776b8b1b8c0281f0acf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:22.728794 29172 tablet_service.cc:1467] Processing CreateTablet for tablet 8195907915104776b8b1b8c0281f0acf (DEFAULT_TABLE table=test-table [id=eb4118362c384304be5a70b860f50f92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:31:22.729334 29172 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8195907915104776b8b1b8c0281f0acf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:22.740653 29020 tablet_service.cc:1467] Processing CreateTablet for tablet 8195907915104776b8b1b8c0281f0acf (DEFAULT_TABLE table=test-table [id=eb4118362c384304be5a70b860f50f92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:31:22.741087 29323 tablet_replica.cc:330] T 0201c6cd25fa4d4aa7aae36145a8faaa P ad11bfd2f76b4a008496a2d703fcf8fe: stopping tablet replica
I20260808 11:31:22.741436 29020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8195907915104776b8b1b8c0281f0acf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:22.748073 29270 tablet_bootstrap.cc:492] T 8195907915104776b8b1b8c0281f0acf P d0a20562723a4500bf4dcda28c2baed5: Bootstrap starting.
I20260808 11:31:22.748209 29272 tablet_bootstrap.cc:492] T 8195907915104776b8b1b8c0281f0acf P 87a1b69a40fe4199b8ef4e3e5700b6a6: Bootstrap starting.
I20260808 11:31:22.750033 29270 tablet_bootstrap.cc:654] T 8195907915104776b8b1b8c0281f0acf P d0a20562723a4500bf4dcda28c2baed5: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:22.753971 29325 tablet_replica.cc:330] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6: stopping tablet replica
I20260808 11:31:22.753997 29272 tablet_bootstrap.cc:654] T 8195907915104776b8b1b8c0281f0acf P 87a1b69a40fe4199b8ef4e3e5700b6a6: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:22.754709 29269 tablet_bootstrap.cc:492] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe: Bootstrap starting.
I20260808 11:31:22.754783 29323 raft_consensus.cc:2229] T 0201c6cd25fa4d4aa7aae36145a8faaa P ad11bfd2f76b4a008496a2d703fcf8fe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:31:22.755264 29325 raft_consensus.cc:2229] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 1 LEADER]: Raft consensus shutting down.
I20260808 11:31:22.755847 29323 raft_consensus.cc:2258] T 0201c6cd25fa4d4aa7aae36145a8faaa P ad11bfd2f76b4a008496a2d703fcf8fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:31:22.756932 29325 raft_consensus.cc:2258] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:31:22.757086 29269 tablet_bootstrap.cc:654] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:22.759057 29325 ts_tablet_manager.cc:1905] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:31:22.760128 29323 ts_tablet_manager.cc:1905] T 0201c6cd25fa4d4aa7aae36145a8faaa P ad11bfd2f76b4a008496a2d703fcf8fe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:31:22.771570 29323 ts_tablet_manager.cc:1918] T 0201c6cd25fa4d4aa7aae36145a8faaa P ad11bfd2f76b4a008496a2d703fcf8fe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 11:31:22.773124 29323 log.cc:1196] T 0201c6cd25fa4d4aa7aae36145a8faaa P ad11bfd2f76b4a008496a2d703fcf8fe: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-0/wal/wals/0201c6cd25fa4d4aa7aae36145a8faaa
I20260808 11:31:22.773914 29323 ts_tablet_manager.cc:1939] T 0201c6cd25fa4d4aa7aae36145a8faaa P ad11bfd2f76b4a008496a2d703fcf8fe: Deleting consensus metadata
I20260808 11:31:22.775602 29269 tablet_bootstrap.cc:492] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe: No bootstrap required, opened a new log
I20260808 11:31:22.775781 29269 ts_tablet_manager.cc:1397] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.007s
I20260808 11:31:22.776134 28713 catalog_manager.cc:4841] TS ad11bfd2f76b4a008496a2d703fcf8fe (127.26.66.129:33407): tablet 0201c6cd25fa4d4aa7aae36145a8faaa (table test-table [id=beb6380d1d6e4b1391142d3f7252d4bf]) successfully deleted
I20260808 11:31:22.776346 29325 ts_tablet_manager.cc:1918] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 11:31:22.776503 29325 log.cc:1196] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-1/wal/wals/0201c6cd25fa4d4aa7aae36145a8faaa
I20260808 11:31:22.776690 29269 raft_consensus.cc:348] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:22.776958 29269 raft_consensus.cc:374] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:22.777051 29325 ts_tablet_manager.cc:1939] T 0201c6cd25fa4d4aa7aae36145a8faaa P 87a1b69a40fe4199b8ef4e3e5700b6a6: Deleting consensus metadata
I20260808 11:31:22.777076 29269 raft_consensus.cc:729] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad11bfd2f76b4a008496a2d703fcf8fe, State: Initialized, Role: FOLLOWER
I20260808 11:31:22.777346 29269 consensus_queue.cc:260] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:22.777974 29269 ts_tablet_manager.cc:1428] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260808 11:31:22.780220 28711 catalog_manager.cc:4841] TS 87a1b69a40fe4199b8ef4e3e5700b6a6 (127.26.66.130:34005): tablet 0201c6cd25fa4d4aa7aae36145a8faaa (table test-table [id=beb6380d1d6e4b1391142d3f7252d4bf]) successfully deleted
I20260808 11:31:22.780507 29270 tablet_bootstrap.cc:492] T 8195907915104776b8b1b8c0281f0acf P d0a20562723a4500bf4dcda28c2baed5: No bootstrap required, opened a new log
I20260808 11:31:22.780682 29270 ts_tablet_manager.cc:1397] T 8195907915104776b8b1b8c0281f0acf P d0a20562723a4500bf4dcda28c2baed5: Time spent bootstrapping tablet: real 0.033s user 0.012s sys 0.000s
I20260808 11:31:22.781531 29270 raft_consensus.cc:348] T 8195907915104776b8b1b8c0281f0acf P d0a20562723a4500bf4dcda28c2baed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:22.781790 29270 raft_consensus.cc:374] T 8195907915104776b8b1b8c0281f0acf P d0a20562723a4500bf4dcda28c2baed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:22.781889 29270 raft_consensus.cc:729] T 8195907915104776b8b1b8c0281f0acf P d0a20562723a4500bf4dcda28c2baed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0a20562723a4500bf4dcda28c2baed5, State: Initialized, Role: FOLLOWER
I20260808 11:31:22.782203 29270 consensus_queue.cc:260] T 8195907915104776b8b1b8c0281f0acf P d0a20562723a4500bf4dcda28c2baed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:22.783571 29270 ts_tablet_manager.cc:1428] T 8195907915104776b8b1b8c0281f0acf P d0a20562723a4500bf4dcda28c2baed5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 11:31:22.784598 29324 tablet_replica.cc:330] T 0201c6cd25fa4d4aa7aae36145a8faaa P d0a20562723a4500bf4dcda28c2baed5: stopping tablet replica
I20260808 11:31:22.785063 29324 raft_consensus.cc:2229] T 0201c6cd25fa4d4aa7aae36145a8faaa P d0a20562723a4500bf4dcda28c2baed5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:31:22.785342 29272 tablet_bootstrap.cc:492] T 8195907915104776b8b1b8c0281f0acf P 87a1b69a40fe4199b8ef4e3e5700b6a6: No bootstrap required, opened a new log
I20260808 11:31:22.785439 29324 raft_consensus.cc:2258] T 0201c6cd25fa4d4aa7aae36145a8faaa P d0a20562723a4500bf4dcda28c2baed5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:31:22.785511 29272 ts_tablet_manager.cc:1397] T 8195907915104776b8b1b8c0281f0acf P 87a1b69a40fe4199b8ef4e3e5700b6a6: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.014s
I20260808 11:31:22.786586 29272 raft_consensus.cc:348] T 8195907915104776b8b1b8c0281f0acf P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:22.786829 29272 raft_consensus.cc:374] T 8195907915104776b8b1b8c0281f0acf P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:22.786933 29272 raft_consensus.cc:729] T 8195907915104776b8b1b8c0281f0acf P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a1b69a40fe4199b8ef4e3e5700b6a6, State: Initialized, Role: FOLLOWER
I20260808 11:31:22.787171 29272 consensus_queue.cc:260] T 8195907915104776b8b1b8c0281f0acf P 87a1b69a40fe4199b8ef4e3e5700b6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:22.787870 29324 ts_tablet_manager.cc:1905] T 0201c6cd25fa4d4aa7aae36145a8faaa P d0a20562723a4500bf4dcda28c2baed5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:31:22.789865 29272 ts_tablet_manager.cc:1428] T 8195907915104776b8b1b8c0281f0acf P 87a1b69a40fe4199b8ef4e3e5700b6a6: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260808 11:31:22.795476 29324 ts_tablet_manager.cc:1918] T 0201c6cd25fa4d4aa7aae36145a8faaa P d0a20562723a4500bf4dcda28c2baed5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 11:31:22.795650 29324 log.cc:1196] T 0201c6cd25fa4d4aa7aae36145a8faaa P d0a20562723a4500bf4dcda28c2baed5: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-2/wal/wals/0201c6cd25fa4d4aa7aae36145a8faaa
I20260808 11:31:22.796217 29324 ts_tablet_manager.cc:1939] T 0201c6cd25fa4d4aa7aae36145a8faaa P d0a20562723a4500bf4dcda28c2baed5: Deleting consensus metadata
I20260808 11:31:22.797917 28712 catalog_manager.cc:4841] TS d0a20562723a4500bf4dcda28c2baed5 (127.26.66.131:43845): tablet 0201c6cd25fa4d4aa7aae36145a8faaa (table test-table [id=beb6380d1d6e4b1391142d3f7252d4bf]) successfully deleted
I20260808 11:31:22.805557 29308 raft_consensus.cc:482] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:31:22.805761 29308 raft_consensus.cc:504] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:22.806550 29308 leader_election.cc:288] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a1b69a40fe4199b8ef4e3e5700b6a6 (127.26.66.130:34005), d0a20562723a4500bf4dcda28c2baed5 (127.26.66.131:43845)
I20260808 11:31:22.807281 29049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8195907915104776b8b1b8c0281f0acf" candidate_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" is_pre_election: true
I20260808 11:31:22.807529 29049 raft_consensus.cc:2454] T 8195907915104776b8b1b8c0281f0acf P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad11bfd2f76b4a008496a2d703fcf8fe in term 0.
I20260808 11:31:22.808218 29197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8195907915104776b8b1b8c0281f0acf" candidate_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a20562723a4500bf4dcda28c2baed5" is_pre_election: true
I20260808 11:31:22.808432 29197 raft_consensus.cc:2454] T 8195907915104776b8b1b8c0281f0acf P d0a20562723a4500bf4dcda28c2baed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad11bfd2f76b4a008496a2d703fcf8fe in term 0.
I20260808 11:31:22.808960 28821 leader_election.cc:302] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a1b69a40fe4199b8ef4e3e5700b6a6, ad11bfd2f76b4a008496a2d703fcf8fe; no voters:
I20260808 11:31:22.809453 29308 raft_consensus.cc:2781] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:31:22.809589 29308 raft_consensus.cc:482] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:31:22.809675 29308 raft_consensus.cc:3037] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:22.813346 29308 raft_consensus.cc:504] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:22.814419 29049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8195907915104776b8b1b8c0281f0acf" candidate_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6"
I20260808 11:31:22.814635 29049 raft_consensus.cc:3037] T 8195907915104776b8b1b8c0281f0acf P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:22.817957 29049 raft_consensus.cc:2454] T 8195907915104776b8b1b8c0281f0acf P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad11bfd2f76b4a008496a2d703fcf8fe in term 1.
I20260808 11:31:22.818594 28821 leader_election.cc:302] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a1b69a40fe4199b8ef4e3e5700b6a6, ad11bfd2f76b4a008496a2d703fcf8fe; no voters:
I20260808 11:31:22.818917 29296 raft_consensus.cc:2781] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:31:22.819078 29296 raft_consensus.cc:686] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe [term 1 LEADER]: Becoming Leader. State: Replica: ad11bfd2f76b4a008496a2d703fcf8fe, State: Running, Role: LEADER
I20260808 11:31:22.819368 29296 consensus_queue.cc:237] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:22.822809 29197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8195907915104776b8b1b8c0281f0acf" candidate_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a20562723a4500bf4dcda28c2baed5"
I20260808 11:31:22.823035 29197 raft_consensus.cc:3037] T 8195907915104776b8b1b8c0281f0acf P d0a20562723a4500bf4dcda28c2baed5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:22.826505 29197 raft_consensus.cc:2454] T 8195907915104776b8b1b8c0281f0acf P d0a20562723a4500bf4dcda28c2baed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad11bfd2f76b4a008496a2d703fcf8fe in term 1.
I20260808 11:31:22.827518 29308 leader_election.cc:288] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe [CANDIDATE]: Term 1 election: Requested vote from peers 87a1b69a40fe4199b8ef4e3e5700b6a6 (127.26.66.130:34005), d0a20562723a4500bf4dcda28c2baed5 (127.26.66.131:43845)
I20260808 11:31:22.829381 28726 catalog_manager.cc:5495] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe reported cstate change: term changed from 0 to 1, leader changed from <none> to ad11bfd2f76b4a008496a2d703fcf8fe (127.26.66.129). New cstate: current_term: 1 leader_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } health_report { overall_health: UNKNOWN } } }
I20260808 11:31:22.870770 29264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:22.862824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36324 (local address 127.26.66.129:33407)
0808 11:31:22.863026 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:22.863032 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:22.863051 (+ 19us) server_negotiation.cc:407] Connection header received
0808 11:31:22.863115 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:22.863120 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:22.863200 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:22.863302 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:31:22.863775 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.864994 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.868139 (+ 3145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.868835 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.868969 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:22.869612 (+ 643us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:31:22.869788 (+ 176us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:31:22.869874 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:22.870360 (+ 486us) server_negotiation.cc:299] Negotiation successful
0808 11:31:22.870443 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 11:31:22.900449 29320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:22.893306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:33407 (local address 127.26.66.129:45639)
0808 11:31:22.893537 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:22.893562 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:22.893692 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:22.894568 (+ 876us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:22.894573 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:22.894585 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 11:31:22.894782 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:22.894802 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.896454 (+ 1652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.896460 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:22.898122 (+ 1662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:22.898137 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.899211 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.899217 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:22.899416 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:22.899483 (+ 67us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 11:31:22.899908 (+ 425us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 11:31:22.899917 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 11:31:22.899988 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 11:31:22.900126 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260808 11:31:22.901058 29264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:22.893915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:45639 (local address 127.26.66.129:33407)
0808 11:31:22.894118 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:22.894125 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:22.894143 (+ 18us) server_negotiation.cc:407] Connection header received
0808 11:31:22.894210 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:22.894218 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:22.894301 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:22.894398 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:31:22.895014 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.896262 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.898283 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:22.898978 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:22.899100 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:22.899634 (+ 534us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:31:22.899768 (+ 134us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:31:22.899856 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:22.900728 (+ 872us) server_negotiation.cc:299] Negotiation successful
0808 11:31:22.900810 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 11:31:22.912276 29049 raft_consensus.cc:1261] T 8195907915104776b8b1b8c0281f0acf P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 1 FOLLOWER]: Refusing update from remote peer ad11bfd2f76b4a008496a2d703fcf8fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:31:22.912274 29197 raft_consensus.cc:1261] T 8195907915104776b8b1b8c0281f0acf P d0a20562723a4500bf4dcda28c2baed5 [term 1 FOLLOWER]: Refusing update from remote peer ad11bfd2f76b4a008496a2d703fcf8fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:31:22.913153 29308 consensus_queue.cc:1035] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:31:22.913713 29296 consensus_queue.cc:1035] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 11:31:22.956099 29301 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 11:31:24.595965 28726 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45422:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:31:24.596225 28726 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45422:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:31:24.600579 28726 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 57a5ece6fd4547c3a36eeb103b903be7: Sending DeleteTablet for 3 replicas of tablet 8195907915104776b8b1b8c0281f0acf
I20260808 11:31:24.601372 28872 tablet_service.cc:1514] Processing DeleteTablet for tablet 8195907915104776b8b1b8c0281f0acf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:31:24 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:36308
I20260808 11:31:24.601570 29021 tablet_service.cc:1514] Processing DeleteTablet for tablet 8195907915104776b8b1b8c0281f0acf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:31:24 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:57152
I20260808 11:31:24.602028 29173 tablet_service.cc:1514] Processing DeleteTablet for tablet 8195907915104776b8b1b8c0281f0acf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:31:24 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:39150
I20260808 11:31:24.608345 29356 tablet_replica.cc:330] T 8195907915104776b8b1b8c0281f0acf P 87a1b69a40fe4199b8ef4e3e5700b6a6: stopping tablet replica
I20260808 11:31:24.609242 29356 raft_consensus.cc:2229] T 8195907915104776b8b1b8c0281f0acf P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:31:24.610044 29356 raft_consensus.cc:2258] T 8195907915104776b8b1b8c0281f0acf P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:31:24.611938 29356 ts_tablet_manager.cc:1905] T 8195907915104776b8b1b8c0281f0acf P 87a1b69a40fe4199b8ef4e3e5700b6a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:31:24.616266 29357 tablet_replica.cc:330] T 8195907915104776b8b1b8c0281f0acf P d0a20562723a4500bf4dcda28c2baed5: stopping tablet replica
I20260808 11:31:24.616570 29357 raft_consensus.cc:2229] T 8195907915104776b8b1b8c0281f0acf P d0a20562723a4500bf4dcda28c2baed5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:31:24.616889 29357 raft_consensus.cc:2258] T 8195907915104776b8b1b8c0281f0acf P d0a20562723a4500bf4dcda28c2baed5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:31:24.620482 29354 tablet_replica.cc:330] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe: stopping tablet replica
I20260808 11:31:24.620738 29354 raft_consensus.cc:2229] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe [term 1 LEADER]: Raft consensus shutting down.
I20260808 11:31:24.621433 29354 raft_consensus.cc:2258] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:31:24.621783 29357 ts_tablet_manager.cc:1905] T 8195907915104776b8b1b8c0281f0acf P d0a20562723a4500bf4dcda28c2baed5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:31:24.622546 29354 ts_tablet_manager.cc:1905] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:31:24.629035 29354 ts_tablet_manager.cc:1918] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 11:31:24.629163 29357 ts_tablet_manager.cc:1918] T 8195907915104776b8b1b8c0281f0acf P d0a20562723a4500bf4dcda28c2baed5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 11:31:24.629372 29357 log.cc:1196] T 8195907915104776b8b1b8c0281f0acf P d0a20562723a4500bf4dcda28c2baed5: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-2/wal/wals/8195907915104776b8b1b8c0281f0acf
I20260808 11:31:24.629947 29357 ts_tablet_manager.cc:1939] T 8195907915104776b8b1b8c0281f0acf P d0a20562723a4500bf4dcda28c2baed5: Deleting consensus metadata
I20260808 11:31:24.631145 29356 ts_tablet_manager.cc:1918] T 8195907915104776b8b1b8c0281f0acf P 87a1b69a40fe4199b8ef4e3e5700b6a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 11:31:24.631342 29356 log.cc:1196] T 8195907915104776b8b1b8c0281f0acf P 87a1b69a40fe4199b8ef4e3e5700b6a6: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-1/wal/wals/8195907915104776b8b1b8c0281f0acf
I20260808 11:31:24.631577 28712 catalog_manager.cc:4841] TS d0a20562723a4500bf4dcda28c2baed5 (127.26.66.131:43845): tablet 8195907915104776b8b1b8c0281f0acf (table test-table [id=eb4118362c384304be5a70b860f50f92]) successfully deleted
I20260808 11:31:24.632093 29356 ts_tablet_manager.cc:1939] T 8195907915104776b8b1b8c0281f0acf P 87a1b69a40fe4199b8ef4e3e5700b6a6: Deleting consensus metadata
I20260808 11:31:24.632856 29354 log.cc:1196] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-0/wal/wals/8195907915104776b8b1b8c0281f0acf
I20260808 11:31:24.633315 28711 catalog_manager.cc:4841] TS 87a1b69a40fe4199b8ef4e3e5700b6a6 (127.26.66.130:34005): tablet 8195907915104776b8b1b8c0281f0acf (table test-table [id=eb4118362c384304be5a70b860f50f92]) successfully deleted
I20260808 11:31:24.633455 29354 ts_tablet_manager.cc:1939] T 8195907915104776b8b1b8c0281f0acf P ad11bfd2f76b4a008496a2d703fcf8fe: Deleting consensus metadata
I20260808 11:31:24.634745 28713 catalog_manager.cc:4841] TS ad11bfd2f76b4a008496a2d703fcf8fe (127.26.66.129:33407): tablet 8195907915104776b8b1b8c0281f0acf (table test-table [id=eb4118362c384304be5a70b860f50f92]) successfully deleted
Aug 08 11:31:24 dist-test-slave-zkpd krb5kdc[28680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188684, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 11:31:24 dist-test-slave-zkpd krb5kdc[28680](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188684, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:24.677734 29366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:24.662966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45436 (local address 127.26.66.190:37989)
0808 11:31:24.663806 (+ 840us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:24.663818 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:24.663837 (+ 19us) server_negotiation.cc:407] Connection header received
0808 11:31:24.663935 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:24.663941 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:24.664018 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:24.664139 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:24.665506 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:24.666298 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:24.667635 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:24.668141 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:24.668281 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:24.672216 (+ 3935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:24.672221 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:24.672224 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:24.672256 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:24.675013 (+ 2757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:24.675689 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:24.675696 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:24.675699 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:24.675850 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:24.676301 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:24.676306 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:24.676310 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:24.676588 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:24.676844 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:24.677157 (+ 313us) server_negotiation.cc:299] Negotiation successful
0808 11:31:24.677391 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":693,"thread_start_us":500,"threads_started":1}
I20260808 11:31:24.681008 28726 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45436:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 11:31:24.681649 28726 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:31:24.688346 28872 tablet_service.cc:1467] Processing CreateTablet for tablet 229a3a77f797450a826d56b3ab999458 (DEFAULT_TABLE table=test-table [id=00585fc7e5834767b0187a3484bffc52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:31:24.688550 29021 tablet_service.cc:1467] Processing CreateTablet for tablet 229a3a77f797450a826d56b3ab999458 (DEFAULT_TABLE table=test-table [id=00585fc7e5834767b0187a3484bffc52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:31:24.688798 28872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 229a3a77f797450a826d56b3ab999458. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:24.688947 29021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 229a3a77f797450a826d56b3ab999458. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:24.694087 29367 tablet_bootstrap.cc:492] T 229a3a77f797450a826d56b3ab999458 P ad11bfd2f76b4a008496a2d703fcf8fe: Bootstrap starting.
I20260808 11:31:24.694310 29173 tablet_service.cc:1467] Processing CreateTablet for tablet 229a3a77f797450a826d56b3ab999458 (DEFAULT_TABLE table=test-table [id=00585fc7e5834767b0187a3484bffc52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:31:24.694536 29368 tablet_bootstrap.cc:492] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6: Bootstrap starting.
I20260808 11:31:24.694742 29173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 229a3a77f797450a826d56b3ab999458. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:24.696095 29367 tablet_bootstrap.cc:654] T 229a3a77f797450a826d56b3ab999458 P ad11bfd2f76b4a008496a2d703fcf8fe: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:24.696274 29368 tablet_bootstrap.cc:654] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:24.699615 29368 tablet_bootstrap.cc:492] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6: No bootstrap required, opened a new log
I20260808 11:31:24.699638 29367 tablet_bootstrap.cc:492] T 229a3a77f797450a826d56b3ab999458 P ad11bfd2f76b4a008496a2d703fcf8fe: No bootstrap required, opened a new log
I20260808 11:31:24.699762 29368 ts_tablet_manager.cc:1397] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 11:31:24.699790 29367 ts_tablet_manager.cc:1397] T 229a3a77f797450a826d56b3ab999458 P ad11bfd2f76b4a008496a2d703fcf8fe: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 11:31:24.700523 29367 raft_consensus.cc:348] T 229a3a77f797450a826d56b3ab999458 P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:24.700731 29367 raft_consensus.cc:374] T 229a3a77f797450a826d56b3ab999458 P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:24.700598 29368 raft_consensus.cc:348] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:24.700831 29368 raft_consensus.cc:374] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:24.700889 29367 raft_consensus.cc:729] T 229a3a77f797450a826d56b3ab999458 P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad11bfd2f76b4a008496a2d703fcf8fe, State: Initialized, Role: FOLLOWER
I20260808 11:31:24.700934 29368 raft_consensus.cc:729] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a1b69a40fe4199b8ef4e3e5700b6a6, State: Initialized, Role: FOLLOWER
I20260808 11:31:24.701167 29368 consensus_queue.cc:260] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:24.701182 29367 consensus_queue.cc:260] T 229a3a77f797450a826d56b3ab999458 P ad11bfd2f76b4a008496a2d703fcf8fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:24.702772 29367 ts_tablet_manager.cc:1428] T 229a3a77f797450a826d56b3ab999458 P ad11bfd2f76b4a008496a2d703fcf8fe: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260808 11:31:24.703651 29368 ts_tablet_manager.cc:1428] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260808 11:31:24.703867 29372 tablet_bootstrap.cc:492] T 229a3a77f797450a826d56b3ab999458 P d0a20562723a4500bf4dcda28c2baed5: Bootstrap starting.
I20260808 11:31:24.705873 29372 tablet_bootstrap.cc:654] T 229a3a77f797450a826d56b3ab999458 P d0a20562723a4500bf4dcda28c2baed5: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:24.708518 29372 tablet_bootstrap.cc:492] T 229a3a77f797450a826d56b3ab999458 P d0a20562723a4500bf4dcda28c2baed5: No bootstrap required, opened a new log
I20260808 11:31:24.708675 29372 ts_tablet_manager.cc:1397] T 229a3a77f797450a826d56b3ab999458 P d0a20562723a4500bf4dcda28c2baed5: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260808 11:31:24.709360 29372 raft_consensus.cc:348] T 229a3a77f797450a826d56b3ab999458 P d0a20562723a4500bf4dcda28c2baed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:24.709568 29372 raft_consensus.cc:374] T 229a3a77f797450a826d56b3ab999458 P d0a20562723a4500bf4dcda28c2baed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:24.709688 29372 raft_consensus.cc:729] T 229a3a77f797450a826d56b3ab999458 P d0a20562723a4500bf4dcda28c2baed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0a20562723a4500bf4dcda28c2baed5, State: Initialized, Role: FOLLOWER
I20260808 11:31:24.709939 29372 consensus_queue.cc:260] T 229a3a77f797450a826d56b3ab999458 P d0a20562723a4500bf4dcda28c2baed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:24.710677 29372 ts_tablet_manager.cc:1428] T 229a3a77f797450a826d56b3ab999458 P d0a20562723a4500bf4dcda28c2baed5: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 11:31:24.784510 29371 raft_consensus.cc:482] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:31:24.784736 29371 raft_consensus.cc:504] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:24.785534 29371 leader_election.cc:288] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad11bfd2f76b4a008496a2d703fcf8fe (127.26.66.129:33407), d0a20562723a4500bf4dcda28c2baed5 (127.26.66.131:43845)
I20260808 11:31:24.786167 29195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "229a3a77f797450a826d56b3ab999458" candidate_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a20562723a4500bf4dcda28c2baed5" is_pre_election: true
I20260808 11:31:24.786170 28893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "229a3a77f797450a826d56b3ab999458" candidate_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" is_pre_election: true
I20260808 11:31:24.786443 28893 raft_consensus.cc:2454] T 229a3a77f797450a826d56b3ab999458 P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a1b69a40fe4199b8ef4e3e5700b6a6 in term 0.
I20260808 11:31:24.786435 29195 raft_consensus.cc:2454] T 229a3a77f797450a826d56b3ab999458 P d0a20562723a4500bf4dcda28c2baed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a1b69a40fe4199b8ef4e3e5700b6a6 in term 0.
I20260808 11:31:24.786954 28970 leader_election.cc:302] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 87a1b69a40fe4199b8ef4e3e5700b6a6, ad11bfd2f76b4a008496a2d703fcf8fe, d0a20562723a4500bf4dcda28c2baed5; no voters:
I20260808 11:31:24.787326 29371 raft_consensus.cc:2781] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:31:24.787472 29371 raft_consensus.cc:482] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:31:24.787576 29371 raft_consensus.cc:3037] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:24.790103 29371 raft_consensus.cc:504] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:24.790664 29371 leader_election.cc:288] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [CANDIDATE]: Term 1 election: Requested vote from peers ad11bfd2f76b4a008496a2d703fcf8fe (127.26.66.129:33407), d0a20562723a4500bf4dcda28c2baed5 (127.26.66.131:43845)
I20260808 11:31:24.791216 29195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "229a3a77f797450a826d56b3ab999458" candidate_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a20562723a4500bf4dcda28c2baed5"
I20260808 11:31:24.791199 28893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "229a3a77f797450a826d56b3ab999458" candidate_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe"
I20260808 11:31:24.791430 28893 raft_consensus.cc:3037] T 229a3a77f797450a826d56b3ab999458 P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:24.791430 29195 raft_consensus.cc:3037] T 229a3a77f797450a826d56b3ab999458 P d0a20562723a4500bf4dcda28c2baed5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:24.794531 28893 raft_consensus.cc:2454] T 229a3a77f797450a826d56b3ab999458 P ad11bfd2f76b4a008496a2d703fcf8fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a1b69a40fe4199b8ef4e3e5700b6a6 in term 1.
I20260808 11:31:24.794528 29195 raft_consensus.cc:2454] T 229a3a77f797450a826d56b3ab999458 P d0a20562723a4500bf4dcda28c2baed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a1b69a40fe4199b8ef4e3e5700b6a6 in term 1.
I20260808 11:31:24.794958 28969 leader_election.cc:302] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a1b69a40fe4199b8ef4e3e5700b6a6, d0a20562723a4500bf4dcda28c2baed5; no voters:
I20260808 11:31:24.795284 29371 raft_consensus.cc:2781] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:31:24.795715 29371 raft_consensus.cc:686] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 1 LEADER]: Becoming Leader. State: Replica: 87a1b69a40fe4199b8ef4e3e5700b6a6, State: Running, Role: LEADER
I20260808 11:31:24.796052 29371 consensus_queue.cc:237] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:24.798492 28726 catalog_manager.cc:5495] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a1b69a40fe4199b8ef4e3e5700b6a6 (127.26.66.130). New cstate: current_term: 1 leader_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } health_report { overall_health: UNKNOWN } } }
I20260808 11:31:24.830797 29379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:24.825446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57182 (local address 127.26.66.130:34005)
0808 11:31:24.826048 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:24.826054 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:24.826074 (+ 20us) server_negotiation.cc:407] Connection header received
0808 11:31:24.826133 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:24.826136 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:24.826194 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:24.826301 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:31:24.826728 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:24.827509 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:24.828900 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:24.829350 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:24.829488 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:24.829964 (+ 476us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:31:24.830071 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:31:24.830211 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:24.830377 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 11:31:24.830456 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":288,"threads_started":1}
I20260808 11:31:24.839694 29195 raft_consensus.cc:1261] T 229a3a77f797450a826d56b3ab999458 P d0a20562723a4500bf4dcda28c2baed5 [term 1 FOLLOWER]: Refusing update from remote peer 87a1b69a40fe4199b8ef4e3e5700b6a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:31:24.839809 28893 raft_consensus.cc:1261] T 229a3a77f797450a826d56b3ab999458 P ad11bfd2f76b4a008496a2d703fcf8fe [term 1 FOLLOWER]: Refusing update from remote peer 87a1b69a40fe4199b8ef4e3e5700b6a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:31:24.840260 29375 consensus_queue.cc:1035] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:31:24.840668 29371 consensus_queue.cc:1035] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:31:24.887703 28726 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45436:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:31:24.887959 28726 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45436:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:31:24.890893 28726 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 57a5ece6fd4547c3a36eeb103b903be7: Sending DeleteTablet for 3 replicas of tablet 229a3a77f797450a826d56b3ab999458
I20260808 11:31:24.891726 29021 tablet_service.cc:1514] Processing DeleteTablet for tablet 229a3a77f797450a826d56b3ab999458 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:31:24 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:57152
I20260808 11:31:24.891803 29173 tablet_service.cc:1514] Processing DeleteTablet for tablet 229a3a77f797450a826d56b3ab999458 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:31:24 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:39150
I20260808 11:31:24.892046 28872 tablet_service.cc:1514] Processing DeleteTablet for tablet 229a3a77f797450a826d56b3ab999458 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:31:24 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:36308
I20260808 11:31:24.892107 29357 tablet_replica.cc:330] T 229a3a77f797450a826d56b3ab999458 P d0a20562723a4500bf4dcda28c2baed5: stopping tablet replica
I20260808 11:31:24.892107 29356 tablet_replica.cc:330] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6: stopping tablet replica
I20260808 11:31:24.892274 29354 tablet_replica.cc:330] T 229a3a77f797450a826d56b3ab999458 P ad11bfd2f76b4a008496a2d703fcf8fe: stopping tablet replica
I20260808 11:31:24.892306 29356 raft_consensus.cc:2229] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 1 LEADER]: Raft consensus shutting down.
I20260808 11:31:24.892324 29357 raft_consensus.cc:2229] T 229a3a77f797450a826d56b3ab999458 P d0a20562723a4500bf4dcda28c2baed5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:31:24.892454 29354 raft_consensus.cc:2229] T 229a3a77f797450a826d56b3ab999458 P ad11bfd2f76b4a008496a2d703fcf8fe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:31:24.892501 29357 raft_consensus.cc:2258] T 229a3a77f797450a826d56b3ab999458 P d0a20562723a4500bf4dcda28c2baed5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:31:24.892608 29354 raft_consensus.cc:2258] T 229a3a77f797450a826d56b3ab999458 P ad11bfd2f76b4a008496a2d703fcf8fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:31:24.892616 29356 raft_consensus.cc:2258] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:31:24.893762 29354 ts_tablet_manager.cc:1905] T 229a3a77f797450a826d56b3ab999458 P ad11bfd2f76b4a008496a2d703fcf8fe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:31:24.893779 29356 ts_tablet_manager.cc:1905] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:31:24.894081 29357 ts_tablet_manager.cc:1905] T 229a3a77f797450a826d56b3ab999458 P d0a20562723a4500bf4dcda28c2baed5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:31:24.894002 28726 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45436:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 11:31:24.894636 28726 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:31:24.899689 29356 ts_tablet_manager.cc:1918] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 11:31:24.899855 29356 log.cc:1196] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-1/wal/wals/229a3a77f797450a826d56b3ab999458
I20260808 11:31:24.900478 29356 ts_tablet_manager.cc:1939] T 229a3a77f797450a826d56b3ab999458 P 87a1b69a40fe4199b8ef4e3e5700b6a6: Deleting consensus metadata
I20260808 11:31:24.901357 29354 ts_tablet_manager.cc:1918] T 229a3a77f797450a826d56b3ab999458 P ad11bfd2f76b4a008496a2d703fcf8fe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 11:31:24.901526 29354 log.cc:1196] T 229a3a77f797450a826d56b3ab999458 P ad11bfd2f76b4a008496a2d703fcf8fe: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-0/wal/wals/229a3a77f797450a826d56b3ab999458
I20260808 11:31:24.901583 28711 catalog_manager.cc:4841] TS 87a1b69a40fe4199b8ef4e3e5700b6a6 (127.26.66.130:34005): tablet 229a3a77f797450a826d56b3ab999458 (table test-table [id=00585fc7e5834767b0187a3484bffc52]) successfully deleted
I20260808 11:31:24.901991 29354 ts_tablet_manager.cc:1939] T 229a3a77f797450a826d56b3ab999458 P ad11bfd2f76b4a008496a2d703fcf8fe: Deleting consensus metadata
I20260808 11:31:24.902168 29357 ts_tablet_manager.cc:1918] T 229a3a77f797450a826d56b3ab999458 P d0a20562723a4500bf4dcda28c2baed5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 11:31:24.902334 29357 log.cc:1196] T 229a3a77f797450a826d56b3ab999458 P d0a20562723a4500bf4dcda28c2baed5: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-2/wal/wals/229a3a77f797450a826d56b3ab999458
I20260808 11:31:24.902719 29357 ts_tablet_manager.cc:1939] T 229a3a77f797450a826d56b3ab999458 P d0a20562723a4500bf4dcda28c2baed5: Deleting consensus metadata
I20260808 11:31:24.903362 28713 catalog_manager.cc:4841] TS ad11bfd2f76b4a008496a2d703fcf8fe (127.26.66.129:33407): tablet 229a3a77f797450a826d56b3ab999458 (table test-table [id=00585fc7e5834767b0187a3484bffc52]) successfully deleted
I20260808 11:31:24.903669 28712 catalog_manager.cc:4841] TS d0a20562723a4500bf4dcda28c2baed5 (127.26.66.131:43845): tablet 229a3a77f797450a826d56b3ab999458 (table test-table [id=00585fc7e5834767b0187a3484bffc52]) successfully deleted
I20260808 11:31:24.905053 28872 tablet_service.cc:1467] Processing CreateTablet for tablet 99bed192193b4a85bcf4ff1e4eacf385 (DEFAULT_TABLE table=test-table [id=b917a1163e9f41528853a41a81dee7b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:31:24.905315 29173 tablet_service.cc:1467] Processing CreateTablet for tablet 99bed192193b4a85bcf4ff1e4eacf385 (DEFAULT_TABLE table=test-table [id=b917a1163e9f41528853a41a81dee7b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:31:24.905463 28872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99bed192193b4a85bcf4ff1e4eacf385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:24.905687 29173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99bed192193b4a85bcf4ff1e4eacf385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:24.908535 29021 tablet_service.cc:1467] Processing CreateTablet for tablet 99bed192193b4a85bcf4ff1e4eacf385 (DEFAULT_TABLE table=test-table [id=b917a1163e9f41528853a41a81dee7b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:31:24.908957 29021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99bed192193b4a85bcf4ff1e4eacf385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:24.910776 29367 tablet_bootstrap.cc:492] T 99bed192193b4a85bcf4ff1e4eacf385 P ad11bfd2f76b4a008496a2d703fcf8fe: Bootstrap starting.
I20260808 11:31:24.911244 29372 tablet_bootstrap.cc:492] T 99bed192193b4a85bcf4ff1e4eacf385 P d0a20562723a4500bf4dcda28c2baed5: Bootstrap starting.
I20260808 11:31:24.912518 29367 tablet_bootstrap.cc:654] T 99bed192193b4a85bcf4ff1e4eacf385 P ad11bfd2f76b4a008496a2d703fcf8fe: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:24.913080 29372 tablet_bootstrap.cc:654] T 99bed192193b4a85bcf4ff1e4eacf385 P d0a20562723a4500bf4dcda28c2baed5: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:24.914837 29368 tablet_bootstrap.cc:492] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6: Bootstrap starting.
I20260808 11:31:24.916211 29372 tablet_bootstrap.cc:492] T 99bed192193b4a85bcf4ff1e4eacf385 P d0a20562723a4500bf4dcda28c2baed5: No bootstrap required, opened a new log
I20260808 11:31:24.916254 29368 tablet_bootstrap.cc:654] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:24.916394 29372 ts_tablet_manager.cc:1397] T 99bed192193b4a85bcf4ff1e4eacf385 P d0a20562723a4500bf4dcda28c2baed5: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260808 11:31:24.917318 29372 raft_consensus.cc:348] T 99bed192193b4a85bcf4ff1e4eacf385 P d0a20562723a4500bf4dcda28c2baed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:24.917636 29372 raft_consensus.cc:374] T 99bed192193b4a85bcf4ff1e4eacf385 P d0a20562723a4500bf4dcda28c2baed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:24.917754 29372 raft_consensus.cc:729] T 99bed192193b4a85bcf4ff1e4eacf385 P d0a20562723a4500bf4dcda28c2baed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0a20562723a4500bf4dcda28c2baed5, State: Initialized, Role: FOLLOWER
I20260808 11:31:24.918112 29368 tablet_bootstrap.cc:492] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6: No bootstrap required, opened a new log
I20260808 11:31:24.918232 29368 ts_tablet_manager.cc:1397] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260808 11:31:24.918061 29372 consensus_queue.cc:260] T 99bed192193b4a85bcf4ff1e4eacf385 P d0a20562723a4500bf4dcda28c2baed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:24.918663 29372 ts_tablet_manager.cc:1428] T 99bed192193b4a85bcf4ff1e4eacf385 P d0a20562723a4500bf4dcda28c2baed5: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260808 11:31:24.918927 29368 raft_consensus.cc:348] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:24.919100 29368 raft_consensus.cc:374] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:24.919148 29368 raft_consensus.cc:729] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a1b69a40fe4199b8ef4e3e5700b6a6, State: Initialized, Role: FOLLOWER
I20260808 11:31:24.919385 29368 consensus_queue.cc:260] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:24.919978 29368 ts_tablet_manager.cc:1428] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 11:31:24.925048 29367 tablet_bootstrap.cc:492] T 99bed192193b4a85bcf4ff1e4eacf385 P ad11bfd2f76b4a008496a2d703fcf8fe: No bootstrap required, opened a new log
I20260808 11:31:24.925225 29367 ts_tablet_manager.cc:1397] T 99bed192193b4a85bcf4ff1e4eacf385 P ad11bfd2f76b4a008496a2d703fcf8fe: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.007s
I20260808 11:31:24.925915 29367 raft_consensus.cc:348] T 99bed192193b4a85bcf4ff1e4eacf385 P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:24.926101 29367 raft_consensus.cc:374] T 99bed192193b4a85bcf4ff1e4eacf385 P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:24.926162 29367 raft_consensus.cc:729] T 99bed192193b4a85bcf4ff1e4eacf385 P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad11bfd2f76b4a008496a2d703fcf8fe, State: Initialized, Role: FOLLOWER
I20260808 11:31:24.926389 29367 consensus_queue.cc:260] T 99bed192193b4a85bcf4ff1e4eacf385 P ad11bfd2f76b4a008496a2d703fcf8fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:24.926820 29367 ts_tablet_manager.cc:1428] T 99bed192193b4a85bcf4ff1e4eacf385 P ad11bfd2f76b4a008496a2d703fcf8fe: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 11:31:24.962980 29375 raft_consensus.cc:482] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:31:24.963254 29375 raft_consensus.cc:504] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:24.964001 29375 leader_election.cc:288] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad11bfd2f76b4a008496a2d703fcf8fe (127.26.66.129:33407), d0a20562723a4500bf4dcda28c2baed5 (127.26.66.131:43845)
I20260808 11:31:24.964521 28893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99bed192193b4a85bcf4ff1e4eacf385" candidate_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" is_pre_election: true
I20260808 11:31:24.964586 29197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99bed192193b4a85bcf4ff1e4eacf385" candidate_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a20562723a4500bf4dcda28c2baed5" is_pre_election: true
I20260808 11:31:24.964766 28893 raft_consensus.cc:2454] T 99bed192193b4a85bcf4ff1e4eacf385 P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a1b69a40fe4199b8ef4e3e5700b6a6 in term 0.
I20260808 11:31:24.964818 29197 raft_consensus.cc:2454] T 99bed192193b4a85bcf4ff1e4eacf385 P d0a20562723a4500bf4dcda28c2baed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a1b69a40fe4199b8ef4e3e5700b6a6 in term 0.
I20260808 11:31:24.965200 28970 leader_election.cc:302] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a1b69a40fe4199b8ef4e3e5700b6a6, ad11bfd2f76b4a008496a2d703fcf8fe; no voters:
I20260808 11:31:24.965502 29375 raft_consensus.cc:2781] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:31:24.965610 29375 raft_consensus.cc:482] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:31:24.965693 29375 raft_consensus.cc:3037] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:24.967676 29375 raft_consensus.cc:504] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:24.968281 29375 leader_election.cc:288] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [CANDIDATE]: Term 1 election: Requested vote from peers ad11bfd2f76b4a008496a2d703fcf8fe (127.26.66.129:33407), d0a20562723a4500bf4dcda28c2baed5 (127.26.66.131:43845)
I20260808 11:31:24.968700 28893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99bed192193b4a85bcf4ff1e4eacf385" candidate_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe"
I20260808 11:31:24.968768 29197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99bed192193b4a85bcf4ff1e4eacf385" candidate_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a20562723a4500bf4dcda28c2baed5"
I20260808 11:31:24.968890 28893 raft_consensus.cc:3037] T 99bed192193b4a85bcf4ff1e4eacf385 P ad11bfd2f76b4a008496a2d703fcf8fe [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:24.969023 29197 raft_consensus.cc:3037] T 99bed192193b4a85bcf4ff1e4eacf385 P d0a20562723a4500bf4dcda28c2baed5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:24.971323 28893 raft_consensus.cc:2454] T 99bed192193b4a85bcf4ff1e4eacf385 P ad11bfd2f76b4a008496a2d703fcf8fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a1b69a40fe4199b8ef4e3e5700b6a6 in term 1.
I20260808 11:31:24.971426 29197 raft_consensus.cc:2454] T 99bed192193b4a85bcf4ff1e4eacf385 P d0a20562723a4500bf4dcda28c2baed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a1b69a40fe4199b8ef4e3e5700b6a6 in term 1.
I20260808 11:31:24.971698 28970 leader_election.cc:302] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a1b69a40fe4199b8ef4e3e5700b6a6, ad11bfd2f76b4a008496a2d703fcf8fe; no voters:
I20260808 11:31:24.972035 29375 raft_consensus.cc:2781] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:31:24.972208 29375 raft_consensus.cc:686] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 1 LEADER]: Becoming Leader. State: Replica: 87a1b69a40fe4199b8ef4e3e5700b6a6, State: Running, Role: LEADER
I20260808 11:31:24.972471 29375 consensus_queue.cc:237] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } }
I20260808 11:31:24.975068 28727 catalog_manager.cc:5495] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a1b69a40fe4199b8ef4e3e5700b6a6 (127.26.66.130). New cstate: current_term: 1 leader_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a1b69a40fe4199b8ef4e3e5700b6a6" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 } health_report { overall_health: UNKNOWN } } }
I20260808 11:31:25.003686 28893 raft_consensus.cc:1261] T 99bed192193b4a85bcf4ff1e4eacf385 P ad11bfd2f76b4a008496a2d703fcf8fe [term 1 FOLLOWER]: Refusing update from remote peer 87a1b69a40fe4199b8ef4e3e5700b6a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:31:25.003722 29197 raft_consensus.cc:1261] T 99bed192193b4a85bcf4ff1e4eacf385 P d0a20562723a4500bf4dcda28c2baed5 [term 1 FOLLOWER]: Refusing update from remote peer 87a1b69a40fe4199b8ef4e3e5700b6a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:31:25.004343 29375 consensus_queue.cc:1035] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad11bfd2f76b4a008496a2d703fcf8fe" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 33407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:31:25.004637 29371 consensus_queue.cc:1035] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0a20562723a4500bf4dcda28c2baed5" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 11:31:25.026314 29336 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 11:31:26.604713 28728 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45436:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:31:26.604980 28728 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45436:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:31:26.608767 28728 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 57a5ece6fd4547c3a36eeb103b903be7: Sending DeleteTablet for 3 replicas of tablet 99bed192193b4a85bcf4ff1e4eacf385
I20260808 11:31:26.609546 28872 tablet_service.cc:1514] Processing DeleteTablet for tablet 99bed192193b4a85bcf4ff1e4eacf385 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:31:26 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:36308
I20260808 11:31:26.609655 29021 tablet_service.cc:1514] Processing DeleteTablet for tablet 99bed192193b4a85bcf4ff1e4eacf385 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:31:26 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:57152
I20260808 11:31:26.609716 29173 tablet_service.cc:1514] Processing DeleteTablet for tablet 99bed192193b4a85bcf4ff1e4eacf385 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:31:26 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:39150
I20260808 11:31:26.610438 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 28802
I20260808 11:31:26.620831 29416 tablet_replica.cc:330] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6: stopping tablet replica
I20260808 11:31:26.621387 29416 raft_consensus.cc:2229] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 1 LEADER]: Raft consensus shutting down.
I20260808 11:31:26.621961 29414 tablet_replica.cc:330] T 99bed192193b4a85bcf4ff1e4eacf385 P ad11bfd2f76b4a008496a2d703fcf8fe: stopping tablet replica
I20260808 11:31:26.621945 29416 raft_consensus.cc:2258] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:31:26.622341 29414 raft_consensus.cc:2229] T 99bed192193b4a85bcf4ff1e4eacf385 P ad11bfd2f76b4a008496a2d703fcf8fe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:31:26.622741 29414 raft_consensus.cc:2258] T 99bed192193b4a85bcf4ff1e4eacf385 P ad11bfd2f76b4a008496a2d703fcf8fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:31:26.623149 29416 ts_tablet_manager.cc:1905] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:31:26.623986 29414 ts_tablet_manager.cc:1905] T 99bed192193b4a85bcf4ff1e4eacf385 P ad11bfd2f76b4a008496a2d703fcf8fe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:31:26.630254 29416 ts_tablet_manager.cc:1918] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 11:31:26.630445 29416 log.cc:1196] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-1/wal/wals/99bed192193b4a85bcf4ff1e4eacf385
I20260808 11:31:26.630944 29414 ts_tablet_manager.cc:1918] T 99bed192193b4a85bcf4ff1e4eacf385 P ad11bfd2f76b4a008496a2d703fcf8fe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 11:31:26.630988 29416 ts_tablet_manager.cc:1939] T 99bed192193b4a85bcf4ff1e4eacf385 P 87a1b69a40fe4199b8ef4e3e5700b6a6: Deleting consensus metadata
I20260808 11:31:26.631162 29414 log.cc:1196] T 99bed192193b4a85bcf4ff1e4eacf385 P ad11bfd2f76b4a008496a2d703fcf8fe: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-0/wal/wals/99bed192193b4a85bcf4ff1e4eacf385
I20260808 11:31:26.631702 29414 ts_tablet_manager.cc:1939] T 99bed192193b4a85bcf4ff1e4eacf385 P ad11bfd2f76b4a008496a2d703fcf8fe: Deleting consensus metadata
I20260808 11:31:26.632274 28711 catalog_manager.cc:4841] TS 87a1b69a40fe4199b8ef4e3e5700b6a6 (127.26.66.130:34005): tablet 99bed192193b4a85bcf4ff1e4eacf385 (table test-table [id=b917a1163e9f41528853a41a81dee7b5]) successfully deleted
I20260808 11:31:26.632936 28713 catalog_manager.cc:4841] TS ad11bfd2f76b4a008496a2d703fcf8fe (127.26.66.129:33407): tablet 99bed192193b4a85bcf4ff1e4eacf385 (table test-table [id=b917a1163e9f41528853a41a81dee7b5]) successfully deleted
I20260808 11:31:26.633126 29415 tablet_replica.cc:330] T 99bed192193b4a85bcf4ff1e4eacf385 P d0a20562723a4500bf4dcda28c2baed5: stopping tablet replica
I20260808 11:31:26.633440 29415 raft_consensus.cc:2229] T 99bed192193b4a85bcf4ff1e4eacf385 P d0a20562723a4500bf4dcda28c2baed5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:31:26.633756 29415 raft_consensus.cc:2258] T 99bed192193b4a85bcf4ff1e4eacf385 P d0a20562723a4500bf4dcda28c2baed5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:31:26.634822 29415 ts_tablet_manager.cc:1905] T 99bed192193b4a85bcf4ff1e4eacf385 P d0a20562723a4500bf4dcda28c2baed5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:31:26.640671 29415 ts_tablet_manager.cc:1918] T 99bed192193b4a85bcf4ff1e4eacf385 P d0a20562723a4500bf4dcda28c2baed5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 11:31:26.640834 29415 log.cc:1196] T 99bed192193b4a85bcf4ff1e4eacf385 P d0a20562723a4500bf4dcda28c2baed5: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786188664137852-26890-0/minicluster-data/ts-2/wal/wals/99bed192193b4a85bcf4ff1e4eacf385
I20260808 11:31:26.641242 29415 ts_tablet_manager.cc:1939] T 99bed192193b4a85bcf4ff1e4eacf385 P d0a20562723a4500bf4dcda28c2baed5: Deleting consensus metadata
I20260808 11:31:26.642252 28712 catalog_manager.cc:4841] TS d0a20562723a4500bf4dcda28c2baed5 (127.26.66.131:43845): tablet 99bed192193b4a85bcf4ff1e4eacf385 (table test-table [id=b917a1163e9f41528853a41a81dee7b5]) successfully deleted
Aug 08 11:31:26 dist-test-slave-zkpd krb5kdc[28680](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188684, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.66.129@KRBTEST.COM
I20260808 11:31:26.652060 29418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:26.611401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36326 (local address 127.26.66.129:33407)
0808 11:31:26.632113 (+ 20712us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:26.632120 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:26.632150 (+ 30us) server_negotiation.cc:407] Connection header received
0808 11:31:26.632243 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:26.632251 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:26.632352 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:26.632473 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:26.634397 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:26.635349 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:26.637172 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:26.637622 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:26.637747 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:26.646267 (+ 8520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:26.646290 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:26.646306 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:26.646340 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:26.649206 (+ 2866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:26.649903 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:26.649910 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:26.649912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:26.650029 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:26.650417 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:26.650420 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:26.650422 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:26.650746 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:26.651057 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:26.651385 (+ 328us) server_negotiation.cc:299] Negotiation successful
0808 11:31:26.651630 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20548,"thread_start_us":20643,"threads_started":1}
W20260808 11:31:26.652752 28940 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36326
W20260808 11:31:26.653584 26890 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 28802: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 11:31:26.653865 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 28802
I20260808 11:31:26.686895 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 28950
Aug 08 11:31:26 dist-test-slave-zkpd krb5kdc[28680](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188684, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.66.130@KRBTEST.COM
I20260808 11:31:26.702775 29419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:26.687744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57192 (local address 127.26.66.130:34005)
0808 11:31:26.688535 (+ 791us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:26.688540 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:26.688554 (+ 14us) server_negotiation.cc:407] Connection header received
0808 11:31:26.688610 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:26.688613 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:26.688671 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:26.688795 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:26.690206 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:26.690991 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:26.692364 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:26.692736 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:26.692842 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:26.697143 (+ 4301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:26.697158 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:26.697174 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:26.697208 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:26.700018 (+ 2810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:26.700686 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:26.700693 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:26.700695 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:26.700837 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:26.701222 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:26.701226 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:26.701228 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:26.701565 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:26.701883 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:26.702172 (+ 289us) server_negotiation.cc:299] Negotiation successful
0808 11:31:26.702432 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":641,"thread_start_us":485,"threads_started":1}
W20260808 11:31:26.703487 29093 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57192
W20260808 11:31:26.704118 26890 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 28950: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 11:31:26.704301 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 28950
I20260808 11:31:26.733156 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 29102
Aug 08 11:31:26 dist-test-slave-zkpd krb5kdc[28680](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188684, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.66.131@KRBTEST.COM
I20260808 11:31:26.747972 29420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:26.734030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39160 (local address 127.26.66.131:43845)
0808 11:31:26.734558 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:26.734563 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:26.734579 (+ 16us) server_negotiation.cc:407] Connection header received
0808 11:31:26.734637 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:26.734640 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:26.734701 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:26.734799 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:26.736112 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:26.736846 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:26.737980 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:26.738366 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:26.738455 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:26.742843 (+ 4388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:26.742876 (+ 33us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:26.742894 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:26.742925 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:26.745658 (+ 2733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:26.746253 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:26.746260 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:26.746263 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:26.746389 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:26.746691 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:26.746694 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:26.746696 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:26.747036 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:26.747264 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:26.747476 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 11:31:26.747636 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":299,"threads_started":1}
W20260808 11:31:26.748627 29243 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39160
W20260808 11:31:26.749266 26890 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 29102: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 11:31:26.749398 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 29102
I20260808 11:31:26.771865 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 28695
I20260808 11:31:26.773119 28769 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:26.893347 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 28695
2026-08-08T11:31:26Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (8523 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:31:26 dist-test-slave-zkpd krb5kdc[29425](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:31:27 dist-test-slave-zkpd krb5kdc[29425](info): set up 2 sockets
Aug 08 11:31:27 dist-test-slave-zkpd krb5kdc[29425](info): commencing operation
krb5kdc: starting...
W20260808 11:31:28.025426 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.082s user 0.000s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:31:28 dist-test-slave-zkpd krb5kdc[29425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188688, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:31:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:31:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:31:28.243146 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:37955
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:34237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:37955
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:28.571614 29438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:28.571882 29438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:28.572072 29438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:28.579169 29438 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:31:28.579269 29438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:28.579397 29438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:28.579492 29438 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:31:28.579576 29438 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:31:28.589112 29438 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:34237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:37955
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:37955
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:28.590410 29438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:28.591708 29438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:28.603869 29447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:28.603783 29445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:28.603757 29443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:28.604866 29438 server_base.cc:1034] running on GCE node
I20260808 11:31:28.605556 29438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:28.606896 29438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:28.608131 29438 hybrid_clock.cc:648] HybridClock initialized: now 1786188688608076 us; error 38 us; skew 500 ppm
I20260808 11:31:28.608479 29438 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:28 dist-test-slave-zkpd krb5kdc[29425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188688, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:28.611557 29438 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:31:28.613047 29438 webserver.cc:460] Webserver started at http://127.26.66.190:45983/ using document root <none> and password file <none>
I20260808 11:31:28.613709 29438 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:28.613811 29438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:28.614078 29438 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:28.617033 29438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "91035adaec574018b3db8351deb28437"
format_stamp: "Formatted at 2026-08-08 11:31:28 on dist-test-slave-zkpd"
server_key: "1a91aeb2a8064bd23613a1284ef20820"
server_key_iv: "08a986e74cb796218c0abd067989742a"
server_key_version: "encryptionkey@0"
I20260808 11:31:28.617750 29438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "91035adaec574018b3db8351deb28437"
format_stamp: "Formatted at 2026-08-08 11:31:28 on dist-test-slave-zkpd"
server_key: "1a91aeb2a8064bd23613a1284ef20820"
server_key_iv: "08a986e74cb796218c0abd067989742a"
server_key_version: "encryptionkey@0"
I20260808 11:31:28.622923 29438 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 11:31:28.626505 29455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:28.627849 29438 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 11:31:28.628101 29438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "91035adaec574018b3db8351deb28437"
format_stamp: "Formatted at 2026-08-08 11:31:28 on dist-test-slave-zkpd"
server_key: "1a91aeb2a8064bd23613a1284ef20820"
server_key_iv: "08a986e74cb796218c0abd067989742a"
server_key_version: "encryptionkey@0"
I20260808 11:31:28.628314 29438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:28.644064 29438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:28.648039 29438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:28.648335 29438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:28.665681 29438 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:37955
I20260808 11:31:28.665688 29508 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:37955 every 8 connection(s)
I20260808 11:31:28.667026 29438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:31:28.670748 29509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:28.672279 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 29438
I20260808 11:31:28.672530 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:31:28.673379 26890 external_mini_cluster.cc:1428] Setting key 30bb8498822c61f81c398b0264d8220a
I20260808 11:31:28.685927 29509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91035adaec574018b3db8351deb28437: Bootstrap starting.
Aug 08 11:31:28 dist-test-slave-zkpd krb5kdc[29425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188688, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:28.689179 29509 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91035adaec574018b3db8351deb28437: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:28.690570 29509 log.cc:824] T 00000000000000000000000000000000 P 91035adaec574018b3db8351deb28437: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:28.693965 29509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91035adaec574018b3db8351deb28437: No bootstrap required, opened a new log
I20260808 11:31:28.697737 29512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:28.675482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45056 (local address 127.26.66.190:37955)
0808 11:31:28.676330 (+ 848us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:28.676346 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:28.676408 (+ 62us) server_negotiation.cc:407] Connection header received
0808 11:31:28.678164 (+ 1756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:28.678192 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:28.678696 (+ 504us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:28.679127 (+ 431us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:28.680515 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:28.682554 (+ 2039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:28.683912 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:28.684976 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:28.685155 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:28.689159 (+ 4004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:28.689177 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:28.689196 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:28.689249 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:28.693259 (+ 4010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:28.693900 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:28.693910 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:28.693919 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:28.694154 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:28.694531 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:28.694536 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:28.694539 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:28.695252 (+ 713us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:28.695570 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:28.695868 (+ 298us) server_negotiation.cc:299] Negotiation successful
0808 11:31:28.696393 (+ 525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":360,"threads_started":1}
I20260808 11:31:28.703274 29509 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91035adaec574018b3db8351deb28437 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91035adaec574018b3db8351deb28437" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 37955 } }
I20260808 11:31:28.703588 29509 raft_consensus.cc:374] T 00000000000000000000000000000000 P 91035adaec574018b3db8351deb28437 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:28.703660 29509 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91035adaec574018b3db8351deb28437 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91035adaec574018b3db8351deb28437, State: Initialized, Role: FOLLOWER
I20260808 11:31:28.704181 29509 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91035adaec574018b3db8351deb28437 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91035adaec574018b3db8351deb28437" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 37955 } }
I20260808 11:31:28.704385 29509 raft_consensus.cc:388] T 00000000000000000000000000000000 P 91035adaec574018b3db8351deb28437 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:31:28.704484 29509 raft_consensus.cc:482] T 00000000000000000000000000000000 P 91035adaec574018b3db8351deb28437 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:31:28.704602 29509 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91035adaec574018b3db8351deb28437 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:28.706664 29509 raft_consensus.cc:504] T 00000000000000000000000000000000 P 91035adaec574018b3db8351deb28437 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91035adaec574018b3db8351deb28437" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 37955 } }
I20260808 11:31:28.707176 29509 leader_election.cc:302] T 00000000000000000000000000000000 P 91035adaec574018b3db8351deb28437 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91035adaec574018b3db8351deb28437; no voters:
I20260808 11:31:28.707659 29509 leader_election.cc:288] T 00000000000000000000000000000000 P 91035adaec574018b3db8351deb28437 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:31:28.707809 29514 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 91035adaec574018b3db8351deb28437 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:31:28.708554 29514 raft_consensus.cc:686] T 00000000000000000000000000000000 P 91035adaec574018b3db8351deb28437 [term 1 LEADER]: Becoming Leader. State: Replica: 91035adaec574018b3db8351deb28437, State: Running, Role: LEADER
I20260808 11:31:28.709102 29514 consensus_queue.cc:237] T 00000000000000000000000000000000 P 91035adaec574018b3db8351deb28437 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91035adaec574018b3db8351deb28437" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 37955 } }
I20260808 11:31:28.709672 29509 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91035adaec574018b3db8351deb28437 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:31:28.712229 29516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91035adaec574018b3db8351deb28437 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91035adaec574018b3db8351deb28437. Latest consensus state: current_term: 1 leader_uuid: "91035adaec574018b3db8351deb28437" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91035adaec574018b3db8351deb28437" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 37955 } } }
I20260808 11:31:28.712347 29515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91035adaec574018b3db8351deb28437 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "91035adaec574018b3db8351deb28437" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91035adaec574018b3db8351deb28437" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 37955 } } }
I20260808 11:31:28.712757 29515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91035adaec574018b3db8351deb28437 [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:28.712647 29516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91035adaec574018b3db8351deb28437 [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:28.716398 29520 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:31:28.721020 29520 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:31:28.730099 29520 catalog_manager.cc:1347] Generated new cluster ID: e86d84c1ce844507baf2aadec28fb603
I20260808 11:31:28.730214 29520 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:31:28.755065 29520 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:31:28.756585 29520 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:31:28.765058 29520 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 91035adaec574018b3db8351deb28437: Generated new TSK 0
I20260808 11:31:28.766059 29520 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.66.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
I20260808 11:31:28.817912 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:0
--local_ip_for_outbound_sockets=127.26.66.129
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:37955
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:34237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:29.171001 29535 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:29.171360 29535 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:29.171554 29535 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:29.179508 29535 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:29.179659 29535 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:29.179838 29535 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:31:29.189493 29535 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:34237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:37955
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:29.190761 29535 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:29.192158 29535 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:29.206195 29541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:29.206254 29542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:29.206323 29544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:29.207024 29535 server_base.cc:1034] running on GCE node
I20260808 11:31:29.207635 29535 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:29.208665 29535 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:29.209896 29535 hybrid_clock.cc:648] HybridClock initialized: now 1786188689209841 us; error 44 us; skew 500 ppm
I20260808 11:31:29.210219 29535 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:29 dist-test-slave-zkpd krb5kdc[29425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188689, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:29.213627 29535 init.cc:377] Logged in from keytab as kudu/127.26.66.129@KRBTEST.COM (short username kudu)
I20260808 11:31:29.215176 29535 webserver.cc:460] Webserver started at http://127.26.66.129:34491/ using document root <none> and password file <none>
I20260808 11:31:29.215870 29535 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:29.216061 29535 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:29.216387 29535 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:29.219309 29535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/data/instance:
uuid: "61ccc2f9e8c74ab0a2c25d31b68cfcf5"
format_stamp: "Formatted at 2026-08-08 11:31:29 on dist-test-slave-zkpd"
server_key: "5acffd263bd0d5393250cb7f6531bbb3"
server_key_iv: "63d78d81dad529c141aa56ae2f1f0401"
server_key_version: "encryptionkey@0"
I20260808 11:31:29.220237 29535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance:
uuid: "61ccc2f9e8c74ab0a2c25d31b68cfcf5"
format_stamp: "Formatted at 2026-08-08 11:31:29 on dist-test-slave-zkpd"
server_key: "5acffd263bd0d5393250cb7f6531bbb3"
server_key_iv: "63d78d81dad529c141aa56ae2f1f0401"
server_key_version: "encryptionkey@0"
I20260808 11:31:29.225708 29535 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 11:31:29.229084 29552 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:29.230456 29535 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:31:29.230628 29535 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "61ccc2f9e8c74ab0a2c25d31b68cfcf5"
format_stamp: "Formatted at 2026-08-08 11:31:29 on dist-test-slave-zkpd"
server_key: "5acffd263bd0d5393250cb7f6531bbb3"
server_key_iv: "63d78d81dad529c141aa56ae2f1f0401"
server_key_version: "encryptionkey@0"
I20260808 11:31:29.230832 29535 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:29.247430 29535 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:29.252049 29535 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:29.252341 29535 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:29.253278 29535 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:31:29.254607 29535 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:29.254719 29535 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:29.254871 29535 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:29.254941 29535 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:29.290165 29535 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:34333
I20260808 11:31:29.290436 29669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:34333 every 8 connection(s)
I20260808 11:31:29.291666 29535 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:31:29.301379 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 29535
I20260808 11:31:29.301579 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance
I20260808 11:31:29.302429 26890 external_mini_cluster.cc:1428] Setting key 70e5d70c11faff13187ae1554f1b9199
Aug 08 11:31:29 dist-test-slave-zkpd krb5kdc[29425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188689, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:29.312858 29672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:29.294311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:51985 (local address 127.26.66.190:37955)
0808 11:31:29.294814 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:29.294818 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:29.295605 (+ 787us) server_negotiation.cc:407] Connection header received
0808 11:31:29.297537 (+ 1932us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:29.297543 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:29.297637 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:29.297771 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:29.299321 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:29.300144 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:29.302303 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:29.302771 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:29.302886 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:29.306876 (+ 3990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:29.306880 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:29.306884 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:29.306914 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:29.309610 (+ 2696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:29.310424 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:29.310431 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:29.310435 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:29.310562 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:29.311040 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:29.311046 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:29.311049 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:29.311335 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:29.311492 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:29.312264 (+ 772us) server_negotiation.cc:299] Negotiation successful
0808 11:31:29.312487 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":264,"threads_started":1}
I20260808 11:31:29.313774 29673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:29.294698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:37955 (local address 127.26.66.129:51985)
0808 11:31:29.295432 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:29.295477 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:29.297259 (+ 1782us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:29.298025 (+ 766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:29.298036 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:29.298575 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:29.299130 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:29.299147 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:29.300329 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:29.300333 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:29.302112 (+ 1779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:29.302130 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:29.303020 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:29.303029 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:29.303251 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:29.304018 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:29.304041 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:29.306642 (+ 2601us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:29.309761 (+ 3119us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:29.309772 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:29.309790 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:29.310307 (+ 517us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:29.310676 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:29.310681 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:29.310684 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:29.310928 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:29.311464 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:29.311472 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:29.311818 (+ 346us) client_negotiation.cc:769] Sending connection context
0808 11:31:29.312156 (+ 338us) client_negotiation.cc:240] Negotiation successful
0808 11:31:29.312661 (+ 505us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":287,"threads_started":1}
I20260808 11:31:29.315527 29670 heartbeater.cc:347] Connected to a master server at 127.26.66.190:37955
I20260808 11:31:29.315845 29670 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:29.316591 29670 heartbeater.cc:511] Master 127.26.66.190:37955 requested a full tablet report, sending...
I20260808 11:31:29.318642 29472 ts_manager.cc:194] Registered new tserver with Master: 61ccc2f9e8c74ab0a2c25d31b68cfcf5 (127.26.66.129:34333)
I20260808 11:31:29.320231 29472 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.129@KRBTEST.COM'} at 127.26.66.129:51985
WARNING: no policy specified for kudu/127.26.66.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
I20260808 11:31:29.358950 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:0
--local_ip_for_outbound_sockets=127.26.66.130
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:37955
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:34237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:29.702078 29676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:29.702350 29676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:29.702527 29676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:29.709503 29676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:29.709625 29676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:29.709830 29676 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:31:29.719082 29676 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:34237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:37955
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:29.720405 29676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:29.721710 29676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:29.735248 29684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:29.735271 29681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:29.735347 29682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:29.735929 29676 server_base.cc:1034] running on GCE node
I20260808 11:31:29.736599 29676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:29.737548 29676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:29.738785 29676 hybrid_clock.cc:648] HybridClock initialized: now 1786188689738746 us; error 52 us; skew 500 ppm
I20260808 11:31:29.739154 29676 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:29 dist-test-slave-zkpd krb5kdc[29425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188689, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:29.742302 29676 init.cc:377] Logged in from keytab as kudu/127.26.66.130@KRBTEST.COM (short username kudu)
I20260808 11:31:29.743731 29676 webserver.cc:460] Webserver started at http://127.26.66.130:45603/ using document root <none> and password file <none>
I20260808 11:31:29.744478 29676 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:29.744626 29676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:29.744961 29676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:29.747812 29676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/data/instance:
uuid: "f828c754416c41569ee6c2791a2f52b6"
format_stamp: "Formatted at 2026-08-08 11:31:29 on dist-test-slave-zkpd"
server_key: "471b65c307d93234cd61e04492bb080c"
server_key_iv: "3779a17d6cf14d079d5a7293fd716dfa"
server_key_version: "encryptionkey@0"
I20260808 11:31:29.748682 29676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance:
uuid: "f828c754416c41569ee6c2791a2f52b6"
format_stamp: "Formatted at 2026-08-08 11:31:29 on dist-test-slave-zkpd"
server_key: "471b65c307d93234cd61e04492bb080c"
server_key_iv: "3779a17d6cf14d079d5a7293fd716dfa"
server_key_version: "encryptionkey@0"
I20260808 11:31:29.753854 29676 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 11:31:29.757242 29692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:29.758608 29676 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:31:29.758787 29676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "f828c754416c41569ee6c2791a2f52b6"
format_stamp: "Formatted at 2026-08-08 11:31:29 on dist-test-slave-zkpd"
server_key: "471b65c307d93234cd61e04492bb080c"
server_key_iv: "3779a17d6cf14d079d5a7293fd716dfa"
server_key_version: "encryptionkey@0"
I20260808 11:31:29.758986 29676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:29.777459 29676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:29.781488 29676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:29.781785 29676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:29.782763 29676 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:31:29.784169 29676 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:29.784277 29676 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:29.784442 29676 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:29.784518 29676 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:29.818691 29676 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:44213
I20260808 11:31:29.818739 29811 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:44213 every 8 connection(s)
I20260808 11:31:29.820147 29676 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:31:29.820729 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 29676
I20260808 11:31:29.820927 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance
I20260808 11:31:29.821519 26890 external_mini_cluster.cc:1428] Setting key 6d314fe92df3181ee74bca6eb8912226
Aug 08 11:31:29 dist-test-slave-zkpd krb5kdc[29425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188689, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:29.844600 29814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:29.822879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:53717 (local address 127.26.66.190:37955)
0808 11:31:29.823317 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:29.823321 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:29.824904 (+ 1583us) server_negotiation.cc:407] Connection header received
0808 11:31:29.827762 (+ 2858us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:29.827766 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:29.827842 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:29.827994 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:29.830185 (+ 2191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:29.830950 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:29.832825 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:29.833235 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:29.833376 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:29.837407 (+ 4031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:29.837416 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:29.837424 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:29.837469 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:29.841033 (+ 3564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:29.841751 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:29.841759 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:29.841765 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:29.841927 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:29.842377 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:29.842384 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:29.842391 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:29.842790 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:29.842962 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:29.843781 (+ 819us) server_negotiation.cc:299] Negotiation successful
0808 11:31:29.844076 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":238,"threads_started":1}
I20260808 11:31:29.845144 29815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:29.823617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:37955 (local address 127.26.66.130:53717)
0808 11:31:29.824698 (+ 1081us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:29.824757 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:29.827479 (+ 2722us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:29.828250 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:29.828263 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:29.829087 (+ 824us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:29.829893 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:29.829921 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:29.831144 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:29.831147 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:29.832661 (+ 1514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:29.832674 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:29.833471 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:29.833478 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:29.833734 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:29.834478 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:29.834518 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:29.837174 (+ 2656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:29.841178 (+ 4004us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:29.841184 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:29.841195 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:29.841612 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:29.842057 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:29.842060 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:29.842062 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:29.842235 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:29.842929 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:29.842935 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:29.843386 (+ 451us) client_negotiation.cc:769] Sending connection context
0808 11:31:29.843605 (+ 219us) client_negotiation.cc:240] Negotiation successful
0808 11:31:29.844041 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":785,"thread_start_us":535,"threads_started":1}
I20260808 11:31:29.846611 29812 heartbeater.cc:347] Connected to a master server at 127.26.66.190:37955
I20260808 11:31:29.846952 29812 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.26.66.131@KRBTEST.COM; defaulting to no policy
I20260808 11:31:29.847934 29812 heartbeater.cc:511] Master 127.26.66.190:37955 requested a full tablet report, sending...
I20260808 11:31:29.849454 29472 ts_manager.cc:194] Registered new tserver with Master: f828c754416c41569ee6c2791a2f52b6 (127.26.66.130:44213)
I20260808 11:31:29.850345 29472 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.130@KRBTEST.COM'} at 127.26.66.130:53717
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
I20260808 11:31:29.878539 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:0
--local_ip_for_outbound_sockets=127.26.66.131
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:37955
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:34237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:30.214049 29818 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:30.214361 29818 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:30.214525 29818 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:30.221829 29818 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:30.221973 29818 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:30.222138 29818 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:31:30.231868 29818 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:34237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:37955
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:30.233218 29818 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:30.234640 29818 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:30.248099 29823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:30.248070 29824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:30.248229 29826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:30.248886 29818 server_base.cc:1034] running on GCE node
I20260808 11:31:30.249555 29818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:30.250458 29818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:30.251695 29818 hybrid_clock.cc:648] HybridClock initialized: now 1786188690251640 us; error 55 us; skew 500 ppm
I20260808 11:31:30.252085 29818 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:30 dist-test-slave-zkpd krb5kdc[29425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188690, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:30.255268 29818 init.cc:377] Logged in from keytab as kudu/127.26.66.131@KRBTEST.COM (short username kudu)
I20260808 11:31:30.256857 29818 webserver.cc:460] Webserver started at http://127.26.66.131:38617/ using document root <none> and password file <none>
I20260808 11:31:30.257541 29818 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:30.257686 29818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:30.258002 29818 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:30.260975 29818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/data/instance:
uuid: "b82a191fd886468fb77f933af6013c44"
format_stamp: "Formatted at 2026-08-08 11:31:30 on dist-test-slave-zkpd"
server_key: "36480e24b91ac48252f8da0dda2fa062"
server_key_iv: "c8bb6f3cc5e897af9eaad912704bc666"
server_key_version: "encryptionkey@0"
I20260808 11:31:30.261780 29818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance:
uuid: "b82a191fd886468fb77f933af6013c44"
format_stamp: "Formatted at 2026-08-08 11:31:30 on dist-test-slave-zkpd"
server_key: "36480e24b91ac48252f8da0dda2fa062"
server_key_iv: "c8bb6f3cc5e897af9eaad912704bc666"
server_key_version: "encryptionkey@0"
I20260808 11:31:30.267156 29818 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 11:31:30.270836 29833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:30.272315 29818 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:31:30.272495 29818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "b82a191fd886468fb77f933af6013c44"
format_stamp: "Formatted at 2026-08-08 11:31:30 on dist-test-slave-zkpd"
server_key: "36480e24b91ac48252f8da0dda2fa062"
server_key_iv: "c8bb6f3cc5e897af9eaad912704bc666"
server_key_version: "encryptionkey@0"
I20260808 11:31:30.272715 29818 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:30.304524 29818 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:30.308429 29818 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:30.308722 29818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:30.309783 29818 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:31:30.311174 29818 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:30.311280 29818 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:30.311444 29818 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:30.311533 29818 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:30.323129 29670 heartbeater.cc:503] Master 127.26.66.190:37955 was elected leader, sending a full tablet report...
I20260808 11:31:30.346699 29818 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:44263
I20260808 11:31:30.346781 29954 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:44263 every 8 connection(s)
I20260808 11:31:30.348132 29818 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:31:30.350090 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 29818
I20260808 11:31:30.350299 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance
I20260808 11:31:30.350826 26890 external_mini_cluster.cc:1428] Setting key 1c62240e9330eea878d2f027f0058a48
Aug 08 11:31:30 dist-test-slave-zkpd krb5kdc[29425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188690, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:30.368585 29957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:30.350839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:53969 (local address 127.26.66.190:37955)
0808 11:31:30.351343 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:30.351349 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:30.352565 (+ 1216us) server_negotiation.cc:407] Connection header received
0808 11:31:30.354448 (+ 1883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:30.354452 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:30.354515 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:30.354608 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:30.356117 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:30.356893 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:30.358347 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:30.358771 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:30.358867 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:30.362159 (+ 3292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:30.362163 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:30.362166 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:30.362210 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:30.365503 (+ 3293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:30.366490 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:30.366494 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:30.366496 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:30.366611 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:30.367005 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:30.367008 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:30.367010 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:30.367249 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:30.367380 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:30.368156 (+ 776us) server_negotiation.cc:299] Negotiation successful
0808 11:31:30.368321 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":223,"threads_started":1}
I20260808 11:31:30.369509 29958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:30.351482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:37955 (local address 127.26.66.131:53969)
0808 11:31:30.352384 (+ 902us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:30.352432 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:30.354213 (+ 1781us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:30.354815 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:30.354823 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:30.355320 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:30.355957 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:30.355989 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:30.357022 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:30.357025 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:30.358225 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:30.358237 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:30.358961 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:30.358966 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:30.359153 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:30.359749 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:30.359770 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:30.361931 (+ 2161us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:30.365670 (+ 3739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:30.365692 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:30.365705 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:30.366376 (+ 671us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:30.366710 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:30.366714 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:30.366716 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:30.366906 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:30.367409 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:30.367415 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:30.367710 (+ 295us) client_negotiation.cc:769] Sending connection context
0808 11:31:30.368058 (+ 348us) client_negotiation.cc:240] Negotiation successful
0808 11:31:30.368425 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":408,"threads_started":1}
I20260808 11:31:30.370707 29955 heartbeater.cc:347] Connected to a master server at 127.26.66.190:37955
I20260808 11:31:30.370958 29955 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:30.371585 29955 heartbeater.cc:511] Master 127.26.66.190:37955 requested a full tablet report, sending...
I20260808 11:31:30.372993 29472 ts_manager.cc:194] Registered new tserver with Master: b82a191fd886468fb77f933af6013c44 (127.26.66.131:44263)
I20260808 11:31:30.373800 29472 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.131@KRBTEST.COM'} at 127.26.66.131:53969
I20260808 11:31:30.378250 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 11:31:30.415547 29957 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:31:30.413077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40392 (local address 127.26.66.190:37955)
0808 11:31:30.413330 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:30.413340 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:30.413718 (+ 378us) server_negotiation.cc:407] Connection header received
0808 11:31:30.413883 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:30.413887 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:30.413953 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:30.414043 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:30.415264 (+ 1221us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40392: BlockingRecv error: recv got EOF from 127.0.0.1:40392 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 11:31:30.418491 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 29535
W20260808 11:31:30.421401 26890 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 29535: Not authorized: Client connection negotiation failed: client connection to 127.26.66.129:34333: server requires authentication, but client does not have Kerberos credentials available
I20260808 11:31:30.421617 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 29535
I20260808 11:31:30.442034 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 29676
W20260808 11:31:30.444657 26890 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 29676: Not authorized: Client connection negotiation failed: client connection to 127.26.66.130:44213: server requires authentication, but client does not have Kerberos credentials available
I20260808 11:31:30.444803 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 29676
I20260808 11:31:30.463635 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 29818
W20260808 11:31:30.466403 26890 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 29818: Not authorized: Client connection negotiation failed: client connection to 127.26.66.131:44263: server requires authentication, but client does not have Kerberos credentials available
I20260808 11:31:30.466579 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 29818
I20260808 11:31:30.486073 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 29438
I20260808 11:31:30.487375 29504 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:30.596021 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 29438
2026-08-08T11:31:30Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3700 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:31:30 dist-test-slave-zkpd krb5kdc[29973](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:31:30 dist-test-slave-zkpd krb5kdc[29973](info): set up 2 sockets
Aug 08 11:31:30 dist-test-slave-zkpd krb5kdc[29973](info): commencing operation
krb5kdc: starting...
W20260808 11:31:31.730050 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.087s user 0.001s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:31:31 dist-test-slave-zkpd krb5kdc[29973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188691, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:31:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:31:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:31:31.949676 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:39381
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:36533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:39381
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:32.289921 29986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:32.290198 29986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:32.290288 29986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:32.297416 29986 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:31:32.297523 29986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:32.297570 29986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:32.297629 29986 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:31:32.297676 29986 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:31:32.307307 29986 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:36533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:39381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:39381
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:32.308599 29986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:32.309939 29986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:32.322045 29992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:32.322111 29994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:32.322139 29991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:32.323029 29986 server_base.cc:1034] running on GCE node
I20260808 11:31:32.323815 29986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:32.325294 29986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:32.326529 29986 hybrid_clock.cc:648] HybridClock initialized: now 1786188692326492 us; error 52 us; skew 500 ppm
I20260808 11:31:32.326882 29986 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:32 dist-test-slave-zkpd krb5kdc[29973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188692, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:32.334780 29986 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:31:32.336504 29986 webserver.cc:460] Webserver started at http://127.26.66.190:45571/ using document root <none> and password file <none>
I20260808 11:31:32.337210 29986 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:32.337358 29986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:32.337672 29986 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:32.340714 29986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "c2bec8a2fdec422a89cb36ad30d50b7d"
format_stamp: "Formatted at 2026-08-08 11:31:32 on dist-test-slave-zkpd"
server_key: "004f56ef050acf70192e65a2d040da15"
server_key_iv: "2ab515c0f78c97f911ca3aa12b944d74"
server_key_version: "encryptionkey@0"
I20260808 11:31:32.341516 29986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "c2bec8a2fdec422a89cb36ad30d50b7d"
format_stamp: "Formatted at 2026-08-08 11:31:32 on dist-test-slave-zkpd"
server_key: "004f56ef050acf70192e65a2d040da15"
server_key_iv: "2ab515c0f78c97f911ca3aa12b944d74"
server_key_version: "encryptionkey@0"
I20260808 11:31:32.346601 29986 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 11:31:32.349996 30002 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:32.351253 29986 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 11:31:32.351433 29986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "c2bec8a2fdec422a89cb36ad30d50b7d"
format_stamp: "Formatted at 2026-08-08 11:31:32 on dist-test-slave-zkpd"
server_key: "004f56ef050acf70192e65a2d040da15"
server_key_iv: "2ab515c0f78c97f911ca3aa12b944d74"
server_key_version: "encryptionkey@0"
I20260808 11:31:32.351634 29986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:32.369712 29986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:32.373965 29986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:32.374241 29986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:32.392758 29986 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:39381
I20260808 11:31:32.392804 30054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:39381 every 8 connection(s)
I20260808 11:31:32.394127 29986 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:31:32.397733 30055 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:32.399230 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 29986
I20260808 11:31:32.399502 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:31:32.400391 26890 external_mini_cluster.cc:1428] Setting key 2a657cc52f20e55a33044f88fa6af03f
I20260808 11:31:32.412176 30055 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2bec8a2fdec422a89cb36ad30d50b7d: Bootstrap starting.
Aug 08 11:31:32 dist-test-slave-zkpd krb5kdc[29973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188691, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:32.415850 30055 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2bec8a2fdec422a89cb36ad30d50b7d: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:32.416983 30055 log.cc:824] T 00000000000000000000000000000000 P c2bec8a2fdec422a89cb36ad30d50b7d: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:32.419657 30055 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2bec8a2fdec422a89cb36ad30d50b7d: No bootstrap required, opened a new log
I20260808 11:31:32.423002 30058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:32.402298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48224 (local address 127.26.66.190:39381)
0808 11:31:32.403106 (+ 808us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:32.403116 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:32.403160 (+ 44us) server_negotiation.cc:407] Connection header received
0808 11:31:32.404781 (+ 1621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:32.404812 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:32.405177 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:32.405492 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:32.407337 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:32.408696 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:32.410551 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:32.411178 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:32.411301 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:32.415863 (+ 4562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:32.415874 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:32.415931 (+ 57us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:32.415987 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:32.419049 (+ 3062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:32.419722 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:32.419734 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:32.419740 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:32.420003 (+ 263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:32.420387 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:32.420393 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:32.420396 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:32.420877 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:32.421195 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:32.421644 (+ 449us) server_negotiation.cc:299] Negotiation successful
0808 11:31:32.422054 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":594,"thread_start_us":388,"threads_started":1}
I20260808 11:31:32.426656 26890 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 11:31:32.427595 30055 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2bec8a2fdec422a89cb36ad30d50b7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2bec8a2fdec422a89cb36ad30d50b7d" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 39381 } }
I20260808 11:31:32.427961 30055 raft_consensus.cc:374] T 00000000000000000000000000000000 P c2bec8a2fdec422a89cb36ad30d50b7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:32.428076 30055 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2bec8a2fdec422a89cb36ad30d50b7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2bec8a2fdec422a89cb36ad30d50b7d, State: Initialized, Role: FOLLOWER
I20260808 11:31:32.428666 30055 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2bec8a2fdec422a89cb36ad30d50b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2bec8a2fdec422a89cb36ad30d50b7d" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 39381 } }
I20260808 11:31:32.428892 30055 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2bec8a2fdec422a89cb36ad30d50b7d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:31:32.429037 30055 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2bec8a2fdec422a89cb36ad30d50b7d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:31:32.429204 30055 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2bec8a2fdec422a89cb36ad30d50b7d [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:32.431227 30055 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2bec8a2fdec422a89cb36ad30d50b7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2bec8a2fdec422a89cb36ad30d50b7d" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 39381 } }
I20260808 11:31:32.431691 30055 leader_election.cc:302] T 00000000000000000000000000000000 P c2bec8a2fdec422a89cb36ad30d50b7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2bec8a2fdec422a89cb36ad30d50b7d; no voters:
I20260808 11:31:32.432351 30055 leader_election.cc:288] T 00000000000000000000000000000000 P c2bec8a2fdec422a89cb36ad30d50b7d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:31:32.432467 30060 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2bec8a2fdec422a89cb36ad30d50b7d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:31:32.435065 30055 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2bec8a2fdec422a89cb36ad30d50b7d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:31:32.436609 30060 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2bec8a2fdec422a89cb36ad30d50b7d [term 1 LEADER]: Becoming Leader. State: Replica: c2bec8a2fdec422a89cb36ad30d50b7d, State: Running, Role: LEADER
I20260808 11:31:32.437371 30060 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2bec8a2fdec422a89cb36ad30d50b7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2bec8a2fdec422a89cb36ad30d50b7d" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 39381 } }
I20260808 11:31:32.440557 30061 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2bec8a2fdec422a89cb36ad30d50b7d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2bec8a2fdec422a89cb36ad30d50b7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2bec8a2fdec422a89cb36ad30d50b7d" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 39381 } } }
I20260808 11:31:32.440971 30061 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2bec8a2fdec422a89cb36ad30d50b7d [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:32.441509 30062 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2bec8a2fdec422a89cb36ad30d50b7d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2bec8a2fdec422a89cb36ad30d50b7d. Latest consensus state: current_term: 1 leader_uuid: "c2bec8a2fdec422a89cb36ad30d50b7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2bec8a2fdec422a89cb36ad30d50b7d" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 39381 } } }
I20260808 11:31:32.441778 30062 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2bec8a2fdec422a89cb36ad30d50b7d [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:32.445580 30073 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:31:32.450433 30073 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:31:32.462352 30073 catalog_manager.cc:1347] Generated new cluster ID: 0bec4d0042034164bb69d6d01d1b14f9
I20260808 11:31:32.462474 30073 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:31:32.476537 30073 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:31:32.477852 30073 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:31:32.486255 30058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:32.474549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48230 (local address 127.26.66.190:39381)
0808 11:31:32.474786 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:32.474796 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:32.476212 (+ 1416us) server_negotiation.cc:407] Connection header received
0808 11:31:32.478048 (+ 1836us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:32.478055 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:32.478147 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:32.478269 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:32.479564 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:32.480748 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:32.482533 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:32.483285 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:32.483423 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:32.484629 (+ 1206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:32.484635 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:32.484642 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:31:32.485349 (+ 707us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:32.485452 (+ 103us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:31:32.485489 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:32.485609 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:32.485781 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 11:31:32.485880 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 11:31:32.486927 30073 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2bec8a2fdec422a89cb36ad30d50b7d: Generated new TSK 0
I20260808 11:31:32.487874 30073 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:31:32.497094 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 29986
I20260808 11:31:32.498206 30050 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:32.589020 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 29986
2026-08-08T11:31:32Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1986 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:31:32 dist-test-slave-zkpd krb5kdc[30092](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:31:32 dist-test-slave-zkpd krb5kdc[30092](info): set up 2 sockets
Aug 08 11:31:32 dist-test-slave-zkpd krb5kdc[30092](info): commencing operation
krb5kdc: starting...
W20260808 11:31:33.705576 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.005s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:31:33 dist-test-slave-zkpd krb5kdc[30092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188693, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:31:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:31:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:31:33.933280 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:36505
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:34939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:36505
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:34.266597 30106 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:34.266896 30106 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:34.267055 30106 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:34.274277 30106 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:31:34.274387 30106 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:34.274466 30106 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:34.274575 30106 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:31:34.274652 30106 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:31:34.284584 30106 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:34939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:36505
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:36505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:34.285914 30106 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:34.287246 30106 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:34.299319 30111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:34.299404 30114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:34.299382 30112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:34.300593 30106 server_base.cc:1034] running on GCE node
I20260808 11:31:34.301370 30106 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:34.302735 30106 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:34.304003 30106 hybrid_clock.cc:648] HybridClock initialized: now 1786188694303947 us; error 40 us; skew 500 ppm
I20260808 11:31:34.304343 30106 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:34 dist-test-slave-zkpd krb5kdc[30092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188694, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:34.307413 30106 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:31:34.308902 30106 webserver.cc:460] Webserver started at http://127.26.66.190:36395/ using document root <none> and password file <none>
I20260808 11:31:34.309571 30106 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:34.309737 30106 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:34.310058 30106 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:34.313047 30106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "be2d163d592f4ea0bf7773940aa33d51"
format_stamp: "Formatted at 2026-08-08 11:31:34 on dist-test-slave-zkpd"
server_key: "462cb853c533c9a06d6df96e71a732a9"
server_key_iv: "7c6eabb054629f94d5a1addd8b335baf"
server_key_version: "encryptionkey@0"
I20260808 11:31:34.314041 30106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "be2d163d592f4ea0bf7773940aa33d51"
format_stamp: "Formatted at 2026-08-08 11:31:34 on dist-test-slave-zkpd"
server_key: "462cb853c533c9a06d6df96e71a732a9"
server_key_iv: "7c6eabb054629f94d5a1addd8b335baf"
server_key_version: "encryptionkey@0"
I20260808 11:31:34.319202 30106 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260808 11:31:34.322664 30121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:34.324111 30106 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 11:31:34.324297 30106 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "be2d163d592f4ea0bf7773940aa33d51"
format_stamp: "Formatted at 2026-08-08 11:31:34 on dist-test-slave-zkpd"
server_key: "462cb853c533c9a06d6df96e71a732a9"
server_key_iv: "7c6eabb054629f94d5a1addd8b335baf"
server_key_version: "encryptionkey@0"
I20260808 11:31:34.324504 30106 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:34.347677 30106 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:34.351572 30106 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:34.351907 30106 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:34.370741 30106 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:36505
I20260808 11:31:34.370779 30172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:36505 every 8 connection(s)
I20260808 11:31:34.372146 30106 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:31:34.372857 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 30106
I20260808 11:31:34.373119 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:31:34.373857 26890 external_mini_cluster.cc:1428] Setting key 6c069279ef19e38a4747d3445b8d1883
I20260808 11:31:34.376706 30173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 11:31:34 dist-test-slave-zkpd krb5kdc[30092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188693, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:34.389571 30173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be2d163d592f4ea0bf7773940aa33d51: Bootstrap starting.
I20260808 11:31:34.393680 30173 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be2d163d592f4ea0bf7773940aa33d51: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:34.394944 30173 log.cc:824] T 00000000000000000000000000000000 P be2d163d592f4ea0bf7773940aa33d51: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:34.398322 30173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be2d163d592f4ea0bf7773940aa33d51: No bootstrap required, opened a new log
I20260808 11:31:34.398512 30176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:34.375843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54926 (local address 127.26.66.190:36505)
0808 11:31:34.376697 (+ 854us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:34.376714 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:34.376766 (+ 52us) server_negotiation.cc:407] Connection header received
0808 11:31:34.379126 (+ 2360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:34.379153 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:34.379621 (+ 468us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:34.380092 (+ 471us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:34.381368 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:34.383432 (+ 2064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:34.384715 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:34.385705 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:34.385899 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:34.390064 (+ 4165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:34.390074 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:34.390091 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:34.390137 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:34.394159 (+ 4022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:34.394813 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:34.394821 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:34.394829 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:34.395048 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:34.395454 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:34.395462 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:34.395468 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:34.396140 (+ 672us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:34.396448 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:34.396808 (+ 360us) server_negotiation.cc:299] Negotiation successful
0808 11:31:34.397212 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":612,"thread_start_us":330,"threads_started":1}
I20260808 11:31:34.406529 30173 raft_consensus.cc:348] T 00000000000000000000000000000000 P be2d163d592f4ea0bf7773940aa33d51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be2d163d592f4ea0bf7773940aa33d51" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 36505 } }
I20260808 11:31:34.406908 30173 raft_consensus.cc:374] T 00000000000000000000000000000000 P be2d163d592f4ea0bf7773940aa33d51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:34.407021 30173 raft_consensus.cc:729] T 00000000000000000000000000000000 P be2d163d592f4ea0bf7773940aa33d51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be2d163d592f4ea0bf7773940aa33d51, State: Initialized, Role: FOLLOWER
I20260808 11:31:34.407665 30173 consensus_queue.cc:260] T 00000000000000000000000000000000 P be2d163d592f4ea0bf7773940aa33d51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be2d163d592f4ea0bf7773940aa33d51" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 36505 } }
I20260808 11:31:34.407991 30173 raft_consensus.cc:388] T 00000000000000000000000000000000 P be2d163d592f4ea0bf7773940aa33d51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:31:34.408149 30173 raft_consensus.cc:482] T 00000000000000000000000000000000 P be2d163d592f4ea0bf7773940aa33d51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:31:34.408322 30173 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be2d163d592f4ea0bf7773940aa33d51 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:34.410396 30173 raft_consensus.cc:504] T 00000000000000000000000000000000 P be2d163d592f4ea0bf7773940aa33d51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be2d163d592f4ea0bf7773940aa33d51" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 36505 } }
I20260808 11:31:34.410867 30173 leader_election.cc:302] T 00000000000000000000000000000000 P be2d163d592f4ea0bf7773940aa33d51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be2d163d592f4ea0bf7773940aa33d51; no voters:
I20260808 11:31:34.411413 30173 leader_election.cc:288] T 00000000000000000000000000000000 P be2d163d592f4ea0bf7773940aa33d51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:31:34.411569 30178 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be2d163d592f4ea0bf7773940aa33d51 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:31:34.413152 30178 raft_consensus.cc:686] T 00000000000000000000000000000000 P be2d163d592f4ea0bf7773940aa33d51 [term 1 LEADER]: Becoming Leader. State: Replica: be2d163d592f4ea0bf7773940aa33d51, State: Running, Role: LEADER
I20260808 11:31:34.413599 30173 sys_catalog.cc:564] T 00000000000000000000000000000000 P be2d163d592f4ea0bf7773940aa33d51 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:31:34.413674 30178 consensus_queue.cc:237] T 00000000000000000000000000000000 P be2d163d592f4ea0bf7773940aa33d51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be2d163d592f4ea0bf7773940aa33d51" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 36505 } }
I20260808 11:31:34.416890 30180 sys_catalog.cc:455] T 00000000000000000000000000000000 P be2d163d592f4ea0bf7773940aa33d51 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be2d163d592f4ea0bf7773940aa33d51. Latest consensus state: current_term: 1 leader_uuid: "be2d163d592f4ea0bf7773940aa33d51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be2d163d592f4ea0bf7773940aa33d51" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 36505 } } }
I20260808 11:31:34.416949 30179 sys_catalog.cc:455] T 00000000000000000000000000000000 P be2d163d592f4ea0bf7773940aa33d51 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be2d163d592f4ea0bf7773940aa33d51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be2d163d592f4ea0bf7773940aa33d51" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 36505 } } }
I20260808 11:31:34.417361 30179 sys_catalog.cc:458] T 00000000000000000000000000000000 P be2d163d592f4ea0bf7773940aa33d51 [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:34.417366 30180 sys_catalog.cc:458] T 00000000000000000000000000000000 P be2d163d592f4ea0bf7773940aa33d51 [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:34.418733 30187 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:31:34.424772 30187 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:31:34.433867 30187 catalog_manager.cc:1347] Generated new cluster ID: 41fcdf5ecdcd4fceb6e002ba8a572a9b
I20260808 11:31:34.433988 30187 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:31:34.451150 30187 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:31:34.452518 30187 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:31:34.463109 30187 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be2d163d592f4ea0bf7773940aa33d51: Generated new TSK 0
I20260808 11:31:34.463979 30187 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.66.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
I20260808 11:31:34.518141 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:0
--local_ip_for_outbound_sockets=127.26.66.129
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:36505
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:34939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:34.869943 30199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:34.870257 30199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:34.870436 30199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:34.877609 30199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:34.877753 30199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:34.877942 30199 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:31:34.887629 30199 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:34939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:36505
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:34.889024 30199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:34.890365 30199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:34.903961 30204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:34.903869 30205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:34.903818 30208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:34.904704 30199 server_base.cc:1034] running on GCE node
I20260808 11:31:34.905323 30199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:34.906235 30199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:34.907474 30199 hybrid_clock.cc:648] HybridClock initialized: now 1786188694907427 us; error 55 us; skew 500 ppm
I20260808 11:31:34.907786 30199 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:34 dist-test-slave-zkpd krb5kdc[30092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188694, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:34.911158 30199 init.cc:377] Logged in from keytab as kudu/127.26.66.129@KRBTEST.COM (short username kudu)
I20260808 11:31:34.912616 30199 webserver.cc:460] Webserver started at http://127.26.66.129:36247/ using document root <none> and password file <none>
I20260808 11:31:34.913283 30199 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:34.913439 30199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:34.913760 30199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:34.916683 30199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/data/instance:
uuid: "8a9da0be8bd04b198a232c0a4109c490"
format_stamp: "Formatted at 2026-08-08 11:31:34 on dist-test-slave-zkpd"
server_key: "e5309c1f0209c2beace43c885abb8cb7"
server_key_iv: "ae4bf066b521d28d6334348851fe5c93"
server_key_version: "encryptionkey@0"
I20260808 11:31:34.917587 30199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance:
uuid: "8a9da0be8bd04b198a232c0a4109c490"
format_stamp: "Formatted at 2026-08-08 11:31:34 on dist-test-slave-zkpd"
server_key: "e5309c1f0209c2beace43c885abb8cb7"
server_key_iv: "ae4bf066b521d28d6334348851fe5c93"
server_key_version: "encryptionkey@0"
I20260808 11:31:34.922811 30199 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260808 11:31:34.926147 30216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:34.927415 30199 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 11:31:34.927603 30199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "8a9da0be8bd04b198a232c0a4109c490"
format_stamp: "Formatted at 2026-08-08 11:31:34 on dist-test-slave-zkpd"
server_key: "e5309c1f0209c2beace43c885abb8cb7"
server_key_iv: "ae4bf066b521d28d6334348851fe5c93"
server_key_version: "encryptionkey@0"
I20260808 11:31:34.927850 30199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:34.968981 30199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:34.973584 30199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:34.973959 30199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:34.975003 30199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:31:34.976576 30199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:34.976660 30199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:34.976854 30199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:34.976922 30199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:35.013398 30199 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:34821
I20260808 11:31:35.013450 30330 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:34821 every 8 connection(s)
I20260808 11:31:35.014894 30199 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:31:35.020998 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 30199
I20260808 11:31:35.021253 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance
I20260808 11:31:35.022140 26890 external_mini_cluster.cc:1428] Setting key cf1ab6352823e89486ce16a27091a69d
Aug 08 11:31:35 dist-test-slave-zkpd krb5kdc[30092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188694, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:35.039237 30333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:35.017530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:54777 (local address 127.26.66.190:36505)
0808 11:31:35.017969 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:35.017974 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:35.019064 (+ 1090us) server_negotiation.cc:407] Connection header received
0808 11:31:35.021351 (+ 2287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:35.021359 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:35.021459 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:35.021567 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:35.023487 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:35.024611 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:35.027200 (+ 2589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:35.027640 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:35.027750 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:35.032431 (+ 4681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:35.032440 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:35.032447 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:35.032493 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:35.035499 (+ 3006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:35.036550 (+ 1051us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:35.036554 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:35.036556 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:35.036681 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:35.037213 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:35.037216 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:35.037218 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:35.037467 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:35.037578 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:35.038614 (+ 1036us) server_negotiation.cc:299] Negotiation successful
0808 11:31:35.038954 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":210,"threads_started":1}
I20260808 11:31:35.040863 30334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:35.018113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:36505 (local address 127.26.66.129:54777)
0808 11:31:35.018894 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:35.018948 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:35.020990 (+ 2042us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:35.021883 (+ 893us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:35.021897 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:35.022659 (+ 762us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:35.023304 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:35.023325 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:35.024788 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:35.024795 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:35.027014 (+ 2219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:35.027039 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:35.027886 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:35.027913 (+ 27us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:35.028282 (+ 369us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:35.029113 (+ 831us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:35.029147 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:35.032190 (+ 3043us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:35.035640 (+ 3450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:35.035653 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:35.035673 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:35.036427 (+ 754us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:35.036815 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:35.036824 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:35.036831 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:35.037093 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:35.037604 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:35.037616 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:35.038126 (+ 510us) client_negotiation.cc:769] Sending connection context
0808 11:31:35.038527 (+ 401us) client_negotiation.cc:240] Negotiation successful
0808 11:31:35.039186 (+ 659us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":293,"threads_started":1}
I20260808 11:31:35.042544 30331 heartbeater.cc:347] Connected to a master server at 127.26.66.190:36505
I20260808 11:31:35.042855 30331 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:35.043599 30331 heartbeater.cc:511] Master 127.26.66.190:36505 requested a full tablet report, sending...
I20260808 11:31:35.045909 30138 ts_manager.cc:194] Registered new tserver with Master: 8a9da0be8bd04b198a232c0a4109c490 (127.26.66.129:34821)
I20260808 11:31:35.048131 30138 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.129@KRBTEST.COM'} at 127.26.66.129:54777
WARNING: no policy specified for kudu/127.26.66.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
I20260808 11:31:35.077348 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:0
--local_ip_for_outbound_sockets=127.26.66.130
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:36505
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:34939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:35.409478 30337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:35.409789 30337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:35.409974 30337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:35.417114 30337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:35.417261 30337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:35.417429 30337 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:31:35.427138 30337 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:34939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:36505
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:35.428553 30337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:35.429848 30337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:35.443068 30342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:35.443192 30343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:35.443420 30345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:35.444219 30337 server_base.cc:1034] running on GCE node
I20260808 11:31:35.444813 30337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:35.445787 30337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:35.447022 30337 hybrid_clock.cc:648] HybridClock initialized: now 1786188695446982 us; error 49 us; skew 500 ppm
I20260808 11:31:35.447335 30337 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:35 dist-test-slave-zkpd krb5kdc[30092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188695, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:35.450420 30337 init.cc:377] Logged in from keytab as kudu/127.26.66.130@KRBTEST.COM (short username kudu)
I20260808 11:31:35.451972 30337 webserver.cc:460] Webserver started at http://127.26.66.130:43437/ using document root <none> and password file <none>
I20260808 11:31:35.452668 30337 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:35.452826 30337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:35.453127 30337 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:35.456087 30337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/data/instance:
uuid: "4b5d008e44c24b899ccd30fe11b7fbb5"
format_stamp: "Formatted at 2026-08-08 11:31:35 on dist-test-slave-zkpd"
server_key: "3db4f6f75867afa3e8b96238cc470c8e"
server_key_iv: "df0d0466828a94f97e08b97d97271b95"
server_key_version: "encryptionkey@0"
I20260808 11:31:35.456895 30337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance:
uuid: "4b5d008e44c24b899ccd30fe11b7fbb5"
format_stamp: "Formatted at 2026-08-08 11:31:35 on dist-test-slave-zkpd"
server_key: "3db4f6f75867afa3e8b96238cc470c8e"
server_key_iv: "df0d0466828a94f97e08b97d97271b95"
server_key_version: "encryptionkey@0"
I20260808 11:31:35.462718 30337 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 11:31:35.467526 30353 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:35.469225 30337 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:31:35.469365 30337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "4b5d008e44c24b899ccd30fe11b7fbb5"
format_stamp: "Formatted at 2026-08-08 11:31:35 on dist-test-slave-zkpd"
server_key: "3db4f6f75867afa3e8b96238cc470c8e"
server_key_iv: "df0d0466828a94f97e08b97d97271b95"
server_key_version: "encryptionkey@0"
I20260808 11:31:35.469521 30337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:35.486208 30337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:35.490478 30337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:35.490720 30337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:35.491606 30337 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:31:35.492957 30337 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:35.493031 30337 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:35.493116 30337 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:35.493161 30337 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:35.526438 30337 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:39329
I20260808 11:31:35.526485 30468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:39329 every 8 connection(s)
I20260808 11:31:35.527735 30337 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:31:35.537240 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 30337
I20260808 11:31:35.537460 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance
I20260808 11:31:35.538053 26890 external_mini_cluster.cc:1428] Setting key 179edcdd724d8589c2934812e66d26a4
Aug 08 11:31:35 dist-test-slave-zkpd krb5kdc[30092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188695, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:35.550042 30333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:35.530363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:59437 (local address 127.26.66.190:36505)
0808 11:31:35.530603 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:35.530607 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:35.531774 (+ 1167us) server_negotiation.cc:407] Connection header received
0808 11:31:35.533745 (+ 1971us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:35.533750 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:35.533847 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:35.533962 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:35.535926 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:35.536660 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:35.539101 (+ 2441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:35.539547 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:35.539641 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:35.543766 (+ 4125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:35.543771 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:35.543774 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:35.543809 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:35.546496 (+ 2687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:35.547423 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:35.547427 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:35.547429 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:35.547555 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:35.548070 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:35.548074 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:35.548076 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:35.548344 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:35.548457 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:35.549340 (+ 883us) server_negotiation.cc:299] Negotiation successful
0808 11:31:35.549633 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 11:31:35.550761 30471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:35.530833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:36505 (local address 127.26.66.130:59437)
0808 11:31:35.531595 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:35.531655 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:35.533463 (+ 1808us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:35.534196 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:35.534204 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:35.534857 (+ 653us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:35.535705 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:35.535730 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:35.536810 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:35.536818 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:35.538740 (+ 1922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:35.538752 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:35.539802 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:35.539830 (+ 28us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:35.540165 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:35.540861 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:35.540883 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:35.543530 (+ 2647us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:35.546643 (+ 3113us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:35.546654 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:35.546672 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:35.547300 (+ 628us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:35.547667 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:35.547675 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:35.547680 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:35.547957 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:35.548472 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:35.548484 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:35.548929 (+ 445us) client_negotiation.cc:769] Sending connection context
0808 11:31:35.549224 (+ 295us) client_negotiation.cc:240] Negotiation successful
0808 11:31:35.549683 (+ 459us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":264,"threads_started":1}
I20260808 11:31:35.552287 30469 heartbeater.cc:347] Connected to a master server at 127.26.66.190:36505
I20260808 11:31:35.552594 30469 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:35.553323 30469 heartbeater.cc:511] Master 127.26.66.190:36505 requested a full tablet report, sending...
I20260808 11:31:35.554777 30138 ts_manager.cc:194] Registered new tserver with Master: 4b5d008e44c24b899ccd30fe11b7fbb5 (127.26.66.130:39329)
I20260808 11:31:35.555603 30138 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.130@KRBTEST.COM'} at 127.26.66.130:59437
WARNING: no policy specified for kudu/127.26.66.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
I20260808 11:31:35.591187 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:0
--local_ip_for_outbound_sockets=127.26.66.131
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:36505
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:34939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:35.921988 30474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:35.922240 30474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:35.922405 30474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:35.929530 30474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:35.929625 30474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:35.929862 30474 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:31:35.939327 30474 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:34939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:36505
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:35.940598 30474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:35.941939 30474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:35.954960 30480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:35.954922 30482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:35.955004 30479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:35.955839 30474 server_base.cc:1034] running on GCE node
I20260808 11:31:35.956470 30474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:35.957314 30474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:35.958518 30474 hybrid_clock.cc:648] HybridClock initialized: now 1786188695958463 us; error 50 us; skew 500 ppm
I20260808 11:31:35.958854 30474 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:35 dist-test-slave-zkpd krb5kdc[30092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188695, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:35.961987 30474 init.cc:377] Logged in from keytab as kudu/127.26.66.131@KRBTEST.COM (short username kudu)
I20260808 11:31:35.963429 30474 webserver.cc:460] Webserver started at http://127.26.66.131:36245/ using document root <none> and password file <none>
I20260808 11:31:35.964172 30474 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:35.964324 30474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:35.964625 30474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:35.967511 30474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/data/instance:
uuid: "5ade21b542ec4b62b93052350e269834"
format_stamp: "Formatted at 2026-08-08 11:31:35 on dist-test-slave-zkpd"
server_key: "013b2e0b166f250ff9d83e2dc022f143"
server_key_iv: "3060adea6908c885a6c98e76c9f18417"
server_key_version: "encryptionkey@0"
I20260808 11:31:35.968426 30474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance:
uuid: "5ade21b542ec4b62b93052350e269834"
format_stamp: "Formatted at 2026-08-08 11:31:35 on dist-test-slave-zkpd"
server_key: "013b2e0b166f250ff9d83e2dc022f143"
server_key_iv: "3060adea6908c885a6c98e76c9f18417"
server_key_version: "encryptionkey@0"
I20260808 11:31:35.973501 30474 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 11:31:35.976958 30489 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:35.978144 30474 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:31:35.978322 30474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "5ade21b542ec4b62b93052350e269834"
format_stamp: "Formatted at 2026-08-08 11:31:35 on dist-test-slave-zkpd"
server_key: "013b2e0b166f250ff9d83e2dc022f143"
server_key_iv: "3060adea6908c885a6c98e76c9f18417"
server_key_version: "encryptionkey@0"
I20260808 11:31:35.978515 30474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:35.999445 30474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:36.003257 30474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:36.003549 30474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:36.004599 30474 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:31:36.005959 30474 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:36.006070 30474 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:36.006217 30474 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:36.006291 30474 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:36.042728 30474 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:39631
I20260808 11:31:36.042790 30608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:39631 every 8 connection(s)
I20260808 11:31:36.044076 30474 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:31:36.051331 30331 heartbeater.cc:503] Master 127.26.66.190:36505 was elected leader, sending a full tablet report...
I20260808 11:31:36.051743 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 30474
I20260808 11:31:36.051992 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance
I20260808 11:31:36.052541 26890 external_mini_cluster.cc:1428] Setting key 2b1104213c450f25d3f21407ea08db69
Aug 08 11:31:36 dist-test-slave-zkpd krb5kdc[30092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188695, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:36.064738 30333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:36.046594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:33939 (local address 127.26.66.190:36505)
0808 11:31:36.046823 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:36.046829 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:36.047850 (+ 1021us) server_negotiation.cc:407] Connection header received
0808 11:31:36.049841 (+ 1991us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:36.049845 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:36.049928 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:36.050023 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:36.051494 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:36.052737 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:36.054868 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:36.055377 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:36.055511 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:36.059091 (+ 3580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:36.059096 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:36.059099 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:36.059131 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:36.061603 (+ 2472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:36.062373 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:36.062377 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:36.062379 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:36.062510 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:36.062951 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:36.062956 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:36.062959 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:36.063217 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:36.063387 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:36.064116 (+ 729us) server_negotiation.cc:299] Negotiation successful
0808 11:31:36.064351 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 11:31:36.065629 30611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:36.046991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:36505 (local address 127.26.66.131:33939)
0808 11:31:36.047687 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:36.047726 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:36.049471 (+ 1745us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:36.050222 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:36.050230 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:36.050717 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:36.051250 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:36.051266 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:36.052917 (+ 1651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:36.052924 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:36.054730 (+ 1806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:36.054748 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:36.055607 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:36.055626 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:36.055961 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:36.056680 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:36.056702 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:36.058882 (+ 2180us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:36.061756 (+ 2874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:36.061764 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:36.061778 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:36.062221 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:36.062626 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:36.062631 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:36.062635 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:36.062833 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:36.063353 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:36.063361 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:36.063697 (+ 336us) client_negotiation.cc:769] Sending connection context
0808 11:31:36.064035 (+ 338us) client_negotiation.cc:240] Negotiation successful
0808 11:31:36.064554 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":271,"threads_started":1}
I20260808 11:31:36.067330 30609 heartbeater.cc:347] Connected to a master server at 127.26.66.190:36505
I20260808 11:31:36.067629 30609 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:36.068465 30609 heartbeater.cc:511] Master 127.26.66.190:36505 requested a full tablet report, sending...
I20260808 11:31:36.069844 30137 ts_manager.cc:194] Registered new tserver with Master: 5ade21b542ec4b62b93052350e269834 (127.26.66.131:39631)
I20260808 11:31:36.070713 30137 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.131@KRBTEST.COM'} at 127.26.66.131:33939
I20260808 11:31:36.080118 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 11:31:36 dist-test-slave-zkpd krb5kdc[30092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188696, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 11:31:36 dist-test-slave-zkpd krb5kdc[30092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188696, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:36.136574 30333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:36.122426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54942 (local address 127.26.66.190:36505)
0808 11:31:36.122702 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:36.122708 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:36.123079 (+ 371us) server_negotiation.cc:407] Connection header received
0808 11:31:36.123226 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:36.123230 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:36.123315 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:36.123407 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:36.124811 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:36.125585 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:36.126821 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:36.127336 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:36.127456 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:36.131479 (+ 4023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:36.131484 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:36.131487 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:36.131519 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:36.134213 (+ 2694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:36.134825 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:36.134829 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:36.134831 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:36.134958 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:36.135337 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:36.135340 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:36.135342 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:36.135643 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:36.135843 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:36.136169 (+ 326us) server_negotiation.cc:299] Negotiation successful
0808 11:31:36.136329 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
W20260808 11:31:36.137239 30137 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:54942
I20260808 11:31:36.139183 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 30199
Aug 08 11:31:36 dist-test-slave-zkpd krb5kdc[30092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188696, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.26.66.129@KRBTEST.COM
I20260808 11:31:36.154247 30620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:36.140284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48878 (local address 127.26.66.129:34821)
0808 11:31:36.140964 (+ 680us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:36.140971 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:36.140995 (+ 24us) server_negotiation.cc:407] Connection header received
0808 11:31:36.141052 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:36.141058 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:36.141325 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:36.141466 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:36.142552 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:36.143651 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:36.144823 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:36.145367 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:36.145461 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:36.149183 (+ 3722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:36.149194 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:36.149206 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:36.149242 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:36.151849 (+ 2607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:36.152588 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:36.152594 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:36.152596 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:36.152721 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:36.153033 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:36.153036 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:36.153038 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:36.153351 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:36.153576 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:36.153776 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 11:31:36.153976 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":507,"thread_start_us":338,"threads_started":1}
W20260808 11:31:36.155488 30326 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:48878
W20260808 11:31:36.156635 26890 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 30199: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 11:31:36.156853 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 30199
I20260808 11:31:36.177287 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 30337
Aug 08 11:31:36 dist-test-slave-zkpd krb5kdc[30092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188696, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.26.66.130@KRBTEST.COM
I20260808 11:31:36.193640 30621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:36.178216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36654 (local address 127.26.66.130:39329)
0808 11:31:36.178755 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:36.178762 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:36.178788 (+ 26us) server_negotiation.cc:407] Connection header received
0808 11:31:36.178851 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:36.178857 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:36.179057 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:36.179177 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:36.180536 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:36.181516 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:36.183023 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:36.183594 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:36.183695 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:36.188115 (+ 4420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:36.188135 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:36.188147 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:36.188180 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:36.191033 (+ 2853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:36.191637 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:36.191643 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:36.191646 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:36.191768 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:36.192134 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:36.192137 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:36.192139 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:36.192453 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:36.192691 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:36.193056 (+ 365us) server_negotiation.cc:299] Negotiation successful
0808 11:31:36.193288 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":277,"threads_started":1}
W20260808 11:31:36.194918 30464 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:36654
W20260808 11:31:36.196043 26890 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 30337: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 11:31:36.196224 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 30337
I20260808 11:31:36.215940 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 30474
Aug 08 11:31:36 dist-test-slave-zkpd krb5kdc[30092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188696, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.26.66.131@KRBTEST.COM
I20260808 11:31:36.232307 30622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:36.216911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33194 (local address 127.26.66.131:39631)
0808 11:31:36.217583 (+ 672us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:36.217591 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:36.217619 (+ 28us) server_negotiation.cc:407] Connection header received
0808 11:31:36.217676 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:36.217682 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:36.217903 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:36.218022 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:36.219474 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:36.220663 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:36.221853 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:36.222370 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:36.222465 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:36.226729 (+ 4264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:36.226740 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:36.226754 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:36.226802 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:36.229888 (+ 3086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:36.230475 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:36.230481 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:36.230483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:36.230604 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:36.230919 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:36.230922 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:36.230924 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:36.231240 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:36.231470 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:36.231681 (+ 211us) server_negotiation.cc:299] Negotiation successful
0808 11:31:36.232015 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":361,"threads_started":1}
W20260808 11:31:36.233632 30604 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:33194
W20260808 11:31:36.234831 26890 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 30474: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 11:31:36.234998 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 30474
I20260808 11:31:36.254933 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 30106
I20260808 11:31:36.256186 30168 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:36.361436 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 30106
2026-08-08T11:31:36Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3779 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:31:36 dist-test-slave-zkpd krb5kdc[30626](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:31:36 dist-test-slave-zkpd krb5kdc[30626](info): set up 2 sockets
Aug 08 11:31:36 dist-test-slave-zkpd krb5kdc[30626](info): commencing operation
krb5kdc: starting...
W20260808 11:31:37.491470 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.083s user 0.001s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:31:37 dist-test-slave-zkpd krb5kdc[30626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188697, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:31:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:31:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:31:37.715032 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:45615
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:36045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:45615
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:38.043582 30639 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:38.043852 30639 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:38.044045 30639 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:38.051328 30639 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:31:38.051424 30639 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:38.051604 30639 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:38.051707 30639 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:31:38.051791 30639 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:31:38.061504 30639 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:36045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:45615
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:45615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:38.062844 30639 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:38.064301 30639 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:38.076433 30648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:38.076479 30645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:38.076479 30646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:38.077638 30639 server_base.cc:1034] running on GCE node
I20260808 11:31:38.078382 30639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:38.079737 30639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:38.080971 30639 hybrid_clock.cc:648] HybridClock initialized: now 1786188698080907 us; error 52 us; skew 500 ppm
I20260808 11:31:38.081359 30639 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:38 dist-test-slave-zkpd krb5kdc[30626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188698, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:38.089099 30639 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:31:38.090682 30639 webserver.cc:460] Webserver started at http://127.26.66.190:40319/ using document root <none> and password file <none>
I20260808 11:31:38.091387 30639 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:38.091535 30639 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:38.091872 30639 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:38.095008 30639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "5addee89b2d84c67b28f32831693d5ae"
format_stamp: "Formatted at 2026-08-08 11:31:38 on dist-test-slave-zkpd"
server_key: "8714572751838c1970fe7715a724716d"
server_key_iv: "1f395474a298a4f53c256ed527eb7e3d"
server_key_version: "encryptionkey@0"
I20260808 11:31:38.095829 30639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "5addee89b2d84c67b28f32831693d5ae"
format_stamp: "Formatted at 2026-08-08 11:31:38 on dist-test-slave-zkpd"
server_key: "8714572751838c1970fe7715a724716d"
server_key_iv: "1f395474a298a4f53c256ed527eb7e3d"
server_key_version: "encryptionkey@0"
I20260808 11:31:38.101008 30639 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260808 11:31:38.104740 30656 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:38.106060 30639 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:31:38.106243 30639 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "5addee89b2d84c67b28f32831693d5ae"
format_stamp: "Formatted at 2026-08-08 11:31:38 on dist-test-slave-zkpd"
server_key: "8714572751838c1970fe7715a724716d"
server_key_iv: "1f395474a298a4f53c256ed527eb7e3d"
server_key_version: "encryptionkey@0"
I20260808 11:31:38.106446 30639 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:38.127734 30639 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:38.131626 30639 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:38.131973 30639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:38.150790 30639 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:45615
I20260808 11:31:38.150815 30708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:45615 every 8 connection(s)
I20260808 11:31:38.152185 30639 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:31:38.155031 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 30639
I20260808 11:31:38.155237 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:31:38.155885 26890 external_mini_cluster.cc:1428] Setting key ad3e7d0d7ba9a6335ad45d3f8d0e5b47
I20260808 11:31:38.155966 30709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:38.170663 30709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5addee89b2d84c67b28f32831693d5ae: Bootstrap starting.
Aug 08 11:31:38 dist-test-slave-zkpd krb5kdc[30626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188697, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:38.173899 30709 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5addee89b2d84c67b28f32831693d5ae: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:38.174961 30709 log.cc:824] T 00000000000000000000000000000000 P 5addee89b2d84c67b28f32831693d5ae: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:38.177767 30709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5addee89b2d84c67b28f32831693d5ae: No bootstrap required, opened a new log
I20260808 11:31:38.179116 30712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:38.157865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45480 (local address 127.26.66.190:45615)
0808 11:31:38.158647 (+ 782us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:38.158658 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:38.158707 (+ 49us) server_negotiation.cc:407] Connection header received
0808 11:31:38.160599 (+ 1892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:38.160618 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:38.160994 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:38.161318 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:38.163176 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:38.164553 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:38.166350 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:38.167026 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:38.167163 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:38.171966 (+ 4803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:38.171975 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:38.171988 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:38.172026 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:38.175245 (+ 3219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:38.175947 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:38.175954 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:38.175960 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:38.176134 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:38.176512 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:38.176518 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:38.176523 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:38.177022 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:38.177336 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:38.177768 (+ 432us) server_negotiation.cc:299] Negotiation successful
0808 11:31:38.178175 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":368,"threads_started":1}
I20260808 11:31:38.185868 30709 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5addee89b2d84c67b28f32831693d5ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5addee89b2d84c67b28f32831693d5ae" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45615 } }
I20260808 11:31:38.186230 30709 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5addee89b2d84c67b28f32831693d5ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:38.186349 30709 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5addee89b2d84c67b28f32831693d5ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5addee89b2d84c67b28f32831693d5ae, State: Initialized, Role: FOLLOWER
I20260808 11:31:38.186872 30709 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5addee89b2d84c67b28f32831693d5ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5addee89b2d84c67b28f32831693d5ae" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45615 } }
I20260808 11:31:38.187136 30709 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5addee89b2d84c67b28f32831693d5ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:31:38.187283 30709 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5addee89b2d84c67b28f32831693d5ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:31:38.187448 30709 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5addee89b2d84c67b28f32831693d5ae [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:38.189661 30709 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5addee89b2d84c67b28f32831693d5ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5addee89b2d84c67b28f32831693d5ae" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45615 } }
I20260808 11:31:38.190137 30709 leader_election.cc:302] T 00000000000000000000000000000000 P 5addee89b2d84c67b28f32831693d5ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5addee89b2d84c67b28f32831693d5ae; no voters:
I20260808 11:31:38.190927 30709 leader_election.cc:288] T 00000000000000000000000000000000 P 5addee89b2d84c67b28f32831693d5ae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:31:38.191071 30714 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5addee89b2d84c67b28f32831693d5ae [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:31:38.192030 30714 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5addee89b2d84c67b28f32831693d5ae [term 1 LEADER]: Becoming Leader. State: Replica: 5addee89b2d84c67b28f32831693d5ae, State: Running, Role: LEADER
I20260808 11:31:38.192580 30714 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5addee89b2d84c67b28f32831693d5ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5addee89b2d84c67b28f32831693d5ae" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45615 } }
I20260808 11:31:38.193254 30709 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5addee89b2d84c67b28f32831693d5ae [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:31:38.195402 30716 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5addee89b2d84c67b28f32831693d5ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5addee89b2d84c67b28f32831693d5ae. Latest consensus state: current_term: 1 leader_uuid: "5addee89b2d84c67b28f32831693d5ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5addee89b2d84c67b28f32831693d5ae" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45615 } } }
I20260808 11:31:38.195791 30716 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5addee89b2d84c67b28f32831693d5ae [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:38.196266 30715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5addee89b2d84c67b28f32831693d5ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5addee89b2d84c67b28f32831693d5ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5addee89b2d84c67b28f32831693d5ae" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45615 } } }
I20260808 11:31:38.196532 30715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5addee89b2d84c67b28f32831693d5ae [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:38.198222 30722 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:31:38.204418 30722 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:31:38.213949 30722 catalog_manager.cc:1347] Generated new cluster ID: 112bf3cbb7a84f7ea89c635423cfff59
I20260808 11:31:38.214087 30722 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:31:38.239507 30722 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:31:38.240931 30722 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:31:38.247852 30722 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5addee89b2d84c67b28f32831693d5ae: Generated new TSK 0
I20260808 11:31:38.248862 30722 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.66.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
I20260808 11:31:38.307014 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:0
--local_ip_for_outbound_sockets=127.26.66.129
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45615
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:36045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:38.646811 30737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:38.647095 30737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:38.647193 30737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:38.655231 30737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:38.655354 30737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:38.655493 30737 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:31:38.665521 30737 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:36045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45615
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:38.666827 30737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:38.668299 30737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:38.682608 30743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:38.682518 30744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:38.682569 30746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:38.683449 30737 server_base.cc:1034] running on GCE node
I20260808 11:31:38.684108 30737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:38.684988 30737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:38.686223 30737 hybrid_clock.cc:648] HybridClock initialized: now 1786188698686168 us; error 49 us; skew 500 ppm
I20260808 11:31:38.686497 30737 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:38 dist-test-slave-zkpd krb5kdc[30626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188698, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:38.689774 30737 init.cc:377] Logged in from keytab as kudu/127.26.66.129@KRBTEST.COM (short username kudu)
I20260808 11:31:38.691350 30737 webserver.cc:460] Webserver started at http://127.26.66.129:40867/ using document root <none> and password file <none>
I20260808 11:31:38.692137 30737 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:38.692270 30737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:38.692602 30737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:38.695685 30737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-0/data/instance:
uuid: "005643dbee8d47308d445879c90a0e6f"
format_stamp: "Formatted at 2026-08-08 11:31:38 on dist-test-slave-zkpd"
server_key: "a8fba389e0fa1d4d9cd50fd4a43f0c4f"
server_key_iv: "7918755134f81eeb799ffc4e4c09d2bf"
server_key_version: "encryptionkey@0"
I20260808 11:31:38.696584 30737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance:
uuid: "005643dbee8d47308d445879c90a0e6f"
format_stamp: "Formatted at 2026-08-08 11:31:38 on dist-test-slave-zkpd"
server_key: "a8fba389e0fa1d4d9cd50fd4a43f0c4f"
server_key_iv: "7918755134f81eeb799ffc4e4c09d2bf"
server_key_version: "encryptionkey@0"
I20260808 11:31:38.701974 30737 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 11:31:38.705559 30753 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:38.706975 30737 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 11:31:38.707149 30737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "005643dbee8d47308d445879c90a0e6f"
format_stamp: "Formatted at 2026-08-08 11:31:38 on dist-test-slave-zkpd"
server_key: "a8fba389e0fa1d4d9cd50fd4a43f0c4f"
server_key_iv: "7918755134f81eeb799ffc4e4c09d2bf"
server_key_version: "encryptionkey@0"
I20260808 11:31:38.707371 30737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:38.729336 30737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:38.733445 30737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:38.733753 30737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:38.734754 30737 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:31:38.736187 30737 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:38.736264 30737 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:38.736415 30737 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:38.736486 30737 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:38.770936 30737 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:37461
I20260808 11:31:38.770989 30869 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:37461 every 8 connection(s)
I20260808 11:31:38.772323 30737 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:31:38.780500 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 30737
I20260808 11:31:38.780750 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance
I20260808 11:31:38.781560 26890 external_mini_cluster.cc:1428] Setting key 82d189a3cad03767b6ff25fe8e152665
Aug 08 11:31:38 dist-test-slave-zkpd krb5kdc[30626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188698, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:38.793514 30872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:38.774967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:48431 (local address 127.26.66.190:45615)
0808 11:31:38.775458 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:38.775466 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:38.776558 (+ 1092us) server_negotiation.cc:407] Connection header received
0808 11:31:38.778404 (+ 1846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:38.778408 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:38.778480 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:38.778566 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:38.780459 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:38.781658 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:38.783548 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:38.784053 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:38.784195 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:38.787728 (+ 3533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:38.787734 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:38.787737 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:38.787769 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:38.790312 (+ 2543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:38.791048 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:38.791055 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:38.791058 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:38.791184 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:38.791620 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:38.791626 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:38.791629 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:38.791957 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:38.792119 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:38.792833 (+ 714us) server_negotiation.cc:299] Negotiation successful
0808 11:31:38.793087 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":226,"threads_started":1}
I20260808 11:31:38.794687 30873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:38.775573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45615 (local address 127.26.66.129:48431)
0808 11:31:38.776386 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:38.776434 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:38.778142 (+ 1708us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:38.778861 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:38.778869 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:38.779415 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:38.780228 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:38.780254 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:38.781852 (+ 1598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:38.781857 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:38.783392 (+ 1535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:38.783406 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:38.784322 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:38.784330 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:38.784561 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:38.785299 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:38.785322 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:38.787509 (+ 2187us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:38.790456 (+ 2947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:38.790465 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:38.790481 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:38.790929 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:38.791299 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:38.791305 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:38.791309 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:38.791504 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:38.792096 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:38.792104 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:38.792449 (+ 345us) client_negotiation.cc:769] Sending connection context
0808 11:31:38.792716 (+ 267us) client_negotiation.cc:240] Negotiation successful
0808 11:31:38.793287 (+ 571us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":366,"threads_started":1}
I20260808 11:31:38.796703 30870 heartbeater.cc:347] Connected to a master server at 127.26.66.190:45615
I20260808 11:31:38.797057 30870 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:38.797785 30870 heartbeater.cc:511] Master 127.26.66.190:45615 requested a full tablet report, sending...
I20260808 11:31:38.800036 30674 ts_manager.cc:194] Registered new tserver with Master: 005643dbee8d47308d445879c90a0e6f (127.26.66.129:37461)
I20260808 11:31:38.801470 30674 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.129@KRBTEST.COM'} at 127.26.66.129:48431
WARNING: no policy specified for kudu/127.26.66.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
I20260808 11:31:38.835629 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:0
--local_ip_for_outbound_sockets=127.26.66.130
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45615
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:36045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:39.173834 30876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:39.174110 30876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:39.174209 30876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:39.181360 30876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:39.181470 30876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:39.181583 30876 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:31:39.191138 30876 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:36045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45615
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:39.192381 30876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:39.193775 30876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:39.207420 30881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:39.207449 30885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:39.207512 30883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:39.208549 30876 server_base.cc:1034] running on GCE node
I20260808 11:31:39.209143 30876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:39.210108 30876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:39.211308 30876 hybrid_clock.cc:648] HybridClock initialized: now 1786188699211249 us; error 48 us; skew 500 ppm
I20260808 11:31:39.211624 30876 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:39 dist-test-slave-zkpd krb5kdc[30626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188699, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:39.214781 30876 init.cc:377] Logged in from keytab as kudu/127.26.66.130@KRBTEST.COM (short username kudu)
I20260808 11:31:39.216399 30876 webserver.cc:460] Webserver started at http://127.26.66.130:41599/ using document root <none> and password file <none>
I20260808 11:31:39.217101 30876 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:39.217250 30876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:39.217571 30876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:39.220546 30876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-1/data/instance:
uuid: "b2fb8578b08247b39ca5c35a5452a4a3"
format_stamp: "Formatted at 2026-08-08 11:31:39 on dist-test-slave-zkpd"
server_key: "b83ed9710fd3dfd2dd8a4423bfd477f9"
server_key_iv: "a36149ed801b3ee080208262ebc3508d"
server_key_version: "encryptionkey@0"
I20260808 11:31:39.221347 30876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance:
uuid: "b2fb8578b08247b39ca5c35a5452a4a3"
format_stamp: "Formatted at 2026-08-08 11:31:39 on dist-test-slave-zkpd"
server_key: "b83ed9710fd3dfd2dd8a4423bfd477f9"
server_key_iv: "a36149ed801b3ee080208262ebc3508d"
server_key_version: "encryptionkey@0"
I20260808 11:31:39.226456 30876 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260808 11:31:39.229939 30892 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:39.231238 30876 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 11:31:39.231432 30876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "b2fb8578b08247b39ca5c35a5452a4a3"
format_stamp: "Formatted at 2026-08-08 11:31:39 on dist-test-slave-zkpd"
server_key: "b83ed9710fd3dfd2dd8a4423bfd477f9"
server_key_iv: "a36149ed801b3ee080208262ebc3508d"
server_key_version: "encryptionkey@0"
I20260808 11:31:39.231645 30876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:39.249861 30876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:39.254074 30876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:39.254377 30876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:39.255472 30876 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:31:39.257002 30876 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:39.257110 30876 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:39.257266 30876 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:39.257340 30876 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:39.291884 30876 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:34399
I20260808 11:31:39.292006 31005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:34399 every 8 connection(s)
I20260808 11:31:39.293282 30876 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:31:39.297536 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 30876
I20260808 11:31:39.297750 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance
I20260808 11:31:39.298342 26890 external_mini_cluster.cc:1428] Setting key 9214f35b25f9f5f8f7a06e0995fe5dd3
Aug 08 11:31:39 dist-test-slave-zkpd krb5kdc[30626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188699, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:39.315600 31010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:39.296137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:46637 (local address 127.26.66.190:45615)
0808 11:31:39.296609 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:39.296614 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:39.298968 (+ 2354us) server_negotiation.cc:407] Connection header received
0808 11:31:39.300219 (+ 1251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:39.300225 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:39.300309 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:39.300441 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:39.302639 (+ 2198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:39.303426 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:39.305056 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:39.305507 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:39.305645 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:39.309187 (+ 3542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:39.309192 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:39.309196 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:39.309226 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:39.312549 (+ 3323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:39.313261 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:39.313267 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:39.313271 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:39.313414 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:39.313885 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:39.313890 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:39.313893 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:39.314161 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:39.314320 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:39.314993 (+ 673us) server_negotiation.cc:299] Negotiation successful
0808 11:31:39.315213 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":259,"threads_started":1}
I20260808 11:31:39.316565 31011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:39.296647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45615 (local address 127.26.66.130:46637)
0808 11:31:39.297515 (+ 868us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:39.297571 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:39.299860 (+ 2289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:39.300742 (+ 882us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:39.300756 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:39.301520 (+ 764us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:39.302469 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:39.302498 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:39.303605 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:39.303612 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:39.304899 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:39.304912 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:39.305745 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:39.305753 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:39.305985 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:39.306672 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:39.306698 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:39.308959 (+ 2261us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:39.312693 (+ 3734us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:39.312701 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:39.312716 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:39.313127 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:39.313526 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:39.313531 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:39.313535 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:39.313748 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:39.314294 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:39.314302 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:39.314631 (+ 329us) client_negotiation.cc:769] Sending connection context
0808 11:31:39.314902 (+ 271us) client_negotiation.cc:240] Negotiation successful
0808 11:31:39.315423 (+ 521us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":289,"threads_started":1}
I20260808 11:31:39.318090 31008 heartbeater.cc:347] Connected to a master server at 127.26.66.190:45615
I20260808 11:31:39.318444 31008 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:39.319375 31008 heartbeater.cc:511] Master 127.26.66.190:45615 requested a full tablet report, sending...
I20260808 11:31:39.321157 30674 ts_manager.cc:194] Registered new tserver with Master: b2fb8578b08247b39ca5c35a5452a4a3 (127.26.66.130:34399)
I20260808 11:31:39.322458 30674 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.130@KRBTEST.COM'} at 127.26.66.130:46637
WARNING: no policy specified for kudu/127.26.66.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
I20260808 11:31:39.354954 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:0
--local_ip_for_outbound_sockets=127.26.66.131
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45615
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:36045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:39.696432 31014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:39.696699 31014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:39.696796 31014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:39.704097 31014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:39.704208 31014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:39.704325 31014 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:31:39.714424 31014 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:36045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45615
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:39.715646 31014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:39.716917 31014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:39.729727 31019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:39.729763 31020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:39.729717 31023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:39.730800 31014 server_base.cc:1034] running on GCE node
I20260808 11:31:39.731410 31014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:39.732437 31014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:39.733728 31014 hybrid_clock.cc:648] HybridClock initialized: now 1786188699733650 us; error 50 us; skew 500 ppm
I20260808 11:31:39.734056 31014 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:39 dist-test-slave-zkpd krb5kdc[30626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188699, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:39.737438 31014 init.cc:377] Logged in from keytab as kudu/127.26.66.131@KRBTEST.COM (short username kudu)
I20260808 11:31:39.738911 31014 webserver.cc:460] Webserver started at http://127.26.66.131:35435/ using document root <none> and password file <none>
I20260808 11:31:39.739650 31014 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:39.739800 31014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:39.740170 31014 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:39.743502 31014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-2/data/instance:
uuid: "989c497f22464058a764b941d628bcac"
format_stamp: "Formatted at 2026-08-08 11:31:39 on dist-test-slave-zkpd"
server_key: "ee899b3cc3ba3087dd4e7d66de0a8a9f"
server_key_iv: "cfdd91927bddb3373966773e94484670"
server_key_version: "encryptionkey@0"
I20260808 11:31:39.744459 31014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance:
uuid: "989c497f22464058a764b941d628bcac"
format_stamp: "Formatted at 2026-08-08 11:31:39 on dist-test-slave-zkpd"
server_key: "ee899b3cc3ba3087dd4e7d66de0a8a9f"
server_key_iv: "cfdd91927bddb3373966773e94484670"
server_key_version: "encryptionkey@0"
I20260808 11:31:39.749782 31014 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 11:31:39.753268 31030 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:39.755008 31014 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:31:39.755174 31014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "989c497f22464058a764b941d628bcac"
format_stamp: "Formatted at 2026-08-08 11:31:39 on dist-test-slave-zkpd"
server_key: "ee899b3cc3ba3087dd4e7d66de0a8a9f"
server_key_iv: "cfdd91927bddb3373966773e94484670"
server_key_version: "encryptionkey@0"
I20260808 11:31:39.755391 31014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:39.772238 31014 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:39.776743 31014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:39.777060 31014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:39.778190 31014 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:31:39.779567 31014 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:39.779673 31014 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:39.779845 31014 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:39.779945 31014 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260808 11:31:39.804795 30870 heartbeater.cc:503] Master 127.26.66.190:45615 was elected leader, sending a full tablet report...
I20260808 11:31:39.814946 31014 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:37067
I20260808 11:31:39.814983 31142 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:37067 every 8 connection(s)
I20260808 11:31:39.816370 31014 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:31:39.817309 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 31014
I20260808 11:31:39.817492 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance
I20260808 11:31:39.818092 26890 external_mini_cluster.cc:1428] Setting key c4a3b116e9901aadf764574cf420a0b5
Aug 08 11:31:39 dist-test-slave-zkpd krb5kdc[30626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188699, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:39.837214 31145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:39.819319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:39755 (local address 127.26.66.190:45615)
0808 11:31:39.819816 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:39.819822 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:39.821115 (+ 1293us) server_negotiation.cc:407] Connection header received
0808 11:31:39.823146 (+ 2031us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:39.823151 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:39.823242 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:39.823373 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:39.824930 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:39.825695 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:39.827222 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:39.827610 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:39.827740 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:39.831104 (+ 3364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:39.831110 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:39.831113 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:39.831143 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:39.834295 (+ 3152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:39.835021 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:39.835025 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:39.835027 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:39.835198 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:39.835651 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:39.835655 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:39.835678 (+ 23us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:39.836022 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:39.836149 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:39.836765 (+ 616us) server_negotiation.cc:299] Negotiation successful
0808 11:31:39.836943 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":240,"threads_started":1}
I20260808 11:31:39.838094 31146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:39.820129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45615 (local address 127.26.66.131:39755)
0808 11:31:39.820958 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:39.820996 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:39.822896 (+ 1900us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:39.823638 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:39.823645 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:39.824217 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:39.824763 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:39.824780 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:39.825862 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:39.825866 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:39.827071 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:39.827083 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:39.827852 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:39.827860 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:39.828118 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:39.828738 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:39.828763 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:39.830900 (+ 2137us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:39.834415 (+ 3515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:39.834422 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:39.834432 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:39.834906 (+ 474us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:39.835293 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:39.835296 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:39.835298 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:39.835548 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:39.836132 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:39.836137 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:39.836448 (+ 311us) client_negotiation.cc:769] Sending connection context
0808 11:31:39.836664 (+ 216us) client_negotiation.cc:240] Negotiation successful
0808 11:31:39.837029 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":356,"threads_started":1}
I20260808 11:31:39.839357 31143 heartbeater.cc:347] Connected to a master server at 127.26.66.190:45615
I20260808 11:31:39.839640 31143 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:39.840440 31143 heartbeater.cc:511] Master 127.26.66.190:45615 requested a full tablet report, sending...
I20260808 11:31:39.841802 30674 ts_manager.cc:194] Registered new tserver with Master: 989c497f22464058a764b941d628bcac (127.26.66.131:37067)
I20260808 11:31:39.842598 30674 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.131@KRBTEST.COM'} at 127.26.66.131:39755
I20260808 11:31:39.845980 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 11:31:39 dist-test-slave-zkpd krb5kdc[30626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 11:31:39 dist-test-slave-zkpd krb5kdc[30626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.129@KRBTEST.COM
I20260808 11:31:39.904613 31153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:39.889196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56514 (local address 127.26.66.129:37461)
0808 11:31:39.889900 (+ 704us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:39.889911 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:39.889946 (+ 35us) server_negotiation.cc:407] Connection header received
0808 11:31:39.890015 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:39.890022 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:39.890238 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:39.890428 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:39.891883 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:39.892953 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:39.894274 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:39.894862 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:39.895003 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:39.898934 (+ 3931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:39.898945 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:39.898958 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:39.898989 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:39.901836 (+ 2847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:39.902539 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:39.902546 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:39.902549 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:39.902674 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:39.903090 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:39.903093 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:39.903095 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:39.903444 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:39.903691 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:39.904011 (+ 320us) server_negotiation.cc:299] Negotiation successful
0808 11:31:39.904201 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":500,"thread_start_us":316,"threads_started":1}
Aug 08 11:31:39 dist-test-slave-zkpd krb5kdc[30626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:39.922228 31145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:39.909080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45494 (local address 127.26.66.190:45615)
0808 11:31:39.909303 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:39.909308 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:39.909436 (+ 128us) server_negotiation.cc:407] Connection header received
0808 11:31:39.909556 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:39.909560 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:39.909648 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:39.909726 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:39.911058 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:39.912004 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:39.913207 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:39.913585 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:39.913675 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:39.917307 (+ 3632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:39.917311 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:39.917315 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:39.917345 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:39.919990 (+ 2645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:39.920538 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:39.920541 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:39.920543 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:39.920654 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:39.920987 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:39.920990 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:39.920992 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:39.921281 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:39.921465 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:39.921707 (+ 242us) server_negotiation.cc:299] Negotiation successful
0808 11:31:39.921877 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260808 11:31:39.922796 30674 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45494
I20260808 11:31:39.923802 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 30737
I20260808 11:31:39.937180 31153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:39.924689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56520 (local address 127.26.66.129:37461)
0808 11:31:39.924845 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:39.924851 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:39.925172 (+ 321us) server_negotiation.cc:407] Connection header received
0808 11:31:39.925297 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:39.925302 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:39.925394 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:39.925471 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:39.926602 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:39.927275 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:39.928482 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:39.928899 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:39.928995 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:39.931792 (+ 2797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:39.931799 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:39.931804 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:39.931841 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:39.934741 (+ 2900us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:39.935356 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:39.935359 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:39.935361 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:39.935524 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:39.935987 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:39.935991 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:39.935994 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:39.936339 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:39.936536 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:39.936793 (+ 257us) server_negotiation.cc:299] Negotiation successful
0808 11:31:39.936955 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 11:31:39.937780 30864 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:40.022822 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 30737
I20260808 11:31:40.043818 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 30876
Aug 08 11:31:40 dist-test-slave-zkpd krb5kdc[30626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.130@KRBTEST.COM
I20260808 11:31:40.059602 31158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:40.044754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50966 (local address 127.26.66.130:34399)
0808 11:31:40.045319 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:40.045327 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:40.045354 (+ 27us) server_negotiation.cc:407] Connection header received
0808 11:31:40.045418 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:40.045424 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:40.045648 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:40.045783 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:40.046963 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:40.048030 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:40.049262 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:40.049784 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:40.050099 (+ 315us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:40.054160 (+ 4061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:40.054172 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:40.054187 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:40.054221 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:40.057041 (+ 2820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:40.057670 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:40.057677 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:40.057679 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:40.057797 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:40.058121 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:40.058124 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:40.058126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:40.058456 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:40.058694 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:40.059044 (+ 350us) server_negotiation.cc:299] Negotiation successful
0808 11:31:40.059307 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":287,"threads_started":1}
I20260808 11:31:40.060976 31001 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:40.143980 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 30876
I20260808 11:31:40.165395 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 31014
Aug 08 11:31:40 dist-test-slave-zkpd krb5kdc[30626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.131@KRBTEST.COM
I20260808 11:31:40.182358 31160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:40.166417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38172 (local address 127.26.66.131:37067)
0808 11:31:40.167046 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:40.167054 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:40.167083 (+ 29us) server_negotiation.cc:407] Connection header received
0808 11:31:40.167144 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:40.167150 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:40.167369 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:40.167504 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:40.168858 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:40.169911 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:40.171215 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:40.171766 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:40.171869 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:40.176395 (+ 4526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:40.176407 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:40.176421 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:40.176455 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:40.179384 (+ 2929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:40.180165 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:40.180173 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:40.180176 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:40.180310 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:40.180701 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:40.180705 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:40.180707 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:40.181061 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:40.181401 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:40.181719 (+ 318us) server_negotiation.cc:299] Negotiation successful
0808 11:31:40.182002 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":482,"thread_start_us":310,"threads_started":1}
I20260808 11:31:40.183665 31138 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:40.268436 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 31014
I20260808 11:31:40.288545 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 30639
I20260808 11:31:40.289790 30704 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:40.412810 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 30639
2026-08-08T11:31:40Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4055 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:31:40 dist-test-slave-zkpd krb5kdc[31166](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:31:40 dist-test-slave-zkpd krb5kdc[31166](info): set up 2 sockets
Aug 08 11:31:40 dist-test-slave-zkpd krb5kdc[31166](info): commencing operation
krb5kdc: starting...
W20260808 11:31:41.570813 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.106s user 0.000s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:31:41 dist-test-slave-zkpd krb5kdc[31166](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:31:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:31:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:31:41.817930 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:40653
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:44487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:40653
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:42.160161 31180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:42.160584 31180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:42.160755 31180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:42.168190 31180 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:31:42.168327 31180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:42.168431 31180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:42.168534 31180 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:31:42.168624 31180 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:31:42.178370 31180 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:44487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:40653
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:40653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:42.179636 31180 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:42.180994 31180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:42.192770 31186 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:42.192834 31188 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:42.192756 31185 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:42.193614 31180 server_base.cc:1034] running on GCE node
I20260808 11:31:42.194429 31180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:42.195745 31180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:42.196982 31180 hybrid_clock.cc:648] HybridClock initialized: now 1786188702196936 us; error 58 us; skew 500 ppm
I20260808 11:31:42.197343 31180 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:42 dist-test-slave-zkpd krb5kdc[31166](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188702, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:42.200436 31180 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:31:42.201581 31180 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:42.201691 31180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:42.202018 31180 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:42.204929 31180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "2151d55f336c4ca7b8ea96b1f3c108b0"
format_stamp: "Formatted at 2026-08-08 11:31:42 on dist-test-slave-zkpd"
server_key: "42e217ba81fedb05d7f4511118a8b924"
server_key_iv: "ea47e4935d878cd498a2d81df758b168"
server_key_version: "encryptionkey@0"
I20260808 11:31:42.205668 31180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "2151d55f336c4ca7b8ea96b1f3c108b0"
format_stamp: "Formatted at 2026-08-08 11:31:42 on dist-test-slave-zkpd"
server_key: "42e217ba81fedb05d7f4511118a8b924"
server_key_iv: "ea47e4935d878cd498a2d81df758b168"
server_key_version: "encryptionkey@0"
I20260808 11:31:42.210474 31180 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 11:31:42.213917 31195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:42.215143 31180 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 11:31:42.215286 31180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "2151d55f336c4ca7b8ea96b1f3c108b0"
format_stamp: "Formatted at 2026-08-08 11:31:42 on dist-test-slave-zkpd"
server_key: "42e217ba81fedb05d7f4511118a8b924"
server_key_iv: "ea47e4935d878cd498a2d81df758b168"
server_key_version: "encryptionkey@0"
I20260808 11:31:42.215471 31180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:42.233635 31180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:42.237666 31180 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:42.237896 31180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:42.256457 31180 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:40653
I20260808 11:31:42.256470 31247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:40653 every 8 connection(s)
I20260808 11:31:42.257354 31180 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:31:42.261073 31248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:42.263162 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 31180
I20260808 11:31:42.263399 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:31:42.264245 26890 external_mini_cluster.cc:1428] Setting key 68c83d90abd4f12ffdde7b3b3282930e
I20260808 11:31:42.274571 31248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2151d55f336c4ca7b8ea96b1f3c108b0: Bootstrap starting.
Aug 08 11:31:42 dist-test-slave-zkpd krb5kdc[31166](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:42.277777 31248 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2151d55f336c4ca7b8ea96b1f3c108b0: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:42.278887 31248 log.cc:824] T 00000000000000000000000000000000 P 2151d55f336c4ca7b8ea96b1f3c108b0: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:42.281706 31248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2151d55f336c4ca7b8ea96b1f3c108b0: No bootstrap required, opened a new log
I20260808 11:31:42.286149 31251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:42.266429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57450 (local address 127.26.66.190:40653)
0808 11:31:42.267210 (+ 781us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:42.267225 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:42.267269 (+ 44us) server_negotiation.cc:407] Connection header received
0808 11:31:42.268922 (+ 1653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:42.268946 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:42.269316 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:42.269684 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:42.271199 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:42.272612 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:42.273919 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:42.274577 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:42.274780 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:42.278753 (+ 3973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:42.278762 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:42.278776 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:42.278819 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:42.282052 (+ 3233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:42.282740 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:42.282747 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:42.282753 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:42.282923 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:42.283327 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:42.283335 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:42.283337 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:42.283878 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:42.284281 (+ 403us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:42.284733 (+ 452us) server_negotiation.cc:299] Negotiation successful
0808 11:31:42.285162 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":338,"threads_started":1}
I20260808 11:31:42.289708 31248 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2151d55f336c4ca7b8ea96b1f3c108b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2151d55f336c4ca7b8ea96b1f3c108b0" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 40653 } }
I20260808 11:31:42.290091 31248 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2151d55f336c4ca7b8ea96b1f3c108b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:42.290199 31248 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2151d55f336c4ca7b8ea96b1f3c108b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2151d55f336c4ca7b8ea96b1f3c108b0, State: Initialized, Role: FOLLOWER
I20260808 11:31:42.290729 31248 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2151d55f336c4ca7b8ea96b1f3c108b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2151d55f336c4ca7b8ea96b1f3c108b0" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 40653 } }
I20260808 11:31:42.290982 31248 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2151d55f336c4ca7b8ea96b1f3c108b0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:31:42.291127 31248 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2151d55f336c4ca7b8ea96b1f3c108b0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:31:42.291290 31248 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2151d55f336c4ca7b8ea96b1f3c108b0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:42.293596 31248 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2151d55f336c4ca7b8ea96b1f3c108b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2151d55f336c4ca7b8ea96b1f3c108b0" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 40653 } }
I20260808 11:31:42.294104 31248 leader_election.cc:302] T 00000000000000000000000000000000 P 2151d55f336c4ca7b8ea96b1f3c108b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2151d55f336c4ca7b8ea96b1f3c108b0; no voters:
I20260808 11:31:42.294785 31248 leader_election.cc:288] T 00000000000000000000000000000000 P 2151d55f336c4ca7b8ea96b1f3c108b0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:31:42.294906 31253 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2151d55f336c4ca7b8ea96b1f3c108b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:31:42.296056 31253 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2151d55f336c4ca7b8ea96b1f3c108b0 [term 1 LEADER]: Becoming Leader. State: Replica: 2151d55f336c4ca7b8ea96b1f3c108b0, State: Running, Role: LEADER
I20260808 11:31:42.296660 31253 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2151d55f336c4ca7b8ea96b1f3c108b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2151d55f336c4ca7b8ea96b1f3c108b0" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 40653 } }
I20260808 11:31:42.297358 31248 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2151d55f336c4ca7b8ea96b1f3c108b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:31:42.299660 31254 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2151d55f336c4ca7b8ea96b1f3c108b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2151d55f336c4ca7b8ea96b1f3c108b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2151d55f336c4ca7b8ea96b1f3c108b0" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 40653 } } }
I20260808 11:31:42.299721 31255 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2151d55f336c4ca7b8ea96b1f3c108b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2151d55f336c4ca7b8ea96b1f3c108b0. Latest consensus state: current_term: 1 leader_uuid: "2151d55f336c4ca7b8ea96b1f3c108b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2151d55f336c4ca7b8ea96b1f3c108b0" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 40653 } } }
I20260808 11:31:42.300140 31254 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2151d55f336c4ca7b8ea96b1f3c108b0 [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:42.300173 31255 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2151d55f336c4ca7b8ea96b1f3c108b0 [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:42.301944 31260 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:31:42.306839 31260 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:31:42.315524 31260 catalog_manager.cc:1347] Generated new cluster ID: 233f0c48ce69451680a5539ac09d6c63
I20260808 11:31:42.315642 31260 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:31:42.335929 31260 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:31:42.337261 31260 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:31:42.346195 31260 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2151d55f336c4ca7b8ea96b1f3c108b0: Generated new TSK 0
I20260808 11:31:42.347041 31260 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.66.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
I20260808 11:31:42.411403 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:0
--local_ip_for_outbound_sockets=127.26.66.129
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:40653
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:44487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:42.752601 31274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:42.752876 31274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:42.753046 31274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:42.760293 31274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:42.760425 31274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:42.760625 31274 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:31:42.770295 31274 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:44487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:40653
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:42.771620 31274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:42.772979 31274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:42.785907 31280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:42.786121 31282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:42.786365 31279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:42.786835 31274 server_base.cc:1034] running on GCE node
I20260808 11:31:42.787418 31274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:42.788468 31274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:42.789700 31274 hybrid_clock.cc:648] HybridClock initialized: now 1786188702789664 us; error 48 us; skew 500 ppm
I20260808 11:31:42.790014 31274 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:42 dist-test-slave-zkpd krb5kdc[31166](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188702, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:42.793123 31274 init.cc:377] Logged in from keytab as kudu/127.26.66.129@KRBTEST.COM (short username kudu)
I20260808 11:31:42.794248 31274 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:42.794338 31274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:42.794597 31274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:42.797528 31274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-0/data/instance:
uuid: "6eae8ae4bde740f5a6123b3dfae3c3a3"
format_stamp: "Formatted at 2026-08-08 11:31:42 on dist-test-slave-zkpd"
server_key: "289225b81231bf5edd45e69ce393cca6"
server_key_iv: "72b21f756508c6c8f85fa310dee937c6"
server_key_version: "encryptionkey@0"
I20260808 11:31:42.798363 31274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance:
uuid: "6eae8ae4bde740f5a6123b3dfae3c3a3"
format_stamp: "Formatted at 2026-08-08 11:31:42 on dist-test-slave-zkpd"
server_key: "289225b81231bf5edd45e69ce393cca6"
server_key_iv: "72b21f756508c6c8f85fa310dee937c6"
server_key_version: "encryptionkey@0"
I20260808 11:31:42.803524 31274 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 11:31:42.807036 31288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:42.808353 31274 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260808 11:31:42.808486 31274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "6eae8ae4bde740f5a6123b3dfae3c3a3"
format_stamp: "Formatted at 2026-08-08 11:31:42 on dist-test-slave-zkpd"
server_key: "289225b81231bf5edd45e69ce393cca6"
server_key_iv: "72b21f756508c6c8f85fa310dee937c6"
server_key_version: "encryptionkey@0"
I20260808 11:31:42.808663 31274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:42.846504 31274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:42.850636 31274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:42.850901 31274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:42.851805 31274 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:31:42.853186 31274 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:42.853276 31274 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:42.853364 31274 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:42.853420 31274 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:42.887712 31274 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:46407
I20260808 11:31:42.887813 31406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:46407 every 8 connection(s)
I20260808 11:31:42.888677 31274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:31:42.895660 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 31274
I20260808 11:31:42.895884 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance
I20260808 11:31:42.896580 26890 external_mini_cluster.cc:1428] Setting key 02b80f92381b9574f76fccb6c9b9e68c
Aug 08 11:31:42 dist-test-slave-zkpd krb5kdc[31166](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188702, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:42.910496 31409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:42.891258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:60143 (local address 127.26.66.190:40653)
0808 11:31:42.891750 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:42.891755 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:42.892654 (+ 899us) server_negotiation.cc:407] Connection header received
0808 11:31:42.894507 (+ 1853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:42.894513 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:42.894614 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:42.894735 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:42.896410 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:42.897241 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:42.899349 (+ 2108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:42.900081 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:42.900236 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:42.904218 (+ 3982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:42.904223 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:42.904226 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:42.904258 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:42.906795 (+ 2537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:42.907833 (+ 1038us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:42.907840 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:42.907846 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:42.908030 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:42.908479 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:42.908486 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:42.908490 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:42.908889 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:42.909076 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:42.909752 (+ 676us) server_negotiation.cc:299] Negotiation successful
0808 11:31:42.910020 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":278,"threads_started":1}
I20260808 11:31:42.911201 31410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:42.891685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:40653 (local address 127.26.66.129:60143)
0808 11:31:42.892481 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:42.892519 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:42.894225 (+ 1706us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:42.894974 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:42.894982 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:42.895499 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:42.896225 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:42.896244 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:42.897431 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:42.897436 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:42.899182 (+ 1746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:42.899199 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:42.900290 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:42.900295 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:42.900480 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:42.901179 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:42.901201 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:42.904016 (+ 2815us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:42.906946 (+ 2930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:42.906958 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:42.906975 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:42.907662 (+ 687us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:42.908142 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:42.908145 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:42.908148 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:42.908325 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:42.909030 (+ 705us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:42.909035 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:42.909348 (+ 313us) client_negotiation.cc:769] Sending connection context
0808 11:31:42.909579 (+ 231us) client_negotiation.cc:240] Negotiation successful
0808 11:31:42.909949 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":357,"threads_started":1}
I20260808 11:31:42.912964 31407 heartbeater.cc:347] Connected to a master server at 127.26.66.190:40653
I20260808 11:31:42.913295 31407 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:42.914127 31407 heartbeater.cc:511] Master 127.26.66.190:40653 requested a full tablet report, sending...
I20260808 11:31:42.916716 31212 ts_manager.cc:194] Registered new tserver with Master: 6eae8ae4bde740f5a6123b3dfae3c3a3 (127.26.66.129:46407)
I20260808 11:31:42.918936 31212 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.129@KRBTEST.COM'} at 127.26.66.129:60143
WARNING: no policy specified for kudu/127.26.66.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
I20260808 11:31:42.954542 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:0
--local_ip_for_outbound_sockets=127.26.66.130
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:40653
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:44487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:43.291841 31413 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:43.292212 31413 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:43.292400 31413 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:43.299801 31413 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:43.299943 31413 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:43.300127 31413 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:31:43.309917 31413 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:44487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:40653
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:43.311182 31413 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:43.312628 31413 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:43.325309 31418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:43.325501 31421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:43.325496 31419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:43.329339 31413 server_base.cc:1034] running on GCE node
I20260808 11:31:43.329962 31413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:43.330840 31413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:43.332019 31413 hybrid_clock.cc:648] HybridClock initialized: now 1786188703331971 us; error 30 us; skew 500 ppm
I20260808 11:31:43.332326 31413 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:43 dist-test-slave-zkpd krb5kdc[31166](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188703, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:43.339430 31413 init.cc:377] Logged in from keytab as kudu/127.26.66.130@KRBTEST.COM (short username kudu)
I20260808 11:31:43.340652 31413 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:43.340744 31413 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:43.341027 31413 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:43.344039 31413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-1/data/instance:
uuid: "3f8176f857e64960888419a74f3ef8d1"
format_stamp: "Formatted at 2026-08-08 11:31:43 on dist-test-slave-zkpd"
server_key: "f3c9f0fe623ddafcbeb32f6174841406"
server_key_iv: "8b0e5ecd1248d41129e1b1f7bc8577be"
server_key_version: "encryptionkey@0"
I20260808 11:31:43.344820 31413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance:
uuid: "3f8176f857e64960888419a74f3ef8d1"
format_stamp: "Formatted at 2026-08-08 11:31:43 on dist-test-slave-zkpd"
server_key: "f3c9f0fe623ddafcbeb32f6174841406"
server_key_iv: "8b0e5ecd1248d41129e1b1f7bc8577be"
server_key_version: "encryptionkey@0"
I20260808 11:31:43.349885 31413 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 11:31:43.353317 31428 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:43.354672 31413 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260808 11:31:43.354864 31413 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "3f8176f857e64960888419a74f3ef8d1"
format_stamp: "Formatted at 2026-08-08 11:31:43 on dist-test-slave-zkpd"
server_key: "f3c9f0fe623ddafcbeb32f6174841406"
server_key_iv: "8b0e5ecd1248d41129e1b1f7bc8577be"
server_key_version: "encryptionkey@0"
I20260808 11:31:43.355084 31413 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:43.384793 31413 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:43.388919 31413 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:43.389218 31413 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:43.390237 31413 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:31:43.391644 31413 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:43.391733 31413 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:43.391822 31413 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:43.391881 31413 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:43.426391 31413 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:37051
I20260808 11:31:43.426443 31547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:37051 every 8 connection(s)
I20260808 11:31:43.427294 31413 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:31:43.427657 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 31413
I20260808 11:31:43.427850 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance
I20260808 11:31:43.428510 26890 external_mini_cluster.cc:1428] Setting key d9e3dad44817f0d69499054b5eae3e2c
Aug 08 11:31:43 dist-test-slave-zkpd krb5kdc[31166](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188703, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:43.451839 31550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:43.430011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:43837 (local address 127.26.66.190:40653)
0808 11:31:43.430502 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:43.430507 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:43.431743 (+ 1236us) server_negotiation.cc:407] Connection header received
0808 11:31:43.434773 (+ 3030us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:43.434777 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:43.434864 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:43.434956 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:43.437207 (+ 2251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:43.437958 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:43.440484 (+ 2526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:43.440901 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:43.440996 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:43.444583 (+ 3587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:43.444593 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:43.444601 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:43.444651 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:43.448446 (+ 3795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:43.449189 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:43.449197 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:43.449203 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:43.449373 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:43.449774 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:43.449782 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:43.449786 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:43.450176 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:43.450363 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:43.451025 (+ 662us) server_negotiation.cc:299] Negotiation successful
0808 11:31:43.451283 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":251,"threads_started":1}
I20260808 11:31:43.452391 31551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:43.430641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:40653 (local address 127.26.66.130:43837)
0808 11:31:43.431542 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:43.431602 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:43.434455 (+ 2853us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:43.435246 (+ 791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:43.435262 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:43.436159 (+ 897us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:43.437009 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:43.437039 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:43.438130 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:43.438139 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:43.440344 (+ 2205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:43.440363 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:43.441147 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:43.441153 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:43.441349 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:43.442068 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:43.442091 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:43.444318 (+ 2227us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:43.448593 (+ 4275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:43.448600 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:43.448612 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:43.449049 (+ 437us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:43.449481 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:43.449484 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:43.449487 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:43.449659 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:43.450304 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:43.450310 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:43.450604 (+ 294us) client_negotiation.cc:769] Sending connection context
0808 11:31:43.450860 (+ 256us) client_negotiation.cc:240] Negotiation successful
0808 11:31:43.451229 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":343,"threads_started":1}
I20260808 11:31:43.453948 31548 heartbeater.cc:347] Connected to a master server at 127.26.66.190:40653
I20260808 11:31:43.454319 31548 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:43.455158 31548 heartbeater.cc:511] Master 127.26.66.190:40653 requested a full tablet report, sending...
I20260808 11:31:43.456775 31212 ts_manager.cc:194] Registered new tserver with Master: 3f8176f857e64960888419a74f3ef8d1 (127.26.66.130:37051)
WARNING: no policy specified for kudu/127.26.66.131@KRBTEST.COM; defaulting to no policy
I20260808 11:31:43.457680 31212 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.130@KRBTEST.COM'} at 127.26.66.130:43837
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
I20260808 11:31:43.492039 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:0
--local_ip_for_outbound_sockets=127.26.66.131
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:40653
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:44487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:43.823405 31554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:43.823680 31554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:43.823859 31554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:43.830979 31554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:43.831077 31554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:43.831293 31554 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:31:43.841118 31554 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:44487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:40653
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:43.842427 31554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:43.843734 31554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:43.856590 31559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:43.856652 31560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:43.856628 31562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:43.857498 31554 server_base.cc:1034] running on GCE node
I20260808 11:31:43.858214 31554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:43.859215 31554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:43.860447 31554 hybrid_clock.cc:648] HybridClock initialized: now 1786188703860376 us; error 54 us; skew 500 ppm
I20260808 11:31:43.860771 31554 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:43 dist-test-slave-zkpd krb5kdc[31166](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188703, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:43.864074 31554 init.cc:377] Logged in from keytab as kudu/127.26.66.131@KRBTEST.COM (short username kudu)
I20260808 11:31:43.865238 31554 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:43.865391 31554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:43.865712 31554 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:43.868832 31554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-2/data/instance:
uuid: "f228ec821b764a288078925e1ad6bb43"
format_stamp: "Formatted at 2026-08-08 11:31:43 on dist-test-slave-zkpd"
server_key: "181cb7eb0b09d3391cb09194ca20982f"
server_key_iv: "fb037bf12c9873c293ecb4f6cf470506"
server_key_version: "encryptionkey@0"
I20260808 11:31:43.869679 31554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance:
uuid: "f228ec821b764a288078925e1ad6bb43"
format_stamp: "Formatted at 2026-08-08 11:31:43 on dist-test-slave-zkpd"
server_key: "181cb7eb0b09d3391cb09194ca20982f"
server_key_iv: "fb037bf12c9873c293ecb4f6cf470506"
server_key_version: "encryptionkey@0"
I20260808 11:31:43.874822 31554 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 11:31:43.878257 31568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:43.879559 31554 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 11:31:43.879745 31554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "f228ec821b764a288078925e1ad6bb43"
format_stamp: "Formatted at 2026-08-08 11:31:43 on dist-test-slave-zkpd"
server_key: "181cb7eb0b09d3391cb09194ca20982f"
server_key_iv: "fb037bf12c9873c293ecb4f6cf470506"
server_key_version: "encryptionkey@0"
I20260808 11:31:43.880015 31554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:43.894410 31554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:43.898947 31554 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:43.899228 31554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:43.900239 31554 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:31:43.901659 31554 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:43.901777 31554 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:43.901923 31554 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:43.902012 31554 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:43.922914 31407 heartbeater.cc:503] Master 127.26.66.190:40653 was elected leader, sending a full tablet report...
I20260808 11:31:43.944967 31554 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:42199
I20260808 11:31:43.945037 31685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:42199 every 8 connection(s)
I20260808 11:31:43.945827 31554 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:31:43.955574 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 31554
I20260808 11:31:43.955757 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance
I20260808 11:31:43.956334 26890 external_mini_cluster.cc:1428] Setting key 32369dc12123f913369abbbee00ab205
Aug 08 11:31:43 dist-test-slave-zkpd krb5kdc[31166](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188703, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:43.966084 31550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:43.949481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:53893 (local address 127.26.66.190:40653)
0808 11:31:43.949672 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:43.949679 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:43.949863 (+ 184us) server_negotiation.cc:407] Connection header received
0808 11:31:43.951683 (+ 1820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:43.951688 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:43.951769 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:43.951861 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:43.953527 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:43.954273 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:43.956172 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:43.956626 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:43.956720 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:43.960861 (+ 4141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:43.960866 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:43.960869 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:43.960902 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:43.963409 (+ 2507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:43.964138 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:43.964142 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:43.964144 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:43.964328 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:43.964684 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:43.964688 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:43.964690 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:43.964953 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:43.965082 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:43.965674 (+ 592us) server_negotiation.cc:299] Negotiation successful
0808 11:31:43.965849 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 11:31:43.967017 31688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:43.949007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:40653 (local address 127.26.66.131:53893)
0808 11:31:43.949704 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:43.949743 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:43.951427 (+ 1684us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:43.952120 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:43.952128 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:43.952637 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:43.953356 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:43.953377 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:43.954403 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:43.954407 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:43.956035 (+ 1628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:43.956050 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:43.956860 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:43.956869 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:43.957133 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:43.957932 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:43.957969 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:43.960669 (+ 2700us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:43.963532 (+ 2863us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:43.963539 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:43.963549 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:43.964028 (+ 479us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:43.964419 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:43.964423 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:43.964425 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:43.964588 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:43.965077 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:43.965082 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:43.965368 (+ 286us) client_negotiation.cc:769] Sending connection context
0808 11:31:43.965576 (+ 208us) client_negotiation.cc:240] Negotiation successful
0808 11:31:43.965925 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":474,"threads_started":1}
I20260808 11:31:43.968442 31686 heartbeater.cc:347] Connected to a master server at 127.26.66.190:40653
I20260808 11:31:43.968724 31686 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:43.969373 31686 heartbeater.cc:511] Master 127.26.66.190:40653 requested a full tablet report, sending...
I20260808 11:31:43.970903 31212 ts_manager.cc:194] Registered new tserver with Master: f228ec821b764a288078925e1ad6bb43 (127.26.66.131:42199)
I20260808 11:31:43.971951 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 11:31:43.971989 31212 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.131@KRBTEST.COM'} at 127.26.66.131:53893
I20260808 11:31:43.989828 31550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:43.977247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57456 (local address 127.26.66.190:40653)
0808 11:31:43.977427 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:43.977431 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:43.977957 (+ 526us) server_negotiation.cc:407] Connection header received
0808 11:31:43.978087 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:43.978090 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:43.978146 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:43.978224 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:43.979660 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:43.980453 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:43.981638 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:43.982013 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:43.982142 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:43.984828 (+ 2686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:43.984832 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:43.984835 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:43.984864 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:43.987188 (+ 2324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:43.987822 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:43.987827 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:43.987831 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:43.988007 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:43.988372 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:43.988380 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:43.988384 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:43.988685 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:43.988954 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:43.989270 (+ 316us) server_negotiation.cc:299] Negotiation successful
0808 11:31:43.989477 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 11:31:43.993489 31212 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57456:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 11:31:44.000438 31212 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:31:44.026399 31703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:44.014741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59632 (local address 127.26.66.129:46407)
0808 11:31:44.015987 (+ 1246us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:44.015999 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:44.017081 (+ 1082us) server_negotiation.cc:407] Connection header received
0808 11:31:44.017220 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:44.017232 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:44.017495 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:44.017692 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:31:44.018928 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.020526 (+ 1598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.023273 (+ 2747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.024886 (+ 1613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.025018 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:44.025203 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:44.025829 (+ 626us) server_negotiation.cc:299] Negotiation successful
0808 11:31:44.026003 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1011,"thread_start_us":816,"threads_started":1}
I20260808 11:31:44.026932 31702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:44.012823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:37051 (local address 127.0.0.1:49798)
0808 11:31:44.015052 (+ 2229us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:44.015076 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:44.015246 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:44.016102 (+ 856us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:44.016111 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:44.016147 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:31:44.016702 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:44.017496 (+ 794us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.020045 (+ 2549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.020051 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:44.023877 (+ 3826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:44.023914 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.025537 (+ 1623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.025542 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:44.025768 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:44.025796 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 11:31:44.025872 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 11:31:44.025973 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2069,"mutex_wait_us":200,"thread_start_us":3635,"threads_started":1}
I20260808 11:31:44.027047 31701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:44.013499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49798 (local address 127.26.66.130:37051)
0808 11:31:44.014996 (+ 1497us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:44.015009 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:44.015198 (+ 189us) server_negotiation.cc:407] Connection header received
0808 11:31:44.015435 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:44.015445 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:44.015707 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:44.017704 (+ 1997us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:31:44.017989 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.019797 (+ 1808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.024092 (+ 4295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.025310 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.025469 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:44.025645 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:44.026488 (+ 843us) server_negotiation.cc:299] Negotiation successful
0808 11:31:44.026663 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":361,"threads_started":1}
I20260808 11:31:44.027506 31698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:44.012407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:42199 (local address 127.0.0.1:48416)
0808 11:31:44.013246 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:44.013306 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:44.013528 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:44.020050 (+ 6522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:44.020055 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:44.020083 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:31:44.020564 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:44.020576 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.022398 (+ 1822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.022404 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:44.024782 (+ 2378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:44.024798 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.026670 (+ 1872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.026676 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:44.026845 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:44.026872 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 11:31:44.026933 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 11:31:44.027077 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"mutex_wait_us":25,"thread_start_us":316,"threads_started":1}
I20260808 11:31:44.028702 31699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:44.012639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48416 (local address 127.26.66.131:42199)
0808 11:31:44.019015 (+ 6376us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:44.019023 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:44.019090 (+ 67us) server_negotiation.cc:407] Connection header received
0808 11:31:44.019257 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:44.019265 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:44.019818 (+ 553us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:44.020790 (+ 972us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:31:44.021093 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.022252 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.024990 (+ 2738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.026424 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.027928 (+ 1504us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:44.028141 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:44.028195 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 11:31:44.028355 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6200,"thread_start_us":6000,"threads_started":1}
I20260808 11:31:44.031204 31480 tablet_service.cc:1467] Processing CreateTablet for tablet 014bbee201ca4eef8bb19964cf488d58 (DEFAULT_TABLE table=test-table [id=54869bc42a804d08b26e515cb81068ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:31:44.026471 31700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:44.014414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:46407 (local address 127.0.0.1:59632)
0808 11:31:44.016760 (+ 2346us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:44.016779 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:44.016933 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:44.017744 (+ 811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:44.017751 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:44.017776 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:31:44.018372 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:44.018386 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.020702 (+ 2316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.020709 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:44.023049 (+ 2340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:44.023071 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.025318 (+ 2247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.025322 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:44.025538 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:44.025618 (+ 80us) client_negotiation.cc:769] Sending connection context
0808 11:31:44.025756 (+ 138us) client_negotiation.cc:240] Negotiation successful
0808 11:31:44.025956 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2213,"mutex_wait_us":27,"thread_start_us":304,"threads_started":1}
I20260808 11:31:44.032181 31618 tablet_service.cc:1467] Processing CreateTablet for tablet 014bbee201ca4eef8bb19964cf488d58 (DEFAULT_TABLE table=test-table [id=54869bc42a804d08b26e515cb81068ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:31:44.032837 31480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 014bbee201ca4eef8bb19964cf488d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:44.034042 31618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 014bbee201ca4eef8bb19964cf488d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:44.035051 31339 tablet_service.cc:1467] Processing CreateTablet for tablet 014bbee201ca4eef8bb19964cf488d58 (DEFAULT_TABLE table=test-table [id=54869bc42a804d08b26e515cb81068ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:31:44.036216 31339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 014bbee201ca4eef8bb19964cf488d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:44.046913 31704 tablet_bootstrap.cc:492] T 014bbee201ca4eef8bb19964cf488d58 P 6eae8ae4bde740f5a6123b3dfae3c3a3: Bootstrap starting.
I20260808 11:31:44.049036 31705 tablet_bootstrap.cc:492] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1: Bootstrap starting.
I20260808 11:31:44.050668 31706 tablet_bootstrap.cc:492] T 014bbee201ca4eef8bb19964cf488d58 P f228ec821b764a288078925e1ad6bb43: Bootstrap starting.
I20260808 11:31:44.050768 31704 tablet_bootstrap.cc:654] T 014bbee201ca4eef8bb19964cf488d58 P 6eae8ae4bde740f5a6123b3dfae3c3a3: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:44.052529 31704 log.cc:824] T 014bbee201ca4eef8bb19964cf488d58 P 6eae8ae4bde740f5a6123b3dfae3c3a3: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:44.053587 31705 tablet_bootstrap.cc:654] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:44.053826 31706 tablet_bootstrap.cc:654] T 014bbee201ca4eef8bb19964cf488d58 P f228ec821b764a288078925e1ad6bb43: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:44.054931 31705 log.cc:824] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:44.055013 31706 log.cc:824] T 014bbee201ca4eef8bb19964cf488d58 P f228ec821b764a288078925e1ad6bb43: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:44.056134 31704 tablet_bootstrap.cc:492] T 014bbee201ca4eef8bb19964cf488d58 P 6eae8ae4bde740f5a6123b3dfae3c3a3: No bootstrap required, opened a new log
I20260808 11:31:44.056444 31704 ts_tablet_manager.cc:1397] T 014bbee201ca4eef8bb19964cf488d58 P 6eae8ae4bde740f5a6123b3dfae3c3a3: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260808 11:31:44.057920 31706 tablet_bootstrap.cc:492] T 014bbee201ca4eef8bb19964cf488d58 P f228ec821b764a288078925e1ad6bb43: No bootstrap required, opened a new log
I20260808 11:31:44.058243 31706 ts_tablet_manager.cc:1397] T 014bbee201ca4eef8bb19964cf488d58 P f228ec821b764a288078925e1ad6bb43: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260808 11:31:44.058486 31705 tablet_bootstrap.cc:492] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1: No bootstrap required, opened a new log
I20260808 11:31:44.058740 31705 ts_tablet_manager.cc:1397] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260808 11:31:44.066414 31706 raft_consensus.cc:348] T 014bbee201ca4eef8bb19964cf488d58 P f228ec821b764a288078925e1ad6bb43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f228ec821b764a288078925e1ad6bb43" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 42199 } } peers { permanent_uuid: "3f8176f857e64960888419a74f3ef8d1" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 37051 } } peers { permanent_uuid: "6eae8ae4bde740f5a6123b3dfae3c3a3" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 46407 } }
I20260808 11:31:44.066886 31706 raft_consensus.cc:374] T 014bbee201ca4eef8bb19964cf488d58 P f228ec821b764a288078925e1ad6bb43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:44.067005 31706 raft_consensus.cc:729] T 014bbee201ca4eef8bb19964cf488d58 P f228ec821b764a288078925e1ad6bb43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f228ec821b764a288078925e1ad6bb43, State: Initialized, Role: FOLLOWER
I20260808 11:31:44.067667 31706 consensus_queue.cc:260] T 014bbee201ca4eef8bb19964cf488d58 P f228ec821b764a288078925e1ad6bb43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f228ec821b764a288078925e1ad6bb43" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 42199 } } peers { permanent_uuid: "3f8176f857e64960888419a74f3ef8d1" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 37051 } } peers { permanent_uuid: "6eae8ae4bde740f5a6123b3dfae3c3a3" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 46407 } }
I20260808 11:31:44.067552 31704 raft_consensus.cc:348] T 014bbee201ca4eef8bb19964cf488d58 P 6eae8ae4bde740f5a6123b3dfae3c3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f228ec821b764a288078925e1ad6bb43" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 42199 } } peers { permanent_uuid: "3f8176f857e64960888419a74f3ef8d1" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 37051 } } peers { permanent_uuid: "6eae8ae4bde740f5a6123b3dfae3c3a3" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 46407 } }
I20260808 11:31:44.068048 31704 raft_consensus.cc:374] T 014bbee201ca4eef8bb19964cf488d58 P 6eae8ae4bde740f5a6123b3dfae3c3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:44.068241 31704 raft_consensus.cc:729] T 014bbee201ca4eef8bb19964cf488d58 P 6eae8ae4bde740f5a6123b3dfae3c3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6eae8ae4bde740f5a6123b3dfae3c3a3, State: Initialized, Role: FOLLOWER
I20260808 11:31:44.068923 31686 heartbeater.cc:503] Master 127.26.66.190:40653 was elected leader, sending a full tablet report...
I20260808 11:31:44.068998 31704 consensus_queue.cc:260] T 014bbee201ca4eef8bb19964cf488d58 P 6eae8ae4bde740f5a6123b3dfae3c3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f228ec821b764a288078925e1ad6bb43" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 42199 } } peers { permanent_uuid: "3f8176f857e64960888419a74f3ef8d1" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 37051 } } peers { permanent_uuid: "6eae8ae4bde740f5a6123b3dfae3c3a3" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 46407 } }
I20260808 11:31:44.069737 31706 ts_tablet_manager.cc:1428] T 014bbee201ca4eef8bb19964cf488d58 P f228ec821b764a288078925e1ad6bb43: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260808 11:31:44.069566 31705 raft_consensus.cc:348] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f228ec821b764a288078925e1ad6bb43" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 42199 } } peers { permanent_uuid: "3f8176f857e64960888419a74f3ef8d1" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 37051 } } peers { permanent_uuid: "6eae8ae4bde740f5a6123b3dfae3c3a3" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 46407 } }
I20260808 11:31:44.070111 31705 raft_consensus.cc:374] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:44.070230 31705 raft_consensus.cc:729] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f8176f857e64960888419a74f3ef8d1, State: Initialized, Role: FOLLOWER
I20260808 11:31:44.070993 31705 consensus_queue.cc:260] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f228ec821b764a288078925e1ad6bb43" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 42199 } } peers { permanent_uuid: "3f8176f857e64960888419a74f3ef8d1" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 37051 } } peers { permanent_uuid: "6eae8ae4bde740f5a6123b3dfae3c3a3" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 46407 } }
I20260808 11:31:44.072439 31548 heartbeater.cc:503] Master 127.26.66.190:40653 was elected leader, sending a full tablet report...
I20260808 11:31:44.075042 31705 ts_tablet_manager.cc:1428] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1: Time spent starting tablet: real 0.016s user 0.016s sys 0.000s
I20260808 11:31:44.076895 31704 ts_tablet_manager.cc:1428] T 014bbee201ca4eef8bb19964cf488d58 P 6eae8ae4bde740f5a6123b3dfae3c3a3: Time spent starting tablet: real 0.020s user 0.011s sys 0.008s
W20260808 11:31:44.141132 31408 tablet.cc:2369] T 014bbee201ca4eef8bb19964cf488d58 P 6eae8ae4bde740f5a6123b3dfae3c3a3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:31:44.146641 31712 raft_consensus.cc:482] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:31:44.147001 31712 raft_consensus.cc:504] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f228ec821b764a288078925e1ad6bb43" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 42199 } } peers { permanent_uuid: "3f8176f857e64960888419a74f3ef8d1" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 37051 } } peers { permanent_uuid: "6eae8ae4bde740f5a6123b3dfae3c3a3" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 46407 } }
I20260808 11:31:44.148864 31712 leader_election.cc:288] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f228ec821b764a288078925e1ad6bb43 (127.26.66.131:42199), 6eae8ae4bde740f5a6123b3dfae3c3a3 (127.26.66.129:46407)
I20260808 11:31:44.155912 31703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:44.149553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:37673 (local address 127.26.66.129:46407)
0808 11:31:44.149811 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:44.149819 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:44.150401 (+ 582us) server_negotiation.cc:407] Connection header received
0808 11:31:44.150551 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:44.150554 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:44.150658 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:44.150761 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:31:44.151404 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.152232 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.154059 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.154865 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.155020 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:44.155116 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:44.155499 (+ 383us) server_negotiation.cc:299] Negotiation successful
0808 11:31:44.155627 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 11:31:44.155916 31699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:44.149304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:40495 (local address 127.26.66.131:42199)
0808 11:31:44.149521 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:44.149530 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:44.150221 (+ 691us) server_negotiation.cc:407] Connection header received
0808 11:31:44.150406 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:44.150412 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:44.150509 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:44.150596 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:31:44.151258 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.152155 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.154110 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.154888 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.155088 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:44.155163 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:44.155473 (+ 310us) server_negotiation.cc:299] Negotiation successful
0808 11:31:44.155606 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 11:31:44.156095 31714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:44.149078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:42199 (local address 127.26.66.130:40495)
0808 11:31:44.150100 (+ 1022us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:44.150116 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:44.150248 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:44.150639 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:44.150644 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:44.150670 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:31:44.151103 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:44.151114 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.152298 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.152306 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:44.153932 (+ 1626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:44.153944 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.155153 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.155165 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:44.155314 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:44.155338 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 11:31:44.155434 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 11:31:44.155570 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":900,"mutex_wait_us":103,"thread_start_us":432,"threads_started":1}
I20260808 11:31:44.156124 31713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:44.149137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:46407 (local address 127.26.66.130:37673)
0808 11:31:44.150200 (+ 1063us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:44.150242 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:44.150427 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:44.150791 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:44.150795 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:44.150824 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:31:44.151242 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:44.151255 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.152395 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.152398 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:44.153891 (+ 1493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:44.153904 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.155114 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.155121 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:44.155319 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:44.155342 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 11:31:44.155454 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 11:31:44.155577 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":948,"mutex_wait_us":21,"thread_start_us":660,"threads_started":1}
I20260808 11:31:44.157418 31639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "014bbee201ca4eef8bb19964cf488d58" candidate_uuid: "3f8176f857e64960888419a74f3ef8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f228ec821b764a288078925e1ad6bb43" is_pre_election: true
I20260808 11:31:44.157418 31360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "014bbee201ca4eef8bb19964cf488d58" candidate_uuid: "3f8176f857e64960888419a74f3ef8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6eae8ae4bde740f5a6123b3dfae3c3a3" is_pre_election: true
I20260808 11:31:44.158049 31360 raft_consensus.cc:2454] T 014bbee201ca4eef8bb19964cf488d58 P 6eae8ae4bde740f5a6123b3dfae3c3a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f8176f857e64960888419a74f3ef8d1 in term 0.
I20260808 11:31:44.158041 31639 raft_consensus.cc:2454] T 014bbee201ca4eef8bb19964cf488d58 P f228ec821b764a288078925e1ad6bb43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f8176f857e64960888419a74f3ef8d1 in term 0.
I20260808 11:31:44.158842 31433 leader_election.cc:302] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f8176f857e64960888419a74f3ef8d1, 6eae8ae4bde740f5a6123b3dfae3c3a3; no voters:
I20260808 11:31:44.159294 31712 raft_consensus.cc:2781] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:31:44.159449 31712 raft_consensus.cc:482] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:31:44.159559 31712 raft_consensus.cc:3037] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:44.161935 31712 raft_consensus.cc:504] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f228ec821b764a288078925e1ad6bb43" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 42199 } } peers { permanent_uuid: "3f8176f857e64960888419a74f3ef8d1" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 37051 } } peers { permanent_uuid: "6eae8ae4bde740f5a6123b3dfae3c3a3" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 46407 } }
I20260808 11:31:44.162515 31712 leader_election.cc:288] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1 [CANDIDATE]: Term 1 election: Requested vote from peers f228ec821b764a288078925e1ad6bb43 (127.26.66.131:42199), 6eae8ae4bde740f5a6123b3dfae3c3a3 (127.26.66.129:46407)
I20260808 11:31:44.162995 31360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "014bbee201ca4eef8bb19964cf488d58" candidate_uuid: "3f8176f857e64960888419a74f3ef8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6eae8ae4bde740f5a6123b3dfae3c3a3"
I20260808 11:31:44.162982 31639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "014bbee201ca4eef8bb19964cf488d58" candidate_uuid: "3f8176f857e64960888419a74f3ef8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f228ec821b764a288078925e1ad6bb43"
I20260808 11:31:44.163187 31360 raft_consensus.cc:3037] T 014bbee201ca4eef8bb19964cf488d58 P 6eae8ae4bde740f5a6123b3dfae3c3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:44.163261 31639 raft_consensus.cc:3037] T 014bbee201ca4eef8bb19964cf488d58 P f228ec821b764a288078925e1ad6bb43 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:44.165627 31360 raft_consensus.cc:2454] T 014bbee201ca4eef8bb19964cf488d58 P 6eae8ae4bde740f5a6123b3dfae3c3a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f8176f857e64960888419a74f3ef8d1 in term 1.
I20260808 11:31:44.165920 31639 raft_consensus.cc:2454] T 014bbee201ca4eef8bb19964cf488d58 P f228ec821b764a288078925e1ad6bb43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f8176f857e64960888419a74f3ef8d1 in term 1.
I20260808 11:31:44.166085 31433 leader_election.cc:302] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f8176f857e64960888419a74f3ef8d1, 6eae8ae4bde740f5a6123b3dfae3c3a3; no voters:
I20260808 11:31:44.166414 31712 raft_consensus.cc:2781] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:31:44.166925 31712 raft_consensus.cc:686] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1 [term 1 LEADER]: Becoming Leader. State: Replica: 3f8176f857e64960888419a74f3ef8d1, State: Running, Role: LEADER
I20260808 11:31:44.167439 31712 consensus_queue.cc:237] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f228ec821b764a288078925e1ad6bb43" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 42199 } } peers { permanent_uuid: "3f8176f857e64960888419a74f3ef8d1" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 37051 } } peers { permanent_uuid: "6eae8ae4bde740f5a6123b3dfae3c3a3" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 46407 } }
I20260808 11:31:44.172600 31211 catalog_manager.cc:5495] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f8176f857e64960888419a74f3ef8d1 (127.26.66.130). New cstate: current_term: 1 leader_uuid: "3f8176f857e64960888419a74f3ef8d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f228ec821b764a288078925e1ad6bb43" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 42199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f8176f857e64960888419a74f3ef8d1" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 37051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6eae8ae4bde740f5a6123b3dfae3c3a3" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 46407 } health_report { overall_health: UNKNOWN } } }
W20260808 11:31:44.179369 31549 tablet.cc:2369] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 11:31:44.197268 31687 tablet.cc:2369] T 014bbee201ca4eef8bb19964cf488d58 P f228ec821b764a288078925e1ad6bb43: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:31:44.219158 31701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:44.214137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49806 (local address 127.26.66.130:37051)
0808 11:31:44.214332 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:44.214337 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:44.214355 (+ 18us) server_negotiation.cc:407] Connection header received
0808 11:31:44.214525 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:44.214529 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:44.214615 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:44.214752 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:31:44.215110 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.215830 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.217146 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.217543 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.217635 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:44.218092 (+ 457us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:31:44.218659 (+ 567us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:31:44.218781 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:44.218881 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 11:31:44.218946 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 11:31:44.227375 31639 raft_consensus.cc:1261] T 014bbee201ca4eef8bb19964cf488d58 P f228ec821b764a288078925e1ad6bb43 [term 1 FOLLOWER]: Refusing update from remote peer 3f8176f857e64960888419a74f3ef8d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:31:44.227412 31360 raft_consensus.cc:1261] T 014bbee201ca4eef8bb19964cf488d58 P 6eae8ae4bde740f5a6123b3dfae3c3a3 [term 1 FOLLOWER]: Refusing update from remote peer 3f8176f857e64960888419a74f3ef8d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:31:44.228485 31715 consensus_queue.cc:1035] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f228ec821b764a288078925e1ad6bb43" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 42199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:31:44.228881 31712 consensus_queue.cc:1035] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6eae8ae4bde740f5a6123b3dfae3c3a3" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 46407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:31:44.240880 31718 mvcc.cc:205] Tried to move back new op lower bound from 7316228932505112576 to 7316228932274593792. Current Snapshot: MvccSnapshot[applied={T|T < 7316228932505112576}]
I20260808 11:31:44.261957 31212 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57456:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:31:44.262259 31212 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57456:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:31:44.266404 31212 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2151d55f336c4ca7b8ea96b1f3c108b0: Sending DeleteTablet for 3 replicas of tablet 014bbee201ca4eef8bb19964cf488d58
I20260808 11:31:44.268074 31339 tablet_service.cc:1514] Processing DeleteTablet for tablet 014bbee201ca4eef8bb19964cf488d58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:31:44 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:59632
I20260808 11:31:44.268097 31618 tablet_service.cc:1514] Processing DeleteTablet for tablet 014bbee201ca4eef8bb19964cf488d58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:31:44 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:48416
I20260808 11:31:44.269425 31480 tablet_service.cc:1514] Processing DeleteTablet for tablet 014bbee201ca4eef8bb19964cf488d58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:31:44 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:49798
I20260808 11:31:44.275069 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 31274
I20260808 11:31:44.276527 31730 tablet_replica.cc:330] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1: stopping tablet replica
I20260808 11:31:44.277202 31730 raft_consensus.cc:2229] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1 [term 1 LEADER]: Raft consensus shutting down.
I20260808 11:31:44.278152 31730 raft_consensus.cc:2258] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:31:44.278811 31728 tablet_replica.cc:330] T 014bbee201ca4eef8bb19964cf488d58 P 6eae8ae4bde740f5a6123b3dfae3c3a3: stopping tablet replica
I20260808 11:31:44.279171 31728 raft_consensus.cc:2229] T 014bbee201ca4eef8bb19964cf488d58 P 6eae8ae4bde740f5a6123b3dfae3c3a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:31:44.279598 31728 raft_consensus.cc:2258] T 014bbee201ca4eef8bb19964cf488d58 P 6eae8ae4bde740f5a6123b3dfae3c3a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:31:44.284482 31729 tablet_replica.cc:330] T 014bbee201ca4eef8bb19964cf488d58 P f228ec821b764a288078925e1ad6bb43: stopping tablet replica
I20260808 11:31:44.284960 31729 raft_consensus.cc:2229] T 014bbee201ca4eef8bb19964cf488d58 P f228ec821b764a288078925e1ad6bb43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:31:44.285488 31728 ts_tablet_manager.cc:1905] T 014bbee201ca4eef8bb19964cf488d58 P 6eae8ae4bde740f5a6123b3dfae3c3a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:31:44.285502 31730 ts_tablet_manager.cc:1905] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:31:44.285521 31729 raft_consensus.cc:2258] T 014bbee201ca4eef8bb19964cf488d58 P f228ec821b764a288078925e1ad6bb43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:31:44.287540 31729 ts_tablet_manager.cc:1905] T 014bbee201ca4eef8bb19964cf488d58 P f228ec821b764a288078925e1ad6bb43: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:31:44.292877 31728 ts_tablet_manager.cc:1918] T 014bbee201ca4eef8bb19964cf488d58 P 6eae8ae4bde740f5a6123b3dfae3c3a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:31:44.293102 31728 log.cc:1196] T 014bbee201ca4eef8bb19964cf488d58 P 6eae8ae4bde740f5a6123b3dfae3c3a3: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-0/wal/wals/014bbee201ca4eef8bb19964cf488d58
I20260808 11:31:44.293743 31728 ts_tablet_manager.cc:1939] T 014bbee201ca4eef8bb19964cf488d58 P 6eae8ae4bde740f5a6123b3dfae3c3a3: Deleting consensus metadata
I20260808 11:31:44.293717 31730 ts_tablet_manager.cc:1918] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:31:44.293885 31730 log.cc:1196] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-1/wal/wals/014bbee201ca4eef8bb19964cf488d58
I20260808 11:31:44.294667 31730 ts_tablet_manager.cc:1939] T 014bbee201ca4eef8bb19964cf488d58 P 3f8176f857e64960888419a74f3ef8d1: Deleting consensus metadata
I20260808 11:31:44.295094 31729 ts_tablet_manager.cc:1918] T 014bbee201ca4eef8bb19964cf488d58 P f228ec821b764a288078925e1ad6bb43: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:31:44.295322 31729 log.cc:1196] T 014bbee201ca4eef8bb19964cf488d58 P f228ec821b764a288078925e1ad6bb43: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786188664137852-26890-0/minicluster-data/ts-2/wal/wals/014bbee201ca4eef8bb19964cf488d58
I20260808 11:31:44.295828 31199 catalog_manager.cc:4841] TS 6eae8ae4bde740f5a6123b3dfae3c3a3 (127.26.66.129:46407): tablet 014bbee201ca4eef8bb19964cf488d58 (table test-table [id=54869bc42a804d08b26e515cb81068ff]) successfully deleted
I20260808 11:31:44.295984 31729 ts_tablet_manager.cc:1939] T 014bbee201ca4eef8bb19964cf488d58 P f228ec821b764a288078925e1ad6bb43: Deleting consensus metadata
I20260808 11:31:44.296577 31198 catalog_manager.cc:4841] TS 3f8176f857e64960888419a74f3ef8d1 (127.26.66.130:37051): tablet 014bbee201ca4eef8bb19964cf488d58 (table test-table [id=54869bc42a804d08b26e515cb81068ff]) successfully deleted
I20260808 11:31:44.297660 31197 catalog_manager.cc:4841] TS f228ec821b764a288078925e1ad6bb43 (127.26.66.131:42199): tablet 014bbee201ca4eef8bb19964cf488d58 (table test-table [id=54869bc42a804d08b26e515cb81068ff]) successfully deleted
Aug 08 11:31:44 dist-test-slave-zkpd krb5kdc[31166](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.129@KRBTEST.COM
I20260808 11:31:44.313652 31703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:44.278437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59638 (local address 127.26.66.129:46407)
0808 11:31:44.278698 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:44.278707 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:44.292125 (+ 13418us) server_negotiation.cc:407] Connection header received
0808 11:31:44.296594 (+ 4469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:44.296600 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:44.296684 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:44.296760 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:44.298560 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.299802 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.301219 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.301885 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.302021 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:44.306223 (+ 4202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:44.306242 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:44.306262 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:44.306310 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:44.310289 (+ 3979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:44.311091 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:44.311103 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:44.311107 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:44.311309 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:44.311769 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:44.311775 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:44.311779 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:44.312343 (+ 564us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:44.312696 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:44.312993 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 11:31:44.313244 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 11:31:44.314429 31402 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:44.407749 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 31274
I20260808 11:31:44.429407 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 31413
Aug 08 11:31:44 dist-test-slave-zkpd krb5kdc[31166](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.130@KRBTEST.COM
I20260808 11:31:44.445351 31701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:44.430191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49810 (local address 127.26.66.130:37051)
0808 11:31:44.430398 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:44.430404 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:44.430558 (+ 154us) server_negotiation.cc:407] Connection header received
0808 11:31:44.430777 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:44.430781 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:44.430860 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:44.430975 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:44.432273 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.433172 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.434454 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.434892 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.435031 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:44.439134 (+ 4103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:44.439149 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:44.439162 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:44.439200 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:44.442357 (+ 3157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:44.443055 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:44.443063 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:44.443065 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:44.443213 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:44.443598 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:44.443603 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:44.443608 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:44.444061 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:44.444475 (+ 414us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:44.444685 (+ 210us) server_negotiation.cc:299] Negotiation successful
0808 11:31:44.444941 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 11:31:44.446077 31543 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:44.563338 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 31413
I20260808 11:31:44.587507 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 31554
Aug 08 11:31:44 dist-test-slave-zkpd krb5kdc[31166](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.131@KRBTEST.COM
I20260808 11:31:44.602906 31699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:44.588332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48426 (local address 127.26.66.131:42199)
0808 11:31:44.588522 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:44.588528 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:44.588578 (+ 50us) server_negotiation.cc:407] Connection header received
0808 11:31:44.588820 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:44.588825 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:44.588891 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:44.589003 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:44.590385 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.591181 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.592597 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:44.592985 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:44.593082 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:44.597310 (+ 4228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:44.597334 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:44.597351 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:44.597391 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:44.600379 (+ 2988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:44.600944 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:44.600951 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:44.600953 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:44.601086 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:44.601475 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:44.601479 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:44.601481 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:44.601886 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:44.602109 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:44.602402 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 11:31:44.602577 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 11:31:44.603577 31681 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:44.692787 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 31554
I20260808 11:31:44.714201 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 31180
I20260808 11:31:44.715404 31242 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:44.830875 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 31180
2026-08-08T11:31:44Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4425 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T11:31:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:31:44Z Disabled control of system clock
I20260808 11:31:44.922732 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:44943
--webserver_interface=127.26.66.190
--webserver_port=0
--builtin_ntp_servers=127.26.66.148:46365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:44943
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 11:31:45.255227 31739 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:45.255487 31739 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:45.255625 31739 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:45.263089 31739 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:31:45.263188 31739 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:45.263270 31739 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:45.263372 31739 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:31:45.263449 31739 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:31:45.272840 31739 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:46365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:44943
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:44943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:45.274140 31739 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:45.275933 31739 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:45.287549 31744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:45.287636 31745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:45.287592 31747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:45.289064 31739 server_base.cc:1034] running on GCE node
I20260808 11:31:45.289808 31739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:45.291096 31739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:45.292297 31739 hybrid_clock.cc:648] HybridClock initialized: now 1786188705292255 us; error 29 us; skew 500 ppm
I20260808 11:31:45.292646 31739 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:31:45.294852 31739 webserver.cc:460] Webserver started at http://127.26.66.190:44139/ using document root <none> and password file <none>
I20260808 11:31:45.295557 31739 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:45.295678 31739 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:45.296085 31739 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:45.298998 31739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "e3af91eb8daf4934be67cc83cfaebd35"
format_stamp: "Formatted at 2026-08-08 11:31:45 on dist-test-slave-zkpd"
server_key: "155d3294cea29291ef6bb50413cacd73"
server_key_iv: "07eec337237dc67ab314b653a2ea9782"
server_key_version: "encryptionkey@0"
I20260808 11:31:45.299806 31739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "e3af91eb8daf4934be67cc83cfaebd35"
format_stamp: "Formatted at 2026-08-08 11:31:45 on dist-test-slave-zkpd"
server_key: "155d3294cea29291ef6bb50413cacd73"
server_key_iv: "07eec337237dc67ab314b653a2ea9782"
server_key_version: "encryptionkey@0"
I20260808 11:31:45.304996 31739 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 11:31:45.308282 31754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:45.309520 31739 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 11:31:45.309698 31739 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "e3af91eb8daf4934be67cc83cfaebd35"
format_stamp: "Formatted at 2026-08-08 11:31:45 on dist-test-slave-zkpd"
server_key: "155d3294cea29291ef6bb50413cacd73"
server_key_iv: "07eec337237dc67ab314b653a2ea9782"
server_key_version: "encryptionkey@0"
I20260808 11:31:45.309928 31739 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:45.315469 31739 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:45.316355 31739 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:45.316665 31739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:45.335264 31739 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:44943
I20260808 11:31:45.335311 31808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:44943 every 8 connection(s)
I20260808 11:31:45.336611 31739 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:31:45.340350 31809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:45.342907 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 31739
I20260808 11:31:45.343132 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:31:45.344010 26890 external_mini_cluster.cc:1428] Setting key 3f7718bee488b8bbc5419f2e39e0e759
I20260808 11:31:45.352738 31812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:45.346246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35244 (local address 127.26.66.190:44943)
0808 11:31:45.347286 (+ 1040us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:45.347297 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:45.347347 (+ 50us) server_negotiation.cc:407] Connection header received
0808 11:31:45.349095 (+ 1748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:45.349117 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:45.349534 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:45.349936 (+ 402us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:45.351045 (+ 1109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:45.351051 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:45.351063 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:31:45.351085 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:45.351149 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:31:45.351165 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:45.351451 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:45.351590 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 11:31:45.351826 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":621,"thread_start_us":386,"threads_started":1}
I20260808 11:31:45.353397 31809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3af91eb8daf4934be67cc83cfaebd35: Bootstrap starting.
I20260808 11:31:45.356568 31809 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e3af91eb8daf4934be67cc83cfaebd35: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:45.357582 31809 log.cc:824] T 00000000000000000000000000000000 P e3af91eb8daf4934be67cc83cfaebd35: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:45.360400 31809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3af91eb8daf4934be67cc83cfaebd35: No bootstrap required, opened a new log
I20260808 11:31:45.367873 31809 raft_consensus.cc:348] T 00000000000000000000000000000000 P e3af91eb8daf4934be67cc83cfaebd35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3af91eb8daf4934be67cc83cfaebd35" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 44943 } }
I20260808 11:31:45.368297 31809 raft_consensus.cc:374] T 00000000000000000000000000000000 P e3af91eb8daf4934be67cc83cfaebd35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:45.368418 31809 raft_consensus.cc:729] T 00000000000000000000000000000000 P e3af91eb8daf4934be67cc83cfaebd35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3af91eb8daf4934be67cc83cfaebd35, State: Initialized, Role: FOLLOWER
I20260808 11:31:45.369016 31809 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3af91eb8daf4934be67cc83cfaebd35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3af91eb8daf4934be67cc83cfaebd35" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 44943 } }
I20260808 11:31:45.369258 31809 raft_consensus.cc:388] T 00000000000000000000000000000000 P e3af91eb8daf4934be67cc83cfaebd35 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:31:45.369439 31809 raft_consensus.cc:482] T 00000000000000000000000000000000 P e3af91eb8daf4934be67cc83cfaebd35 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:31:45.369635 31809 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e3af91eb8daf4934be67cc83cfaebd35 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:45.371726 31809 raft_consensus.cc:504] T 00000000000000000000000000000000 P e3af91eb8daf4934be67cc83cfaebd35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3af91eb8daf4934be67cc83cfaebd35" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 44943 } }
I20260808 11:31:45.372262 31809 leader_election.cc:302] T 00000000000000000000000000000000 P e3af91eb8daf4934be67cc83cfaebd35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e3af91eb8daf4934be67cc83cfaebd35; no voters:
I20260808 11:31:45.372848 31809 leader_election.cc:288] T 00000000000000000000000000000000 P e3af91eb8daf4934be67cc83cfaebd35 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:31:45.372982 31814 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e3af91eb8daf4934be67cc83cfaebd35 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:31:45.373756 31814 raft_consensus.cc:686] T 00000000000000000000000000000000 P e3af91eb8daf4934be67cc83cfaebd35 [term 1 LEADER]: Becoming Leader. State: Replica: e3af91eb8daf4934be67cc83cfaebd35, State: Running, Role: LEADER
I20260808 11:31:45.374325 31814 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3af91eb8daf4934be67cc83cfaebd35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3af91eb8daf4934be67cc83cfaebd35" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 44943 } }
I20260808 11:31:45.374881 31809 sys_catalog.cc:564] T 00000000000000000000000000000000 P e3af91eb8daf4934be67cc83cfaebd35 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:31:45.377437 31816 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3af91eb8daf4934be67cc83cfaebd35 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3af91eb8daf4934be67cc83cfaebd35. Latest consensus state: current_term: 1 leader_uuid: "e3af91eb8daf4934be67cc83cfaebd35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3af91eb8daf4934be67cc83cfaebd35" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 44943 } } }
I20260808 11:31:45.377794 31816 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3af91eb8daf4934be67cc83cfaebd35 [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:45.378537 31815 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3af91eb8daf4934be67cc83cfaebd35 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e3af91eb8daf4934be67cc83cfaebd35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3af91eb8daf4934be67cc83cfaebd35" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 44943 } } }
I20260808 11:31:45.379065 31815 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3af91eb8daf4934be67cc83cfaebd35 [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:45.386765 31820 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:31:45.393160 31820 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:31:45.401582 31820 catalog_manager.cc:1347] Generated new cluster ID: 42b54e798ec9414d9f22a58ace136b23
I20260808 11:31:45.401683 31820 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:31:45.414019 31820 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:31:45.414412 31820 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:31:45.421082 31820 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e3af91eb8daf4934be67cc83cfaebd35: Generated new TSK 0
I20260808 11:31:45.421965 31820 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:31:45.436806 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:0
--local_ip_for_outbound_sockets=127.26.66.129
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:44943
--builtin_ntp_servers=127.26.66.148:46365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 11:31:45.779985 31833 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:45.780256 31833 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:45.780448 31833 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:45.787511 31833 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:45.787604 31833 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:45.787796 31833 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:31:45.797017 31833 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:46365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:44943
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:45.798244 31833 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:45.800113 31833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:45.813014 31841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:45.813097 31838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:45.813061 31839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:45.814092 31833 server_base.cc:1034] running on GCE node
I20260808 11:31:45.814678 31833 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:45.815510 31833 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:45.816707 31833 hybrid_clock.cc:648] HybridClock initialized: now 1786188705816655 us; error 43 us; skew 500 ppm
I20260808 11:31:45.817135 31833 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:31:45.819603 31833 webserver.cc:460] Webserver started at http://127.26.66.129:34023/ using document root <none> and password file <none>
I20260808 11:31:45.820339 31833 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:45.820430 31833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:45.820703 31833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:45.823325 31833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-0/data/instance:
uuid: "127e04c13b0d40298e0754868d76ed33"
format_stamp: "Formatted at 2026-08-08 11:31:45 on dist-test-slave-zkpd"
server_key: "f3f89878d3a7a8a59bd3c3738f9cfb6d"
server_key_iv: "997ac6b0c1c63a7760ff582343a7ae50"
server_key_version: "encryptionkey@0"
I20260808 11:31:45.824203 31833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance:
uuid: "127e04c13b0d40298e0754868d76ed33"
format_stamp: "Formatted at 2026-08-08 11:31:45 on dist-test-slave-zkpd"
server_key: "f3f89878d3a7a8a59bd3c3738f9cfb6d"
server_key_iv: "997ac6b0c1c63a7760ff582343a7ae50"
server_key_version: "encryptionkey@0"
I20260808 11:31:45.829124 31833 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260808 11:31:45.832371 31847 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:45.833650 31833 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 11:31:45.833843 31833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "127e04c13b0d40298e0754868d76ed33"
format_stamp: "Formatted at 2026-08-08 11:31:45 on dist-test-slave-zkpd"
server_key: "f3f89878d3a7a8a59bd3c3738f9cfb6d"
server_key_iv: "997ac6b0c1c63a7760ff582343a7ae50"
server_key_version: "encryptionkey@0"
I20260808 11:31:45.834056 31833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:45.839520 31833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:45.840392 31833 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:45.840654 31833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:45.841529 31833 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:31:45.842880 31833 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:45.842988 31833 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:45.843106 31833 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:45.843199 31833 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:45.878329 31833 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:36939
I20260808 11:31:45.878365 31964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:36939 every 8 connection(s)
I20260808 11:31:45.880053 31833 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:31:45.881574 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 31833
I20260808 11:31:45.881803 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance
I20260808 11:31:45.882601 26890 external_mini_cluster.cc:1428] Setting key d9d2b252f98d828fb1f9e959a5b6d147
I20260808 11:31:45.886111 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:0
--local_ip_for_outbound_sockets=127.26.66.130
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:44943
--builtin_ntp_servers=127.26.66.148:46365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 11:31:45.889513 31967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:45.883314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:51079 (local address 127.26.66.190:44943)
0808 11:31:45.883800 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:45.883806 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:45.885142 (+ 1336us) server_negotiation.cc:407] Connection header received
0808 11:31:45.887006 (+ 1864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:45.887011 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:45.887085 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:45.887202 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:45.888605 (+ 1403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:45.888610 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:45.888615 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:31:45.888634 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:45.888694 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:31:45.888706 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:45.888862 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:45.889090 (+ 228us) server_negotiation.cc:299] Negotiation successful
0808 11:31:45.889158 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":241,"threads_started":1}
I20260808 11:31:45.890462 31968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:45.883859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:44943 (local address 127.26.66.129:51079)
0808 11:31:45.884969 (+ 1110us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:45.885026 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:45.886752 (+ 1726us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:45.887435 (+ 683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:45.887442 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:45.887531 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:45.888273 (+ 742us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 11:31:45.888276 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:45.888313 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 11:31:45.888447 (+ 134us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:45.888835 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:45.888846 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:45.888854 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 11:31:45.889170 (+ 316us) client_negotiation.cc:240] Negotiation successful
0808 11:31:45.889415 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":351,"threads_started":1}
I20260808 11:31:45.891827 31965 heartbeater.cc:347] Connected to a master server at 127.26.66.190:44943
I20260808 11:31:45.892161 31965 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:45.892865 31965 heartbeater.cc:511] Master 127.26.66.190:44943 requested a full tablet report, sending...
I20260808 11:31:45.895171 31772 ts_manager.cc:194] Registered new tserver with Master: 127e04c13b0d40298e0754868d76ed33 (127.26.66.129:36939)
W20260808 11:31:46.223671 31969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:46.223953 31969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:46.224099 31969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:46.231227 31969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:46.231324 31969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:46.231431 31969 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:31:46.240844 31969 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:46365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:44943
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:46.242101 31969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:46.243825 31969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:46.257004 31975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:46.256904 31977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:46.256969 31974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:46.257826 31969 server_base.cc:1034] running on GCE node
I20260808 11:31:46.258441 31969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:46.259320 31969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:46.260510 31969 hybrid_clock.cc:648] HybridClock initialized: now 1786188706260450 us; error 44 us; skew 500 ppm
I20260808 11:31:46.260848 31969 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:31:46.263033 31969 webserver.cc:460] Webserver started at http://127.26.66.130:46869/ using document root <none> and password file <none>
I20260808 11:31:46.263696 31969 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:46.263829 31969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:46.264216 31969 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:46.266976 31969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-1/data/instance:
uuid: "e220a8b896e947ac89dd1c679ada9573"
format_stamp: "Formatted at 2026-08-08 11:31:46 on dist-test-slave-zkpd"
server_key: "f567af8b5b042bead64b8c5be8ee1b17"
server_key_iv: "5c80a06b0ba2a0fc05384ff2db9f4f6f"
server_key_version: "encryptionkey@0"
I20260808 11:31:46.267756 31969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance:
uuid: "e220a8b896e947ac89dd1c679ada9573"
format_stamp: "Formatted at 2026-08-08 11:31:46 on dist-test-slave-zkpd"
server_key: "f567af8b5b042bead64b8c5be8ee1b17"
server_key_iv: "5c80a06b0ba2a0fc05384ff2db9f4f6f"
server_key_version: "encryptionkey@0"
I20260808 11:31:46.272814 31969 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260808 11:31:46.276152 31983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:46.277380 31969 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 11:31:46.277552 31969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "e220a8b896e947ac89dd1c679ada9573"
format_stamp: "Formatted at 2026-08-08 11:31:46 on dist-test-slave-zkpd"
server_key: "f567af8b5b042bead64b8c5be8ee1b17"
server_key_iv: "5c80a06b0ba2a0fc05384ff2db9f4f6f"
server_key_version: "encryptionkey@0"
I20260808 11:31:46.277776 31969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:46.283946 31969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:46.284750 31969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:46.285028 31969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:46.285970 31969 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:31:46.287452 31969 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:46.287586 31969 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:46.287729 31969 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:46.287823 31969 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:46.322712 31969 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:39295
I20260808 11:31:46.322808 32097 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:39295 every 8 connection(s)
I20260808 11:31:46.324110 31969 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:31:46.331954 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 31969
I20260808 11:31:46.332170 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance
I20260808 11:31:46.332556 31967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:46.326825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:55295 (local address 127.26.66.190:44943)
0808 11:31:46.327079 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:46.327085 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:46.328583 (+ 1498us) server_negotiation.cc:407] Connection header received
0808 11:31:46.330223 (+ 1640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:46.330227 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:46.330284 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:46.330376 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:46.331671 (+ 1295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:46.331676 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:46.331679 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:31:46.331696 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:46.331727 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:31:46.331739 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:46.331910 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:46.332168 (+ 258us) server_negotiation.cc:299] Negotiation successful
0808 11:31:46.332253 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 11:31:46.332751 26890 external_mini_cluster.cc:1428] Setting key df4d85a1712e01c0fc61a671c2c4313d
I20260808 11:31:46.333529 32101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:46.327417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:44943 (local address 127.26.66.130:55295)
0808 11:31:46.328406 (+ 989us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:46.328445 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:46.329974 (+ 1529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:46.330579 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:46.330587 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:46.330674 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:46.331346 (+ 672us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 11:31:46.331348 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:46.331386 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 11:31:46.331471 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:46.331867 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:46.331880 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:46.331908 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 11:31:46.332208 (+ 300us) client_negotiation.cc:240] Negotiation successful
0808 11:31:46.332462 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":314,"threads_started":1}
I20260808 11:31:46.335117 32098 heartbeater.cc:347] Connected to a master server at 127.26.66.190:44943
I20260808 11:31:46.335433 32098 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:46.336068 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:0
--local_ip_for_outbound_sockets=127.26.66.131
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:44943
--builtin_ntp_servers=127.26.66.148:46365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 11:31:46.336081 32098 heartbeater.cc:511] Master 127.26.66.190:44943 requested a full tablet report, sending...
I20260808 11:31:46.337611 31771 ts_manager.cc:194] Registered new tserver with Master: e220a8b896e947ac89dd1c679ada9573 (127.26.66.130:39295)
W20260808 11:31:46.671439 32102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:46.671747 32102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:46.671943 32102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:46.679189 32102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:46.679322 32102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:46.679509 32102 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:31:46.688597 32102 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:46365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:44943
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:46.689968 32102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:46.691745 32102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:46.705022 32107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:46.704959 32108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:46.705051 32110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:46.706014 32102 server_base.cc:1034] running on GCE node
I20260808 11:31:46.706629 32102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:46.707484 32102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:46.708674 32102 hybrid_clock.cc:648] HybridClock initialized: now 1786188706708631 us; error 41 us; skew 500 ppm
I20260808 11:31:46.708948 32102 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:31:46.711184 32102 webserver.cc:460] Webserver started at http://127.26.66.131:44671/ using document root <none> and password file <none>
I20260808 11:31:46.711844 32102 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:46.712047 32102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:46.712400 32102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:46.715404 32102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-2/data/instance:
uuid: "8058cd29a66a44d98a49c17bf9683cc8"
format_stamp: "Formatted at 2026-08-08 11:31:46 on dist-test-slave-zkpd"
server_key: "3720e1cea7c975eb884d6cb500fd0e7a"
server_key_iv: "083886bc3017f4e5dc89c076b38d9acb"
server_key_version: "encryptionkey@0"
I20260808 11:31:46.716274 32102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance:
uuid: "8058cd29a66a44d98a49c17bf9683cc8"
format_stamp: "Formatted at 2026-08-08 11:31:46 on dist-test-slave-zkpd"
server_key: "3720e1cea7c975eb884d6cb500fd0e7a"
server_key_iv: "083886bc3017f4e5dc89c076b38d9acb"
server_key_version: "encryptionkey@0"
I20260808 11:31:46.721345 32102 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 11:31:46.724762 32116 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:46.726095 32102 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:31:46.726279 32102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "8058cd29a66a44d98a49c17bf9683cc8"
format_stamp: "Formatted at 2026-08-08 11:31:46 on dist-test-slave-zkpd"
server_key: "3720e1cea7c975eb884d6cb500fd0e7a"
server_key_iv: "083886bc3017f4e5dc89c076b38d9acb"
server_key_version: "encryptionkey@0"
I20260808 11:31:46.726503 32102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:46.732270 32102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:46.733026 32102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:46.733304 32102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:46.734222 32102 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:31:46.735620 32102 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:46.735743 32102 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:46.735884 32102 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:46.735989 32102 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260808 11:31:46.770625 32102 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:34059
I20260808 11:31:46.770680 32237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:34059 every 8 connection(s)
I20260808 11:31:46.772163 32102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:31:46.780645 31967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:46.774765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:41221 (local address 127.26.66.190:44943)
0808 11:31:46.774979 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:46.774984 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:46.776544 (+ 1560us) server_negotiation.cc:407] Connection header received
0808 11:31:46.778298 (+ 1754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:46.778303 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:46.778389 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:46.778504 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:46.779847 (+ 1343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:46.779853 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:46.779858 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:31:46.779878 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:46.779937 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:31:46.779951 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:46.780098 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:46.780290 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 11:31:46.780370 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260808 11:31:46.780642 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 32102
I20260808 11:31:46.780879 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance
I20260808 11:31:46.781358 26890 external_mini_cluster.cc:1428] Setting key 1d0acbe48de35fc1a267469f2ad72450
I20260808 11:31:46.781670 32240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:46.775319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:44943 (local address 127.26.66.131:41221)
0808 11:31:46.776340 (+ 1021us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:46.776415 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:46.778024 (+ 1609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:46.778733 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:46.778741 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:46.778835 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:46.779547 (+ 712us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 11:31:46.779550 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:46.779586 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 11:31:46.779670 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:46.780059 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:46.780072 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:46.780082 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 11:31:46.780374 (+ 292us) client_negotiation.cc:240] Negotiation successful
0808 11:31:46.780616 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":307,"threads_started":1}
I20260808 11:31:46.783094 32238 heartbeater.cc:347] Connected to a master server at 127.26.66.190:44943
I20260808 11:31:46.783444 32238 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:46.784111 32238 heartbeater.cc:511] Master 127.26.66.190:44943 requested a full tablet report, sending...
I20260808 11:31:46.785478 31771 ts_manager.cc:194] Registered new tserver with Master: 8058cd29a66a44d98a49c17bf9683cc8 (127.26.66.131:34059)
I20260808 11:31:46.796671 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 11:31:46.803459 31967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:46.801017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35258 (local address 127.26.66.190:44943)
0808 11:31:46.801233 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:46.801242 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:46.801686 (+ 444us) server_negotiation.cc:407] Connection header received
0808 11:31:46.801818 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:46.801822 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:46.801873 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:46.801949 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:46.802867 (+ 918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:46.802871 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:46.802873 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:31:46.802886 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:46.802912 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:31:46.802922 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:46.803009 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:46.803102 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 11:31:46.803148 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 11:31:46.807366 31771 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35258:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 11:31:46.814510 31771 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:31:46.845276 32253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:46.827279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52432 (local address 127.26.66.130:39295)
0808 11:31:46.836850 (+ 9571us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:46.836863 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:46.841210 (+ 4347us) server_negotiation.cc:407] Connection header received
0808 11:31:46.841377 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:46.841389 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:46.841695 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:46.841872 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:46.844240 (+ 2368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:46.844250 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:46.844263 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:31:46.844333 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:46.844405 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:31:46.844427 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:46.844559 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:46.844826 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 11:31:46.844945 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9394,"thread_start_us":9259,"threads_started":1}
I20260808 11:31:46.845376 32254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:46.826616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:39295 (local address 127.0.0.1:52432)
0808 11:31:46.841030 (+ 14414us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:46.841062 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:46.841215 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:46.842878 (+ 1663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:46.842884 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:46.842966 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:46.843867 (+ 901us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 11:31:46.843872 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:46.843923 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 11:31:46.844030 (+ 107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:46.844580 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:46.844593 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:46.844602 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 11:31:46.844810 (+ 208us) client_negotiation.cc:240] Negotiation successful
0808 11:31:46.844915 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14224,"thread_start_us":14989,"threads_started":1}
I20260808 11:31:46.846282 32255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:46.827639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36062 (local address 127.26.66.129:36939)
0808 11:31:46.840398 (+ 12759us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:46.840408 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:46.842823 (+ 2415us) server_negotiation.cc:407] Connection header received
0808 11:31:46.842904 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:46.842913 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:46.843126 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:46.843283 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:46.844533 (+ 1250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:46.844544 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:46.844814 (+ 270us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:31:46.844852 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:46.844912 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:31:46.844935 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:46.845064 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:46.845858 (+ 794us) server_negotiation.cc:299] Negotiation successful
0808 11:31:46.845955 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12543,"thread_start_us":12766,"threads_started":1}
I20260808 11:31:46.846552 32250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:46.826064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:34059 (local address 127.0.0.1:49754)
0808 11:31:46.826860 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:46.826905 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:46.827045 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:46.843633 (+ 16588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:46.843640 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:46.843666 (+ 26us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:46.844655 (+ 989us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 11:31:46.844658 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:46.844672 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 11:31:46.844712 (+ 40us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:46.845853 (+ 1141us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:46.845858 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:46.845862 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 11:31:46.846000 (+ 138us) client_negotiation.cc:240] Negotiation successful
0808 11:31:46.846056 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":346,"threads_started":1}
I20260808 11:31:46.846180 32252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:46.827334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:36939 (local address 127.0.0.1:36062)
0808 11:31:46.842177 (+ 14843us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:46.842201 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:46.842309 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:46.843380 (+ 1071us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:46.843385 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:46.843410 (+ 25us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:46.844280 (+ 870us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 11:31:46.844286 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:46.844303 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 11:31:46.844352 (+ 49us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:46.845116 (+ 764us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:46.845121 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:46.845126 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 11:31:46.845630 (+ 504us) client_negotiation.cc:240] Negotiation successful
0808 11:31:46.845680 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14732,"thread_start_us":13992,"threads_started":1}
I20260808 11:31:46.846865 32251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:46.826424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49754 (local address 127.26.66.131:34059)
0808 11:31:46.842861 (+ 16437us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:46.842868 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:46.842894 (+ 26us) server_negotiation.cc:407] Connection header received
0808 11:31:46.842972 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:46.842978 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:46.843126 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:46.843283 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:46.845286 (+ 2003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:46.845294 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:46.845307 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:31:46.845328 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:46.845383 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:31:46.845408 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:46.846321 (+ 913us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:46.846388 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 11:31:46.846473 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16262,"thread_start_us":16190,"threads_started":1}
I20260808 11:31:46.849539 32032 tablet_service.cc:1467] Processing CreateTablet for tablet bfdb98a546194e61b61dfc2671775b17 (DEFAULT_TABLE table=test-table [id=08b4475d9fbd4193bb80d2f92f6ac50b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:31:46.850729 32032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfdb98a546194e61b61dfc2671775b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:46.850229 31896 tablet_service.cc:1467] Processing CreateTablet for tablet bfdb98a546194e61b61dfc2671775b17 (DEFAULT_TABLE table=test-table [id=08b4475d9fbd4193bb80d2f92f6ac50b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:31:46.850229 32169 tablet_service.cc:1467] Processing CreateTablet for tablet bfdb98a546194e61b61dfc2671775b17 (DEFAULT_TABLE table=test-table [id=08b4475d9fbd4193bb80d2f92f6ac50b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:31:46.851580 31896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfdb98a546194e61b61dfc2671775b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:46.851576 32169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfdb98a546194e61b61dfc2671775b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:46.862012 32256 tablet_bootstrap.cc:492] T bfdb98a546194e61b61dfc2671775b17 P e220a8b896e947ac89dd1c679ada9573: Bootstrap starting.
I20260808 11:31:46.865332 32256 tablet_bootstrap.cc:654] T bfdb98a546194e61b61dfc2671775b17 P e220a8b896e947ac89dd1c679ada9573: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:46.866467 32256 log.cc:824] T bfdb98a546194e61b61dfc2671775b17 P e220a8b896e947ac89dd1c679ada9573: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:46.866921 32258 tablet_bootstrap.cc:492] T bfdb98a546194e61b61dfc2671775b17 P 127e04c13b0d40298e0754868d76ed33: Bootstrap starting.
I20260808 11:31:46.868259 32257 tablet_bootstrap.cc:492] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8: Bootstrap starting.
I20260808 11:31:46.871632 32257 tablet_bootstrap.cc:654] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:46.871796 32258 tablet_bootstrap.cc:654] T bfdb98a546194e61b61dfc2671775b17 P 127e04c13b0d40298e0754868d76ed33: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:46.872705 32257 log.cc:824] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:46.873281 32258 log.cc:824] T bfdb98a546194e61b61dfc2671775b17 P 127e04c13b0d40298e0754868d76ed33: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:46.875566 32257 tablet_bootstrap.cc:492] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8: No bootstrap required, opened a new log
I20260808 11:31:46.875828 32257 ts_tablet_manager.cc:1397] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260808 11:31:46.876093 32258 tablet_bootstrap.cc:492] T bfdb98a546194e61b61dfc2671775b17 P 127e04c13b0d40298e0754868d76ed33: No bootstrap required, opened a new log
I20260808 11:31:46.876346 32258 ts_tablet_manager.cc:1397] T bfdb98a546194e61b61dfc2671775b17 P 127e04c13b0d40298e0754868d76ed33: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260808 11:31:46.877624 32256 tablet_bootstrap.cc:492] T bfdb98a546194e61b61dfc2671775b17 P e220a8b896e947ac89dd1c679ada9573: No bootstrap required, opened a new log
I20260808 11:31:46.877882 32256 ts_tablet_manager.cc:1397] T bfdb98a546194e61b61dfc2671775b17 P e220a8b896e947ac89dd1c679ada9573: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.008s
I20260808 11:31:46.886690 32257 raft_consensus.cc:348] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8058cd29a66a44d98a49c17bf9683cc8" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34059 } } peers { permanent_uuid: "127e04c13b0d40298e0754868d76ed33" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 36939 } } peers { permanent_uuid: "e220a8b896e947ac89dd1c679ada9573" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39295 } }
I20260808 11:31:46.887272 32257 raft_consensus.cc:374] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:46.887428 32257 raft_consensus.cc:729] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8058cd29a66a44d98a49c17bf9683cc8, State: Initialized, Role: FOLLOWER
I20260808 11:31:46.888005 32258 raft_consensus.cc:348] T bfdb98a546194e61b61dfc2671775b17 P 127e04c13b0d40298e0754868d76ed33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8058cd29a66a44d98a49c17bf9683cc8" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34059 } } peers { permanent_uuid: "127e04c13b0d40298e0754868d76ed33" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 36939 } } peers { permanent_uuid: "e220a8b896e947ac89dd1c679ada9573" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39295 } }
I20260808 11:31:46.888275 32257 consensus_queue.cc:260] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8058cd29a66a44d98a49c17bf9683cc8" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34059 } } peers { permanent_uuid: "127e04c13b0d40298e0754868d76ed33" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 36939 } } peers { permanent_uuid: "e220a8b896e947ac89dd1c679ada9573" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39295 } }
I20260808 11:31:46.888576 32258 raft_consensus.cc:374] T bfdb98a546194e61b61dfc2671775b17 P 127e04c13b0d40298e0754868d76ed33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:46.888747 32258 raft_consensus.cc:729] T bfdb98a546194e61b61dfc2671775b17 P 127e04c13b0d40298e0754868d76ed33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 127e04c13b0d40298e0754868d76ed33, State: Initialized, Role: FOLLOWER
I20260808 11:31:46.888633 32256 raft_consensus.cc:348] T bfdb98a546194e61b61dfc2671775b17 P e220a8b896e947ac89dd1c679ada9573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8058cd29a66a44d98a49c17bf9683cc8" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34059 } } peers { permanent_uuid: "127e04c13b0d40298e0754868d76ed33" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 36939 } } peers { permanent_uuid: "e220a8b896e947ac89dd1c679ada9573" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39295 } }
I20260808 11:31:46.889335 32256 raft_consensus.cc:374] T bfdb98a546194e61b61dfc2671775b17 P e220a8b896e947ac89dd1c679ada9573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:46.889511 32256 raft_consensus.cc:729] T bfdb98a546194e61b61dfc2671775b17 P e220a8b896e947ac89dd1c679ada9573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e220a8b896e947ac89dd1c679ada9573, State: Initialized, Role: FOLLOWER
I20260808 11:31:46.889513 32258 consensus_queue.cc:260] T bfdb98a546194e61b61dfc2671775b17 P 127e04c13b0d40298e0754868d76ed33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8058cd29a66a44d98a49c17bf9683cc8" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34059 } } peers { permanent_uuid: "127e04c13b0d40298e0754868d76ed33" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 36939 } } peers { permanent_uuid: "e220a8b896e947ac89dd1c679ada9573" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39295 } }
I20260808 11:31:46.890470 32256 consensus_queue.cc:260] T bfdb98a546194e61b61dfc2671775b17 P e220a8b896e947ac89dd1c679ada9573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8058cd29a66a44d98a49c17bf9683cc8" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34059 } } peers { permanent_uuid: "127e04c13b0d40298e0754868d76ed33" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 36939 } } peers { permanent_uuid: "e220a8b896e947ac89dd1c679ada9573" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39295 } }
I20260808 11:31:46.894878 32098 heartbeater.cc:503] Master 127.26.66.190:44943 was elected leader, sending a full tablet report...
I20260808 11:31:46.895879 32256 ts_tablet_manager.cc:1428] T bfdb98a546194e61b61dfc2671775b17 P e220a8b896e947ac89dd1c679ada9573: Time spent starting tablet: real 0.018s user 0.016s sys 0.000s
I20260808 11:31:46.897324 32258 ts_tablet_manager.cc:1428] T bfdb98a546194e61b61dfc2671775b17 P 127e04c13b0d40298e0754868d76ed33: Time spent starting tablet: real 0.021s user 0.013s sys 0.007s
I20260808 11:31:46.898586 31965 heartbeater.cc:503] Master 127.26.66.190:44943 was elected leader, sending a full tablet report...
I20260808 11:31:46.899571 32238 heartbeater.cc:503] Master 127.26.66.190:44943 was elected leader, sending a full tablet report...
I20260808 11:31:46.900910 32257 ts_tablet_manager.cc:1428] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8: Time spent starting tablet: real 0.025s user 0.012s sys 0.007s
I20260808 11:31:46.989732 32262 raft_consensus.cc:482] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:31:46.990111 32262 raft_consensus.cc:504] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8058cd29a66a44d98a49c17bf9683cc8" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34059 } } peers { permanent_uuid: "127e04c13b0d40298e0754868d76ed33" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 36939 } } peers { permanent_uuid: "e220a8b896e947ac89dd1c679ada9573" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39295 } }
I20260808 11:31:46.991865 32262 leader_election.cc:288] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 127e04c13b0d40298e0754868d76ed33 (127.26.66.129:36939), e220a8b896e947ac89dd1c679ada9573 (127.26.66.130:39295)
I20260808 11:31:46.994778 32240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:46.992176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:39295 (local address 127.26.66.131:53589)
0808 11:31:46.992470 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:46.992494 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:46.992606 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:46.993145 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:46.993149 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:46.993170 (+ 21us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:46.993869 (+ 699us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 11:31:46.993874 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:46.993897 (+ 23us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 11:31:46.993947 (+ 50us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:46.994293 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:46.994300 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:46.994312 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 11:31:46.994442 (+ 130us) client_negotiation.cc:240] Negotiation successful
0808 11:31:46.994493 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149}
I20260808 11:31:46.994832 32253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:46.992589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:53589 (local address 127.26.66.130:39295)
0808 11:31:46.992803 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:46.992811 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:46.992831 (+ 20us) server_negotiation.cc:407] Connection header received
0808 11:31:46.992907 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:46.992913 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:46.992974 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:46.993082 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:46.994117 (+ 1035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:46.994122 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:46.994125 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:31:46.994140 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:46.994169 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:31:46.994180 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:46.994306 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:46.994476 (+ 170us) server_negotiation.cc:299] Negotiation successful
0808 11:31:46.994544 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 11:31:46.995985 32255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:46.992376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:55253 (local address 127.26.66.129:36939)
0808 11:31:46.992588 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:46.992596 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:46.993506 (+ 910us) server_negotiation.cc:407] Connection header received
0808 11:31:46.993722 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:46.993726 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:46.993823 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:46.993926 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:46.995037 (+ 1111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:46.995046 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:46.995053 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:31:46.995073 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:46.995112 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:31:46.995125 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:46.995234 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:46.995523 (+ 289us) server_negotiation.cc:299] Negotiation successful
0808 11:31:46.995643 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 11:31:46.996044 32265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:46.992331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:36939 (local address 127.26.66.131:55253)
0808 11:31:46.993398 (+ 1067us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:46.993414 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:46.993577 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:46.994029 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:46.994033 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:46.994057 (+ 24us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:46.994784 (+ 727us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 11:31:46.994789 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:46.994807 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 11:31:46.994855 (+ 48us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:46.995368 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:46.995372 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:46.995376 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 11:31:46.995488 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 11:31:46.995542 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":932,"thread_start_us":502,"threads_started":1}
I20260808 11:31:46.996965 32053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfdb98a546194e61b61dfc2671775b17" candidate_uuid: "8058cd29a66a44d98a49c17bf9683cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e220a8b896e947ac89dd1c679ada9573" is_pre_election: true
I20260808 11:31:46.997228 31917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfdb98a546194e61b61dfc2671775b17" candidate_uuid: "8058cd29a66a44d98a49c17bf9683cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "127e04c13b0d40298e0754868d76ed33" is_pre_election: true
I20260808 11:31:46.997604 32053 raft_consensus.cc:2454] T bfdb98a546194e61b61dfc2671775b17 P e220a8b896e947ac89dd1c679ada9573 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8058cd29a66a44d98a49c17bf9683cc8 in term 0.
I20260808 11:31:46.997793 31917 raft_consensus.cc:2454] T bfdb98a546194e61b61dfc2671775b17 P 127e04c13b0d40298e0754868d76ed33 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8058cd29a66a44d98a49c17bf9683cc8 in term 0.
I20260808 11:31:46.998342 32119 leader_election.cc:302] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8058cd29a66a44d98a49c17bf9683cc8, e220a8b896e947ac89dd1c679ada9573; no voters:
I20260808 11:31:46.998775 32262 raft_consensus.cc:2781] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:31:46.998934 32262 raft_consensus.cc:482] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:31:46.999050 32262 raft_consensus.cc:3037] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:47.001350 32262 raft_consensus.cc:504] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8058cd29a66a44d98a49c17bf9683cc8" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34059 } } peers { permanent_uuid: "127e04c13b0d40298e0754868d76ed33" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 36939 } } peers { permanent_uuid: "e220a8b896e947ac89dd1c679ada9573" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39295 } }
I20260808 11:31:47.001892 32262 leader_election.cc:288] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8 [CANDIDATE]: Term 1 election: Requested vote from peers 127e04c13b0d40298e0754868d76ed33 (127.26.66.129:36939), e220a8b896e947ac89dd1c679ada9573 (127.26.66.130:39295)
I20260808 11:31:47.002326 31917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfdb98a546194e61b61dfc2671775b17" candidate_uuid: "8058cd29a66a44d98a49c17bf9683cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "127e04c13b0d40298e0754868d76ed33"
I20260808 11:31:47.002393 32053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfdb98a546194e61b61dfc2671775b17" candidate_uuid: "8058cd29a66a44d98a49c17bf9683cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e220a8b896e947ac89dd1c679ada9573"
I20260808 11:31:47.002543 31917 raft_consensus.cc:3037] T bfdb98a546194e61b61dfc2671775b17 P 127e04c13b0d40298e0754868d76ed33 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:47.002581 32053 raft_consensus.cc:3037] T bfdb98a546194e61b61dfc2671775b17 P e220a8b896e947ac89dd1c679ada9573 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:47.005901 31917 raft_consensus.cc:2454] T bfdb98a546194e61b61dfc2671775b17 P 127e04c13b0d40298e0754868d76ed33 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8058cd29a66a44d98a49c17bf9683cc8 in term 1.
I20260808 11:31:47.005901 32053 raft_consensus.cc:2454] T bfdb98a546194e61b61dfc2671775b17 P e220a8b896e947ac89dd1c679ada9573 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8058cd29a66a44d98a49c17bf9683cc8 in term 1.
I20260808 11:31:47.006294 32121 leader_election.cc:302] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127e04c13b0d40298e0754868d76ed33, 8058cd29a66a44d98a49c17bf9683cc8; no voters:
I20260808 11:31:47.006656 32262 raft_consensus.cc:2781] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:31:47.007118 32262 raft_consensus.cc:686] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8 [term 1 LEADER]: Becoming Leader. State: Replica: 8058cd29a66a44d98a49c17bf9683cc8, State: Running, Role: LEADER
I20260808 11:31:47.007575 32262 consensus_queue.cc:237] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8058cd29a66a44d98a49c17bf9683cc8" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34059 } } peers { permanent_uuid: "127e04c13b0d40298e0754868d76ed33" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 36939 } } peers { permanent_uuid: "e220a8b896e947ac89dd1c679ada9573" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39295 } }
I20260808 11:31:47.012458 31771 catalog_manager.cc:5495] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8058cd29a66a44d98a49c17bf9683cc8 (127.26.66.131). New cstate: current_term: 1 leader_uuid: "8058cd29a66a44d98a49c17bf9683cc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8058cd29a66a44d98a49c17bf9683cc8" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "127e04c13b0d40298e0754868d76ed33" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 36939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e220a8b896e947ac89dd1c679ada9573" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39295 } health_report { overall_health: UNKNOWN } } }
W20260808 11:31:47.024092 32239 tablet.cc:2369] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:31:47.039808 32251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:47.037631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49766 (local address 127.26.66.131:34059)
0808 11:31:47.037821 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:47.037826 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:47.038124 (+ 298us) server_negotiation.cc:407] Connection header received
0808 11:31:47.038282 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:47.038287 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:47.038367 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:47.038495 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:47.039350 (+ 855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:47.039354 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:47.039357 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:31:47.039371 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:47.039404 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:31:47.039415 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:47.039512 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:47.039579 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 11:31:47.039623 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 11:31:47.047950 31917 raft_consensus.cc:1261] T bfdb98a546194e61b61dfc2671775b17 P 127e04c13b0d40298e0754868d76ed33 [term 1 FOLLOWER]: Refusing update from remote peer 8058cd29a66a44d98a49c17bf9683cc8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:31:47.047955 32053 raft_consensus.cc:1261] T bfdb98a546194e61b61dfc2671775b17 P e220a8b896e947ac89dd1c679ada9573 [term 1 FOLLOWER]: Refusing update from remote peer 8058cd29a66a44d98a49c17bf9683cc8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:31:47.049039 32266 consensus_queue.cc:1035] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "127e04c13b0d40298e0754868d76ed33" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 36939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:31:47.049441 32262 consensus_queue.cc:1035] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e220a8b896e947ac89dd1c679ada9573" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:31:47.059861 32269 mvcc.cc:205] Tried to move back new op lower bound from 7316228944058081280 to 7316228943906852864. Current Snapshot: MvccSnapshot[applied={T|T < 7316228944058081280}]
I20260808 11:31:47.064384 32271 mvcc.cc:205] Tried to move back new op lower bound from 7316228944058081280 to 7316228943906852864. Current Snapshot: MvccSnapshot[applied={T|T < 7316228944058081280}]
I20260808 11:31:47.074126 31772 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35258:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:31:47.074409 31772 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35258:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:31:47.078629 31772 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e3af91eb8daf4934be67cc83cfaebd35: Sending DeleteTablet for 3 replicas of tablet bfdb98a546194e61b61dfc2671775b17
I20260808 11:31:47.079854 32032 tablet_service.cc:1514] Processing DeleteTablet for tablet bfdb98a546194e61b61dfc2671775b17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:31:47 UTC) from {username='slave'} at 127.0.0.1:52432
I20260808 11:31:47.079857 32169 tablet_service.cc:1514] Processing DeleteTablet for tablet bfdb98a546194e61b61dfc2671775b17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:31:47 UTC) from {username='slave'} at 127.0.0.1:49754
I20260808 11:31:47.080593 31896 tablet_service.cc:1514] Processing DeleteTablet for tablet bfdb98a546194e61b61dfc2671775b17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:31:47 UTC) from {username='slave'} at 127.0.0.1:36062
I20260808 11:31:47.081278 32278 tablet_replica.cc:330] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8: stopping tablet replica
I20260808 11:31:47.081475 32280 tablet_replica.cc:330] T bfdb98a546194e61b61dfc2671775b17 P e220a8b896e947ac89dd1c679ada9573: stopping tablet replica
I20260808 11:31:47.082286 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 31833
I20260808 11:31:47.082903 32281 tablet_replica.cc:330] T bfdb98a546194e61b61dfc2671775b17 P 127e04c13b0d40298e0754868d76ed33: stopping tablet replica
I20260808 11:31:47.083309 32281 raft_consensus.cc:2229] T bfdb98a546194e61b61dfc2671775b17 P 127e04c13b0d40298e0754868d76ed33 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:31:47.084275 32281 raft_consensus.cc:2258] T bfdb98a546194e61b61dfc2671775b17 P 127e04c13b0d40298e0754868d76ed33 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:31:47.084661 32278 raft_consensus.cc:2229] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8 [term 1 LEADER]: Raft consensus shutting down.
I20260808 11:31:47.085021 32280 raft_consensus.cc:2229] T bfdb98a546194e61b61dfc2671775b17 P e220a8b896e947ac89dd1c679ada9573 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:31:47.085516 32280 raft_consensus.cc:2258] T bfdb98a546194e61b61dfc2671775b17 P e220a8b896e947ac89dd1c679ada9573 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:31:47.086176 32278 raft_consensus.cc:2258] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:31:47.086407 32281 ts_tablet_manager.cc:1905] T bfdb98a546194e61b61dfc2671775b17 P 127e04c13b0d40298e0754868d76ed33: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:31:47.088337 32280 ts_tablet_manager.cc:1905] T bfdb98a546194e61b61dfc2671775b17 P e220a8b896e947ac89dd1c679ada9573: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:31:47.092742 32281 ts_tablet_manager.cc:1918] T bfdb98a546194e61b61dfc2671775b17 P 127e04c13b0d40298e0754868d76ed33: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:31:47.092936 32281 log.cc:1196] T bfdb98a546194e61b61dfc2671775b17 P 127e04c13b0d40298e0754868d76ed33: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-0/wal/wals/bfdb98a546194e61b61dfc2671775b17
I20260808 11:31:47.093438 32281 ts_tablet_manager.cc:1939] T bfdb98a546194e61b61dfc2671775b17 P 127e04c13b0d40298e0754868d76ed33: Deleting consensus metadata
I20260808 11:31:47.094996 31758 catalog_manager.cc:4841] TS 127e04c13b0d40298e0754868d76ed33 (127.26.66.129:36939): tablet bfdb98a546194e61b61dfc2671775b17 (table test-table [id=08b4475d9fbd4193bb80d2f92f6ac50b]) successfully deleted
I20260808 11:31:47.095301 32280 ts_tablet_manager.cc:1918] T bfdb98a546194e61b61dfc2671775b17 P e220a8b896e947ac89dd1c679ada9573: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:31:47.095453 32280 log.cc:1196] T bfdb98a546194e61b61dfc2671775b17 P e220a8b896e947ac89dd1c679ada9573: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-1/wal/wals/bfdb98a546194e61b61dfc2671775b17
I20260808 11:31:47.096009 32280 ts_tablet_manager.cc:1939] T bfdb98a546194e61b61dfc2671775b17 P e220a8b896e947ac89dd1c679ada9573: Deleting consensus metadata
I20260808 11:31:47.097544 32255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:47.083582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36066 (local address 127.26.66.129:36939)
0808 11:31:47.083776 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:47.083783 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:47.095118 (+ 11335us) server_negotiation.cc:407] Connection header received
0808 11:31:47.095457 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:47.095463 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:47.095583 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:47.095658 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:47.096867 (+ 1209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:47.096874 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:47.096882 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:31:47.096899 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:47.096927 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:31:47.096938 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:47.097085 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:47.097172 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 11:31:47.097234 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 11:31:47.097625 31757 catalog_manager.cc:4841] TS e220a8b896e947ac89dd1c679ada9573 (127.26.66.130:39295): tablet bfdb98a546194e61b61dfc2671775b17 (table test-table [id=08b4475d9fbd4193bb80d2f92f6ac50b]) successfully deleted
I20260808 11:31:47.098285 31960 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:47.098879 32278 ts_tablet_manager.cc:1905] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:31:47.106541 32278 ts_tablet_manager.cc:1918] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:31:47.106729 32278 log.cc:1196] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786188664137852-26890-0/minicluster-data/ts-2/wal/wals/bfdb98a546194e61b61dfc2671775b17
I20260808 11:31:47.107333 32278 ts_tablet_manager.cc:1939] T bfdb98a546194e61b61dfc2671775b17 P 8058cd29a66a44d98a49c17bf9683cc8: Deleting consensus metadata
I20260808 11:31:47.109112 31758 catalog_manager.cc:4841] TS 8058cd29a66a44d98a49c17bf9683cc8 (127.26.66.131:34059): tablet bfdb98a546194e61b61dfc2671775b17 (table test-table [id=08b4475d9fbd4193bb80d2f92f6ac50b]) successfully deleted
I20260808 11:31:47.189085 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 31833
I20260808 11:31:47.220667 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 31969
I20260808 11:31:47.231106 32253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:47.226272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52438 (local address 127.26.66.130:39295)
0808 11:31:47.226494 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:47.226501 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:47.226523 (+ 22us) server_negotiation.cc:407] Connection header received
0808 11:31:47.226594 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:47.226600 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:47.226805 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:47.226919 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:47.230212 (+ 3293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:47.230219 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:47.230224 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:31:47.230245 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:47.230286 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:31:47.230305 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:47.230434 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:47.230671 (+ 237us) server_negotiation.cc:299] Negotiation successful
0808 11:31:47.230735 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 11:31:47.232401 32093 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:47.385334 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 31969
I20260808 11:31:47.408068 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 32102
I20260808 11:31:47.411326 32251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:47.409018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49768 (local address 127.26.66.131:34059)
0808 11:31:47.409220 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:47.409224 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:47.409243 (+ 19us) server_negotiation.cc:407] Connection header received
0808 11:31:47.409401 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:47.409405 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:47.409457 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:47.409545 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:47.410512 (+ 967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:47.410517 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:47.410520 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:31:47.410535 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:47.410568 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:31:47.410580 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:47.410696 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:47.410896 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 11:31:47.410963 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 11:31:47.412197 32233 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:47.536417 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 32102
I20260808 11:31:47.560060 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 31739
I20260808 11:31:47.561241 31804 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:47.670590 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 31739
2026-08-08T11:31:47Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2826 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 11:31:47.716096 26890 mini_oidc.cc:152] Starting JWKS server
I20260808 11:31:47.718748 26890 webserver.cc:460] Webserver started at https://127.0.0.1:38659/ using document root <none> and password file <none>
I20260808 11:31:47.719099 26890 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 11:31:47.719780 26890 webserver.cc:460] Webserver started at http://127.0.0.1:37243/ using document root <none> and password file <none>
2026-08-08T11:31:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:31:47Z Disabled control of system clock
I20260808 11:31:47.755483 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:38399
--webserver_interface=127.26.66.190
--webserver_port=0
--builtin_ntp_servers=127.26.66.148:39175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:38399
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38659/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786188664137852-26890-0/testchainca.cert with env {}
W20260808 11:31:48.086099 32292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:48.086361 32292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:48.086450 32292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:48.093468 32292 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:31:48.093559 32292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:48.093602 32292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:48.093652 32292 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:31:48.093688 32292 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 11:31:48.093776 32292 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 11:31:48.093809 32292 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38659/jwks.json
I20260808 11:31:48.103278 32292 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:39175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:38399
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:38399
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38659/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786188664137852-26890-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:48.104470 32292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:48.105820 32292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:48.117607 32299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:48.117674 32298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:48.117697 32301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:48.118635 32292 server_base.cc:1034] running on GCE node
I20260808 11:31:48.119415 32292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:48.120759 32292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:48.121975 32292 hybrid_clock.cc:648] HybridClock initialized: now 1786188708121909 us; error 42 us; skew 500 ppm
I20260808 11:31:48.122277 32292 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:31:48.124507 32292 webserver.cc:460] Webserver started at http://127.26.66.190:35277/ using document root <none> and password file <none>
I20260808 11:31:48.125130 32292 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:48.125218 32292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:48.125474 32292 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:48.128362 32292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "fdd74c4ffe154248b95dcc5898fac696"
format_stamp: "Formatted at 2026-08-08 11:31:48 on dist-test-slave-zkpd"
server_key: "5f00e1fcc89f6a3e4f4c8826043eb2ac"
server_key_iv: "6d8f08fea2c593d04745c44c05876742"
server_key_version: "encryptionkey@0"
I20260808 11:31:48.129098 32292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "fdd74c4ffe154248b95dcc5898fac696"
format_stamp: "Formatted at 2026-08-08 11:31:48 on dist-test-slave-zkpd"
server_key: "5f00e1fcc89f6a3e4f4c8826043eb2ac"
server_key_iv: "6d8f08fea2c593d04745c44c05876742"
server_key_version: "encryptionkey@0"
I20260808 11:31:48.134083 32292 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260808 11:31:48.137416 32309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:48.138701 32292 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 11:31:48.138893 32292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "fdd74c4ffe154248b95dcc5898fac696"
format_stamp: "Formatted at 2026-08-08 11:31:48 on dist-test-slave-zkpd"
server_key: "5f00e1fcc89f6a3e4f4c8826043eb2ac"
server_key_iv: "6d8f08fea2c593d04745c44c05876742"
server_key_version: "encryptionkey@0"
I20260808 11:31:48.139106 32292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:48.155596 32292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:48.156457 32292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:48.156762 32292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:48.175166 32292 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:38399
I20260808 11:31:48.175184 32360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:38399 every 8 connection(s)
I20260808 11:31:48.176545 32292 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:31:48.180331 32361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:48.186331 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 32292
I20260808 11:31:48.186539 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:31:48.187367 26890 external_mini_cluster.cc:1428] Setting key 752acbd6e2b540146566a20c2e149886
I20260808 11:31:48.191702 32361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdd74c4ffe154248b95dcc5898fac696: Bootstrap starting.
I20260808 11:31:48.194821 32361 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fdd74c4ffe154248b95dcc5898fac696: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:48.195811 32361 log.cc:824] T 00000000000000000000000000000000 P fdd74c4ffe154248b95dcc5898fac696: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:48.198643 32361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdd74c4ffe154248b95dcc5898fac696: No bootstrap required, opened a new log
I20260808 11:31:48.200721 32364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:48.189326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51186 (local address 127.26.66.190:38399)
0808 11:31:48.190284 (+ 958us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:48.190303 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:48.190344 (+ 41us) server_negotiation.cc:407] Connection header received
0808 11:31:48.192105 (+ 1761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:48.192127 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:48.192595 (+ 468us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:48.192971 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:48.193597 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:48.194863 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:48.196332 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:48.196997 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:48.197197 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:48.198428 (+ 1231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:48.198435 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:48.198449 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:31:48.198994 (+ 545us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:48.199078 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:31:48.199102 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:48.199227 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:48.199465 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 11:31:48.199766 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":560,"thread_start_us":342,"threads_started":1}
I20260808 11:31:48.204715 26890 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 11:31:48.207518 32361 raft_consensus.cc:348] T 00000000000000000000000000000000 P fdd74c4ffe154248b95dcc5898fac696 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdd74c4ffe154248b95dcc5898fac696" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38399 } }
I20260808 11:31:48.207980 32361 raft_consensus.cc:374] T 00000000000000000000000000000000 P fdd74c4ffe154248b95dcc5898fac696 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:48.208103 32361 raft_consensus.cc:729] T 00000000000000000000000000000000 P fdd74c4ffe154248b95dcc5898fac696 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdd74c4ffe154248b95dcc5898fac696, State: Initialized, Role: FOLLOWER
I20260808 11:31:48.208685 32361 consensus_queue.cc:260] T 00000000000000000000000000000000 P fdd74c4ffe154248b95dcc5898fac696 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdd74c4ffe154248b95dcc5898fac696" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38399 } }
I20260808 11:31:48.208891 32361 raft_consensus.cc:388] T 00000000000000000000000000000000 P fdd74c4ffe154248b95dcc5898fac696 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:31:48.208992 32361 raft_consensus.cc:482] T 00000000000000000000000000000000 P fdd74c4ffe154248b95dcc5898fac696 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:31:48.209116 32361 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fdd74c4ffe154248b95dcc5898fac696 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:48.211684 32361 raft_consensus.cc:504] T 00000000000000000000000000000000 P fdd74c4ffe154248b95dcc5898fac696 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdd74c4ffe154248b95dcc5898fac696" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38399 } }
I20260808 11:31:48.212188 32361 leader_election.cc:302] T 00000000000000000000000000000000 P fdd74c4ffe154248b95dcc5898fac696 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fdd74c4ffe154248b95dcc5898fac696; no voters:
I20260808 11:31:48.212750 32361 leader_election.cc:288] T 00000000000000000000000000000000 P fdd74c4ffe154248b95dcc5898fac696 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:31:48.212893 32366 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fdd74c4ffe154248b95dcc5898fac696 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:31:48.213627 32366 raft_consensus.cc:686] T 00000000000000000000000000000000 P fdd74c4ffe154248b95dcc5898fac696 [term 1 LEADER]: Becoming Leader. State: Replica: fdd74c4ffe154248b95dcc5898fac696, State: Running, Role: LEADER
I20260808 11:31:48.214192 32366 consensus_queue.cc:237] T 00000000000000000000000000000000 P fdd74c4ffe154248b95dcc5898fac696 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdd74c4ffe154248b95dcc5898fac696" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38399 } }
I20260808 11:31:48.214795 32361 sys_catalog.cc:564] T 00000000000000000000000000000000 P fdd74c4ffe154248b95dcc5898fac696 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:31:48.217213 32367 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdd74c4ffe154248b95dcc5898fac696 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fdd74c4ffe154248b95dcc5898fac696" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdd74c4ffe154248b95dcc5898fac696" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38399 } } }
I20260808 11:31:48.217629 32367 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdd74c4ffe154248b95dcc5898fac696 [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:48.217386 32368 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdd74c4ffe154248b95dcc5898fac696 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fdd74c4ffe154248b95dcc5898fac696. Latest consensus state: current_term: 1 leader_uuid: "fdd74c4ffe154248b95dcc5898fac696" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdd74c4ffe154248b95dcc5898fac696" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38399 } } }
I20260808 11:31:48.217785 32368 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdd74c4ffe154248b95dcc5898fac696 [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:48.221091 32374 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:31:48.226398 32374 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:31:48.234969 32374 catalog_manager.cc:1347] Generated new cluster ID: 78669129fb274a80b6721829f632c5fc
I20260808 11:31:48.235075 32374 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:31:48.245117 32374 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:31:48.246869 32374 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:31:48.253762 32374 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fdd74c4ffe154248b95dcc5898fac696: Generated new TSK 0
I20260808 11:31:48.254527 32374 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 11:31:48.295697 32394 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 11:31:48.295888 32394 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 11:31:48.297003 32364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:48.275098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51188 (local address 127.26.66.190:38399)
0808 11:31:48.275316 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:48.275323 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:48.275800 (+ 477us) server_negotiation.cc:407] Connection header received
0808 11:31:48.276173 (+ 373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:48.276178 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:48.276282 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:48.276458 (+ 176us) server_negotiation.cc:226] Negotiated authn=JWT
0808 11:31:48.276972 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:48.278159 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:48.279586 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:48.280279 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:48.280427 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:48.280923 (+ 496us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 11:31:48.296300 (+ 15377us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38659/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 11:31:48.296693 (+ 393us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51188: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38659/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":68}
W20260808 11:31:48.297142 32364 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51188: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38659/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260808 11:31:48.298591 32393 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:31:48.274961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38399 (local address 127.0.0.1:51188)
0808 11:31:48.275695 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:48.275711 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:48.275863 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:48.276474 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:48.276477 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:48.276487 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0808 11:31:48.276828 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:48.276836 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:48.278306 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:48.278309 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:48.279441 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:48.279452 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:48.280458 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:48.280464 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:48.280587 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:48.280644 (+ 57us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 11:31:48.296578 (+ 15934us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38659/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 11:31:48.296852 (+ 274us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.66.190:38399: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38659/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":405,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.26.66.190:38399: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38659/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 11:31:48.300558 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 32292
I20260808 11:31:48.301705 32356 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:48.394502 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 32292
2026-08-08T11:31:48Z chronyd exiting
I20260808 11:31:48.448695 26890 test_util.cc:175] -----------------------------------------------
I20260808 11:31:48.448809 26890 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786188664137852-26890-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (737 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 11:31:48.452589 26890 mini_oidc.cc:152] Starting JWKS server
I20260808 11:31:48.454432 26890 webserver.cc:460] Webserver started at https://127.0.0.1:44543/ using document root <none> and password file <none>
I20260808 11:31:48.454685 26890 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 11:31:48.455338 26890 webserver.cc:460] Webserver started at http://127.0.0.1:33645/ using document root <none> and password file <none>
2026-08-08T11:31:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:31:48Z Disabled control of system clock
I20260808 11:31:48.492466 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:34351
--webserver_interface=127.26.66.190
--webserver_port=0
--builtin_ntp_servers=127.26.66.148:33517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:34351
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44543/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786188664137852-26890-0/testchainca.cert with env {}
W20260808 11:31:48.824337 32401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:48.824611 32401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:48.824698 32401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:48.831616 32401 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:31:48.831713 32401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:48.831751 32401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:48.831807 32401 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:31:48.831851 32401 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 11:31:48.831988 32401 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 11:31:48.832041 32401 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44543/jwks.json
I20260808 11:31:48.841472 32401 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:33517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:34351
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:34351
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44543/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786188664137852-26890-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:48.842669 32401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:48.843909 32401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:48.855737 32406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:48.855810 32407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:48.855659 32409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:48.856930 32401 server_base.cc:1034] running on GCE node
I20260808 11:31:48.857790 32401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:48.859218 32401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:48.860447 32401 hybrid_clock.cc:648] HybridClock initialized: now 1786188708860392 us; error 48 us; skew 500 ppm
I20260808 11:31:48.860837 32401 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:31:48.866513 32401 webserver.cc:460] Webserver started at http://127.26.66.190:35259/ using document root <none> and password file <none>
I20260808 11:31:48.867252 32401 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:48.867398 32401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:48.867743 32401 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:48.870709 32401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "aa6c47db72c54bafbb8628151a96e578"
format_stamp: "Formatted at 2026-08-08 11:31:48 on dist-test-slave-zkpd"
server_key: "4408d4a0915ea558ee2efbee2f6d5007"
server_key_iv: "d44ecd03b56d22d9f9ce836160031cb9"
server_key_version: "encryptionkey@0"
I20260808 11:31:48.871531 32401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "aa6c47db72c54bafbb8628151a96e578"
format_stamp: "Formatted at 2026-08-08 11:31:48 on dist-test-slave-zkpd"
server_key: "4408d4a0915ea558ee2efbee2f6d5007"
server_key_iv: "d44ecd03b56d22d9f9ce836160031cb9"
server_key_version: "encryptionkey@0"
I20260808 11:31:48.877118 32401 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 11:31:48.880631 32415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:48.882010 32401 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:31:48.882211 32401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "aa6c47db72c54bafbb8628151a96e578"
format_stamp: "Formatted at 2026-08-08 11:31:48 on dist-test-slave-zkpd"
server_key: "4408d4a0915ea558ee2efbee2f6d5007"
server_key_iv: "d44ecd03b56d22d9f9ce836160031cb9"
server_key_version: "encryptionkey@0"
I20260808 11:31:48.882459 32401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:48.895980 32401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:48.896752 32401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:48.897063 32401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:48.916153 32401 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:34351
I20260808 11:31:48.916174 32469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:34351 every 8 connection(s)
I20260808 11:31:48.917572 32401 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:31:48.921427 32470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:48.923345 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 32401
I20260808 11:31:48.923578 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:31:48.924434 26890 external_mini_cluster.cc:1428] Setting key 6e22fe8abb748f72c404d1c405477a2d
I20260808 11:31:48.934998 32470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa6c47db72c54bafbb8628151a96e578: Bootstrap starting.
I20260808 11:31:48.938861 32470 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa6c47db72c54bafbb8628151a96e578: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:48.940219 32470 log.cc:824] T 00000000000000000000000000000000 P aa6c47db72c54bafbb8628151a96e578: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:48.940780 32473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:48.926629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47292 (local address 127.26.66.190:34351)
0808 11:31:48.927874 (+ 1245us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:48.927917 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:48.928132 (+ 215us) server_negotiation.cc:407] Connection header received
0808 11:31:48.930537 (+ 2405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:48.930569 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:48.931187 (+ 618us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:48.931651 (+ 464us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:48.932248 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:48.934218 (+ 1970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:48.935518 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:48.936558 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:48.936785 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:48.937868 (+ 1083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:48.937882 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:48.937902 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:31:48.938585 (+ 683us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:48.938703 (+ 118us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:31:48.938754 (+ 51us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:48.938900 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:48.939127 (+ 227us) server_negotiation.cc:299] Negotiation successful
0808 11:31:48.939481 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":724,"thread_start_us":437,"threads_started":1}
I20260808 11:31:48.943176 32470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa6c47db72c54bafbb8628151a96e578: No bootstrap required, opened a new log
I20260808 11:31:48.944597 26890 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 11:31:48.954015 32470 raft_consensus.cc:348] T 00000000000000000000000000000000 P aa6c47db72c54bafbb8628151a96e578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa6c47db72c54bafbb8628151a96e578" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 34351 } }
I20260808 11:31:48.954460 32470 raft_consensus.cc:374] T 00000000000000000000000000000000 P aa6c47db72c54bafbb8628151a96e578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:48.954586 32470 raft_consensus.cc:729] T 00000000000000000000000000000000 P aa6c47db72c54bafbb8628151a96e578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa6c47db72c54bafbb8628151a96e578, State: Initialized, Role: FOLLOWER
I20260808 11:31:48.955200 32470 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa6c47db72c54bafbb8628151a96e578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa6c47db72c54bafbb8628151a96e578" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 34351 } }
I20260808 11:31:48.955497 32470 raft_consensus.cc:388] T 00000000000000000000000000000000 P aa6c47db72c54bafbb8628151a96e578 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:31:48.955650 32470 raft_consensus.cc:482] T 00000000000000000000000000000000 P aa6c47db72c54bafbb8628151a96e578 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:31:48.955818 32470 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa6c47db72c54bafbb8628151a96e578 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:48.957921 32470 raft_consensus.cc:504] T 00000000000000000000000000000000 P aa6c47db72c54bafbb8628151a96e578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa6c47db72c54bafbb8628151a96e578" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 34351 } }
I20260808 11:31:48.958426 32470 leader_election.cc:302] T 00000000000000000000000000000000 P aa6c47db72c54bafbb8628151a96e578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aa6c47db72c54bafbb8628151a96e578; no voters:
I20260808 11:31:48.959015 32470 leader_election.cc:288] T 00000000000000000000000000000000 P aa6c47db72c54bafbb8628151a96e578 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:31:48.959167 32475 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aa6c47db72c54bafbb8628151a96e578 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:31:48.960629 32475 raft_consensus.cc:686] T 00000000000000000000000000000000 P aa6c47db72c54bafbb8628151a96e578 [term 1 LEADER]: Becoming Leader. State: Replica: aa6c47db72c54bafbb8628151a96e578, State: Running, Role: LEADER
I20260808 11:31:48.961175 32470 sys_catalog.cc:564] T 00000000000000000000000000000000 P aa6c47db72c54bafbb8628151a96e578 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:31:48.961158 32475 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa6c47db72c54bafbb8628151a96e578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa6c47db72c54bafbb8628151a96e578" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 34351 } }
I20260808 11:31:48.964287 32477 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa6c47db72c54bafbb8628151a96e578 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa6c47db72c54bafbb8628151a96e578. Latest consensus state: current_term: 1 leader_uuid: "aa6c47db72c54bafbb8628151a96e578" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa6c47db72c54bafbb8628151a96e578" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 34351 } } }
I20260808 11:31:48.964782 32477 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa6c47db72c54bafbb8628151a96e578 [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:48.965342 32476 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa6c47db72c54bafbb8628151a96e578 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aa6c47db72c54bafbb8628151a96e578" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa6c47db72c54bafbb8628151a96e578" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 34351 } } }
I20260808 11:31:48.965706 32476 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa6c47db72c54bafbb8628151a96e578 [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:48.966768 32484 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:31:48.971922 32484 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:31:48.980933 32484 catalog_manager.cc:1347] Generated new cluster ID: fa3652836fc04bd3841cdfcd58cb2c44
I20260808 11:31:48.981061 32484 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:31:48.999228 32484 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:31:49.000556 32484 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:31:49.006918 32484 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aa6c47db72c54bafbb8628151a96e578: Generated new TSK 0
I20260808 11:31:49.007687 32484 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 11:31:49.040795 32500 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 11:31:49.040943 32500 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 11:31:49.042224 32473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:49.020935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47308 (local address 127.26.66.190:34351)
0808 11:31:49.021121 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:49.021127 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:49.021540 (+ 413us) server_negotiation.cc:407] Connection header received
0808 11:31:49.021749 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:49.021756 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:49.021853 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:49.022026 (+ 173us) server_negotiation.cc:226] Negotiated authn=JWT
0808 11:31:49.022449 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:49.023603 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:49.025081 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:49.025801 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:49.025936 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:49.026402 (+ 466us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 11:31:49.041510 (+ 15108us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44543/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 11:31:49.041920 (+ 410us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47308: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44543/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":64}
W20260808 11:31:49.042273 32499 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:31:49.020798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:34351 (local address 127.0.0.1:47308)
0808 11:31:49.021435 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:49.021451 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:49.021572 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:49.022028 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:49.022031 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:49.022040 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0808 11:31:49.022270 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:49.022277 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:49.023744 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:49.023748 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:49.024928 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:49.024943 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:49.025964 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:49.025968 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:49.026103 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:49.026135 (+ 32us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 11:31:49.041758 (+ 15623us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44543/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 11:31:49.041979 (+ 221us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.66.190:34351: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44543/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":347,"threads_started":1}
W20260808 11:31:49.042354 32473 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47308: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44543/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260808 11:31:49.044312 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 32401
I20260808 11:31:49.045504 32465 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:49.139236 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 32401
2026-08-08T11:31:49Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (745 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 11:31:49.198328 26890 mini_oidc.cc:152] Starting JWKS server
I20260808 11:31:49.200304 26890 webserver.cc:460] Webserver started at https://127.0.0.1:40609/ using document root <none> and password file <none>
I20260808 11:31:49.200555 26890 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 11:31:49.201213 26890 webserver.cc:460] Webserver started at http://127.0.0.1:41331/ using document root <none> and password file <none>
2026-08-08T11:31:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:31:49Z Disabled control of system clock
I20260808 11:31:49.237291 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:33183
--webserver_interface=127.26.66.190
--webserver_port=0
--builtin_ntp_servers=127.26.66.148:46391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:33183
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40609/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 11:31:49.565162 32507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:49.565512 32507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:49.565685 32507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:49.572745 32507 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:31:49.572890 32507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:49.572984 32507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:49.573092 32507 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:31:49.573182 32507 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 11:31:49.573271 32507 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 11:31:49.573346 32507 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40609/jwks.json
I20260808 11:31:49.582362 32507 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:46391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:33183
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:33183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40609/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:49.583626 32507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:49.585394 32507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:49.597034 32512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:49.597078 32513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:49.597327 32515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:49.598018 32507 server_base.cc:1034] running on GCE node
I20260808 11:31:49.598840 32507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:49.600271 32507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:49.601498 32507 hybrid_clock.cc:648] HybridClock initialized: now 1786188709601456 us; error 36 us; skew 500 ppm
I20260808 11:31:49.601853 32507 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:31:49.604092 32507 webserver.cc:460] Webserver started at http://127.26.66.190:46825/ using document root <none> and password file <none>
I20260808 11:31:49.604800 32507 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:49.604933 32507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:49.605253 32507 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:49.608098 32507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "7b9719c4ffb644f98f9d17f03771d1e1"
format_stamp: "Formatted at 2026-08-08 11:31:49 on dist-test-slave-zkpd"
server_key: "4df56e91ffde267b5ce692e0993803eb"
server_key_iv: "d4264d29bcc8b50f23d860d21760ec3e"
server_key_version: "encryptionkey@0"
I20260808 11:31:49.608892 32507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "7b9719c4ffb644f98f9d17f03771d1e1"
format_stamp: "Formatted at 2026-08-08 11:31:49 on dist-test-slave-zkpd"
server_key: "4df56e91ffde267b5ce692e0993803eb"
server_key_iv: "d4264d29bcc8b50f23d860d21760ec3e"
server_key_version: "encryptionkey@0"
I20260808 11:31:49.613754 32507 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260808 11:31:49.617093 32521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:49.618384 32507 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:31:49.618571 32507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "7b9719c4ffb644f98f9d17f03771d1e1"
format_stamp: "Formatted at 2026-08-08 11:31:49 on dist-test-slave-zkpd"
server_key: "4df56e91ffde267b5ce692e0993803eb"
server_key_iv: "d4264d29bcc8b50f23d860d21760ec3e"
server_key_version: "encryptionkey@0"
I20260808 11:31:49.618801 32507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:49.638475 32507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:49.639360 32507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:49.639679 32507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:49.658020 32507 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:33183
I20260808 11:31:49.658039 32574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:33183 every 8 connection(s)
I20260808 11:31:49.659338 32507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:31:49.662969 32575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:49.668087 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 32507
I20260808 11:31:49.668295 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:31:49.669118 26890 external_mini_cluster.cc:1428] Setting key 67df44bbd5f40c5176ccb8cab31229c1
I20260808 11:31:49.674566 32575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b9719c4ffb644f98f9d17f03771d1e1: Bootstrap starting.
I20260808 11:31:49.677858 32575 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b9719c4ffb644f98f9d17f03771d1e1: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:49.678897 32575 log.cc:824] T 00000000000000000000000000000000 P 7b9719c4ffb644f98f9d17f03771d1e1: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:49.682112 32575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b9719c4ffb644f98f9d17f03771d1e1: No bootstrap required, opened a new log
I20260808 11:31:49.682936 32578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:49.671092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52650 (local address 127.26.66.190:33183)
0808 11:31:49.672241 (+ 1149us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:49.672252 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:49.672298 (+ 46us) server_negotiation.cc:407] Connection header received
0808 11:31:49.673991 (+ 1693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:49.674014 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:49.674447 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:49.674865 (+ 418us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:49.675435 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:49.677022 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:49.678446 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:49.679192 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:49.679402 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:49.680678 (+ 1276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:49.680685 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:49.680698 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:31:49.681223 (+ 525us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:49.681298 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:31:49.681319 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:49.681408 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:49.681655 (+ 247us) server_negotiation.cc:299] Negotiation successful
0808 11:31:49.681992 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":409,"threads_started":1}
I20260808 11:31:49.686980 26890 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 11:31:49.691062 32575 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b9719c4ffb644f98f9d17f03771d1e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b9719c4ffb644f98f9d17f03771d1e1" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 33183 } }
I20260808 11:31:49.691416 32575 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7b9719c4ffb644f98f9d17f03771d1e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:49.691537 32575 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b9719c4ffb644f98f9d17f03771d1e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b9719c4ffb644f98f9d17f03771d1e1, State: Initialized, Role: FOLLOWER
I20260808 11:31:49.692122 32575 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b9719c4ffb644f98f9d17f03771d1e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b9719c4ffb644f98f9d17f03771d1e1" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 33183 } }
I20260808 11:31:49.692366 32575 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7b9719c4ffb644f98f9d17f03771d1e1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:31:49.692520 32575 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b9719c4ffb644f98f9d17f03771d1e1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:31:49.692689 32575 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b9719c4ffb644f98f9d17f03771d1e1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:49.694875 32575 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b9719c4ffb644f98f9d17f03771d1e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b9719c4ffb644f98f9d17f03771d1e1" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 33183 } }
I20260808 11:31:49.695350 32575 leader_election.cc:302] T 00000000000000000000000000000000 P 7b9719c4ffb644f98f9d17f03771d1e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7b9719c4ffb644f98f9d17f03771d1e1; no voters:
I20260808 11:31:49.696070 32575 leader_election.cc:288] T 00000000000000000000000000000000 P 7b9719c4ffb644f98f9d17f03771d1e1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:31:49.696228 32581 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b9719c4ffb644f98f9d17f03771d1e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:31:49.697220 32581 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b9719c4ffb644f98f9d17f03771d1e1 [term 1 LEADER]: Becoming Leader. State: Replica: 7b9719c4ffb644f98f9d17f03771d1e1, State: Running, Role: LEADER
I20260808 11:31:49.697765 32581 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b9719c4ffb644f98f9d17f03771d1e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b9719c4ffb644f98f9d17f03771d1e1" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 33183 } }
I20260808 11:31:49.698443 32575 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b9719c4ffb644f98f9d17f03771d1e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:31:49.700552 32582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b9719c4ffb644f98f9d17f03771d1e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7b9719c4ffb644f98f9d17f03771d1e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b9719c4ffb644f98f9d17f03771d1e1" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 33183 } } }
I20260808 11:31:49.700655 32583 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b9719c4ffb644f98f9d17f03771d1e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b9719c4ffb644f98f9d17f03771d1e1. Latest consensus state: current_term: 1 leader_uuid: "7b9719c4ffb644f98f9d17f03771d1e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b9719c4ffb644f98f9d17f03771d1e1" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 33183 } } }
I20260808 11:31:49.700996 32582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b9719c4ffb644f98f9d17f03771d1e1 [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:49.701131 32583 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b9719c4ffb644f98f9d17f03771d1e1 [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:49.703473 32588 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:31:49.708865 32588 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:31:49.717794 32588 catalog_manager.cc:1347] Generated new cluster ID: b447e657f137470aa95d91ea5a9331af
I20260808 11:31:49.717911 32588 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:31:49.725605 32588 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:31:49.726787 32588 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:31:49.736646 32588 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7b9719c4ffb644f98f9d17f03771d1e1: Generated new TSK 0
I20260808 11:31:49.737449 32588 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:31:49.765259 32578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:49.756576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52652 (local address 127.26.66.190:33183)
0808 11:31:49.756773 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:49.756781 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:49.757274 (+ 493us) server_negotiation.cc:407] Connection header received
0808 11:31:49.757491 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:49.757497 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:49.757597 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:49.757752 (+ 155us) server_negotiation.cc:226] Negotiated authn=JWT
0808 11:31:49.758251 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:49.759374 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:49.760880 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:49.761586 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:49.761725 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:49.762226 (+ 501us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 11:31:49.764615 (+ 2389us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40609/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 11:31:49.764941 (+ 326us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52652: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40609/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":64}
W20260808 11:31:49.765396 32578 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52652: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40609/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260808 11:31:49.767189 32606 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:31:49.756453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:33183 (local address 127.0.0.1:52652)
0808 11:31:49.757171 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:49.757187 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:49.757306 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:49.757802 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:49.757805 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:49.757815 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0808 11:31:49.758101 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:49.758109 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:49.759545 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:49.759549 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:49.760734 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:49.760747 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:49.761791 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:49.761795 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:49.761923 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:49.761954 (+ 31us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 11:31:49.764821 (+ 2867us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40609/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 11:31:49.766762 (+ 1941us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.66.190:33183: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40609/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":581,"mutex_wait_us":1634,"thread_start_us":416,"threads_started":1}
I20260808 11:31:49.768553 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 32507
I20260808 11:31:49.769702 32570 generic_service.cc:196] Checking for leaks (request via RPC)
E20260808 11:31:49.777629 32607 webserver.cc:533] Webserver: sslize failed:
E20260808 11:31:49.777724 32607 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 11:31:49.860330 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 32507
2026-08-08T11:31:49Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (721 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T11:31:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:31:49Z Disabled control of system clock
I20260808 11:31:49.954177 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:46133
--webserver_interface=127.26.66.190
--webserver_port=0
--builtin_ntp_servers=127.26.66.148:40073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:46133
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786188664137852-26890-0/testchainca.cert with env {}
W20260808 11:31:50.291076 32612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:50.291378 32612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:50.291546 32612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:50.298789 32612 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:31:50.298887 32612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:50.298987 32612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:50.299075 32612 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:31:50.299140 32612 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 11:31:50.299252 32612 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 11:31:50.299307 32612 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 11:31:50.309244 32612 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:40073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:46133
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:46133
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786188664137852-26890-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:50.310586 32612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:50.311970 32612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:50.324429 32617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:50.324451 32620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:50.324425 32618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:50.325275 32612 server_base.cc:1034] running on GCE node
I20260808 11:31:50.326068 32612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:50.327468 32612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:50.328701 32612 hybrid_clock.cc:648] HybridClock initialized: now 1786188710328669 us; error 43 us; skew 500 ppm
I20260808 11:31:50.329063 32612 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:31:50.331418 32612 webserver.cc:460] Webserver started at http://127.26.66.190:37143/ using document root <none> and password file <none>
I20260808 11:31:50.332345 32612 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:50.332492 32612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:50.332830 32612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:50.335821 32612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "d19b44978b7b409cad4932b1a02641f7"
format_stamp: "Formatted at 2026-08-08 11:31:50 on dist-test-slave-zkpd"
server_key: "cf6c52a2763664cf26f0f799a37eda86"
server_key_iv: "d1b8c5e24df9b3c35df923c2fa319e23"
server_key_version: "encryptionkey@0"
I20260808 11:31:50.336730 32612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "d19b44978b7b409cad4932b1a02641f7"
format_stamp: "Formatted at 2026-08-08 11:31:50 on dist-test-slave-zkpd"
server_key: "cf6c52a2763664cf26f0f799a37eda86"
server_key_iv: "d1b8c5e24df9b3c35df923c2fa319e23"
server_key_version: "encryptionkey@0"
I20260808 11:31:50.341789 32612 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260808 11:31:50.345266 32626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:50.346663 32612 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:31:50.346882 32612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "d19b44978b7b409cad4932b1a02641f7"
format_stamp: "Formatted at 2026-08-08 11:31:50 on dist-test-slave-zkpd"
server_key: "cf6c52a2763664cf26f0f799a37eda86"
server_key_iv: "d1b8c5e24df9b3c35df923c2fa319e23"
server_key_version: "encryptionkey@0"
I20260808 11:31:50.347106 32612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:50.381513 32612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:50.382354 32612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:50.382645 32612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:50.401158 32612 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:46133
I20260808 11:31:50.401188 32678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:46133 every 8 connection(s)
I20260808 11:31:50.402451 32612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:31:50.404763 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 32612
I20260808 11:31:50.405009 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:31:50.405864 26890 external_mini_cluster.cc:1428] Setting key e54678885c1c4ee50cdaddb38954f0ac
I20260808 11:31:50.406859 32679 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:50.420228 32682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:50.407800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43812 (local address 127.26.66.190:46133)
0808 11:31:50.408821 (+ 1021us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:50.408831 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:50.408872 (+ 41us) server_negotiation.cc:407] Connection header received
0808 11:31:50.411226 (+ 2354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:50.411247 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:50.411683 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:50.412080 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:50.412684 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:50.414025 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:50.415797 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:50.416479 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:50.416618 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:50.417914 (+ 1296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:50.417922 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:50.417937 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:31:50.418505 (+ 568us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:50.418580 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:31:50.418603 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:50.418692 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:50.418923 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 11:31:50.419252 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":622,"thread_start_us":364,"threads_started":1}
I20260808 11:31:50.420562 32679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d19b44978b7b409cad4932b1a02641f7: Bootstrap starting.
I20260808 11:31:50.423718 32679 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d19b44978b7b409cad4932b1a02641f7: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:50.423885 26890 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 11:31:50.424989 32679 log.cc:824] T 00000000000000000000000000000000 P d19b44978b7b409cad4932b1a02641f7: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:50.427803 32679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d19b44978b7b409cad4932b1a02641f7: No bootstrap required, opened a new log
I20260808 11:31:50.434917 32679 raft_consensus.cc:348] T 00000000000000000000000000000000 P d19b44978b7b409cad4932b1a02641f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d19b44978b7b409cad4932b1a02641f7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46133 } }
I20260808 11:31:50.435240 32679 raft_consensus.cc:374] T 00000000000000000000000000000000 P d19b44978b7b409cad4932b1a02641f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:50.435325 32679 raft_consensus.cc:729] T 00000000000000000000000000000000 P d19b44978b7b409cad4932b1a02641f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d19b44978b7b409cad4932b1a02641f7, State: Initialized, Role: FOLLOWER
I20260808 11:31:50.435791 32679 consensus_queue.cc:260] T 00000000000000000000000000000000 P d19b44978b7b409cad4932b1a02641f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d19b44978b7b409cad4932b1a02641f7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46133 } }
I20260808 11:31:50.436075 32679 raft_consensus.cc:388] T 00000000000000000000000000000000 P d19b44978b7b409cad4932b1a02641f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:31:50.436230 32679 raft_consensus.cc:482] T 00000000000000000000000000000000 P d19b44978b7b409cad4932b1a02641f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:31:50.436439 32679 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d19b44978b7b409cad4932b1a02641f7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:50.438694 32679 raft_consensus.cc:504] T 00000000000000000000000000000000 P d19b44978b7b409cad4932b1a02641f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d19b44978b7b409cad4932b1a02641f7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46133 } }
I20260808 11:31:50.439123 32679 leader_election.cc:302] T 00000000000000000000000000000000 P d19b44978b7b409cad4932b1a02641f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d19b44978b7b409cad4932b1a02641f7; no voters:
I20260808 11:31:50.439699 32679 leader_election.cc:288] T 00000000000000000000000000000000 P d19b44978b7b409cad4932b1a02641f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:31:50.439823 32684 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d19b44978b7b409cad4932b1a02641f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:31:50.440613 32684 raft_consensus.cc:686] T 00000000000000000000000000000000 P d19b44978b7b409cad4932b1a02641f7 [term 1 LEADER]: Becoming Leader. State: Replica: d19b44978b7b409cad4932b1a02641f7, State: Running, Role: LEADER
I20260808 11:31:50.441179 32684 consensus_queue.cc:237] T 00000000000000000000000000000000 P d19b44978b7b409cad4932b1a02641f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d19b44978b7b409cad4932b1a02641f7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46133 } }
I20260808 11:31:50.441956 32679 sys_catalog.cc:564] T 00000000000000000000000000000000 P d19b44978b7b409cad4932b1a02641f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:31:50.444343 32685 sys_catalog.cc:455] T 00000000000000000000000000000000 P d19b44978b7b409cad4932b1a02641f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d19b44978b7b409cad4932b1a02641f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d19b44978b7b409cad4932b1a02641f7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46133 } } }
I20260808 11:31:50.444577 32686 sys_catalog.cc:455] T 00000000000000000000000000000000 P d19b44978b7b409cad4932b1a02641f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d19b44978b7b409cad4932b1a02641f7. Latest consensus state: current_term: 1 leader_uuid: "d19b44978b7b409cad4932b1a02641f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d19b44978b7b409cad4932b1a02641f7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46133 } } }
I20260808 11:31:50.444824 32685 sys_catalog.cc:458] T 00000000000000000000000000000000 P d19b44978b7b409cad4932b1a02641f7 [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:50.444885 32686 sys_catalog.cc:458] T 00000000000000000000000000000000 P d19b44978b7b409cad4932b1a02641f7 [sys.catalog]: This master's current role is: LEADER
W20260808 11:31:50.453368 32700 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d19b44978b7b409cad4932b1a02641f7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 11:31:50.453469 32700 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 11:31:50.453619 32693 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:31:50.455307 32693 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:31:50.462828 32693 catalog_manager.cc:1347] Generated new cluster ID: 14096f589ce14c879bf4346c8a793d98
I20260808 11:31:50.462934 32693 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:31:50.474609 32693 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:31:50.476346 32693 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:31:50.484217 32693 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d19b44978b7b409cad4932b1a02641f7: Generated new TSK 0
I20260808 11:31:50.485168 32693 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:31:50.560953 32682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:50.507876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43826 (local address 127.26.66.190:46133)
0808 11:31:50.508128 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:50.508140 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:50.508548 (+ 408us) server_negotiation.cc:407] Connection header received
0808 11:31:50.508774 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:50.508779 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:50.508872 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:50.509034 (+ 162us) server_negotiation.cc:226] Negotiated authn=JWT
0808 11:31:50.509463 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:50.510648 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:50.512178 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:50.512883 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:50.513010 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:50.513500 (+ 490us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 11:31:50.560162 (+ 46662us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 11:31:50.560622 (+ 460us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43826: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":94}
W20260808 11:31:50.561111 32682 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43826: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260808 11:31:50.561107 32708 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:31:50.507703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:46133 (local address 127.0.0.1:43826)
0808 11:31:50.508451 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:50.508467 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:50.508588 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:50.509048 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:50.509051 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:50.509060 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0808 11:31:50.509304 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:50.509321 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:50.510786 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:50.510791 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:50.512032 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:50.512046 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:50.513047 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:50.513052 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:50.513169 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:50.513200 (+ 31us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 11:31:50.560484 (+ 47284us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 11:31:50.560741 (+ 257us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.66.190:46133: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":615,"thread_start_us":455,"threads_started":1}
I20260808 11:31:50.562678 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 32612
I20260808 11:31:50.564013 32673 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:50.660724 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 32612
2026-08-08T11:31:50Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (780 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (424 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (426 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:31:51 dist-test-slave-zkpd krb5kdc[32725](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:31:51 dist-test-slave-zkpd krb5kdc[32725](info): set up 2 sockets
Aug 08 11:31:51 dist-test-slave-zkpd krb5kdc[32725](info): commencing operation
krb5kdc: starting...
W20260808 11:31:52.646323 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.004s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:31:52 dist-test-slave-zkpd krb5kdc[32725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188712, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:31:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:31:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:31:52.891371 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:46819
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:46819
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:53.224478 32738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:53.224815 32738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:53.224982 32738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:53.232041 32738 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:31:53.232168 32738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:53.232295 32738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:53.232386 32738 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:31:53.232453 32738 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:31:53.242091 32738 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:46819
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:46819
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:53.243376 32738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:53.244716 32738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:53.256680 32743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:53.256639 32746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:53.256731 32744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:53.257417 32738 server_base.cc:1034] running on GCE node
I20260808 11:31:53.258134 32738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:53.259444 32738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:53.260694 32738 hybrid_clock.cc:648] HybridClock initialized: now 1786188713260640 us; error 53 us; skew 500 ppm
I20260808 11:31:53.261070 32738 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:53 dist-test-slave-zkpd krb5kdc[32725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188713, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:53.264458 32738 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:31:53.265930 32738 webserver.cc:460] Webserver started at http://127.26.66.190:35839/ using document root <none> and password file <none>
I20260808 11:31:53.266564 32738 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:53.266664 32738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:53.266927 32738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:53.269855 32738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "fb7adebd0c024f3f9f73639031b2ca97"
format_stamp: "Formatted at 2026-08-08 11:31:53 on dist-test-slave-zkpd"
server_key: "966b2b6f0d70dadac5a7d6167b3b164d"
server_key_iv: "72c329ade22ff2b30c0e9c604446a1bb"
server_key_version: "encryptionkey@0"
I20260808 11:31:53.270582 32738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "fb7adebd0c024f3f9f73639031b2ca97"
format_stamp: "Formatted at 2026-08-08 11:31:53 on dist-test-slave-zkpd"
server_key: "966b2b6f0d70dadac5a7d6167b3b164d"
server_key_iv: "72c329ade22ff2b30c0e9c604446a1bb"
server_key_version: "encryptionkey@0"
I20260808 11:31:53.275589 32738 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260808 11:31:53.279003 32753 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:53.280382 32738 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 11:31:53.280516 32738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "fb7adebd0c024f3f9f73639031b2ca97"
format_stamp: "Formatted at 2026-08-08 11:31:53 on dist-test-slave-zkpd"
server_key: "966b2b6f0d70dadac5a7d6167b3b164d"
server_key_iv: "72c329ade22ff2b30c0e9c604446a1bb"
server_key_version: "encryptionkey@0"
I20260808 11:31:53.280673 32738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:53.292939 32738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:53.296876 32738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:53.297135 32738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:53.315884 32738 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:46819
I20260808 11:31:53.315981 337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:46819 every 8 connection(s)
I20260808 11:31:53.317361 32738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:31:53.321049 338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:53.323411 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 32738
I20260808 11:31:53.323644 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:31:53.324374 26890 external_mini_cluster.cc:1428] Setting key bc410145275af0f0ef8dfc3c51113c67
I20260808 11:31:53.333307 338 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb7adebd0c024f3f9f73639031b2ca97: Bootstrap starting.
I20260808 11:31:53.337087 338 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fb7adebd0c024f3f9f73639031b2ca97: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:53.338460 338 log.cc:824] T 00000000000000000000000000000000 P fb7adebd0c024f3f9f73639031b2ca97: Log is configured to *not* fsync() on all Append() calls
Aug 08 11:31:53 dist-test-slave-zkpd krb5kdc[32725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188712, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:53.341526 338 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb7adebd0c024f3f9f73639031b2ca97: No bootstrap required, opened a new log
I20260808 11:31:53.347755 341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:53.326501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53746 (local address 127.26.66.190:46819)
0808 11:31:53.327307 (+ 806us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:53.327324 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:53.327365 (+ 41us) server_negotiation.cc:407] Connection header received
0808 11:31:53.329116 (+ 1751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:53.329138 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:53.329545 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:53.329866 (+ 321us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:53.331622 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:53.332989 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:53.334721 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:53.335397 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:53.335534 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:53.340563 (+ 5029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:53.340571 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:53.340585 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:53.340619 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:53.343702 (+ 3083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:53.344456 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:53.344465 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:53.344471 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:53.344642 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:53.345038 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:53.345043 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:53.345051 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:53.345553 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:53.345906 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:53.346329 (+ 423us) server_negotiation.cc:299] Negotiation successful
0808 11:31:53.346741 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":378,"threads_started":1}
I20260808 11:31:53.349795 338 raft_consensus.cc:348] T 00000000000000000000000000000000 P fb7adebd0c024f3f9f73639031b2ca97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb7adebd0c024f3f9f73639031b2ca97" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46819 } }
I20260808 11:31:53.350221 338 raft_consensus.cc:374] T 00000000000000000000000000000000 P fb7adebd0c024f3f9f73639031b2ca97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:53.350344 338 raft_consensus.cc:729] T 00000000000000000000000000000000 P fb7adebd0c024f3f9f73639031b2ca97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb7adebd0c024f3f9f73639031b2ca97, State: Initialized, Role: FOLLOWER
I20260808 11:31:53.350857 338 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb7adebd0c024f3f9f73639031b2ca97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb7adebd0c024f3f9f73639031b2ca97" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46819 } }
I20260808 11:31:53.351063 338 raft_consensus.cc:388] T 00000000000000000000000000000000 P fb7adebd0c024f3f9f73639031b2ca97 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:31:53.351155 338 raft_consensus.cc:482] T 00000000000000000000000000000000 P fb7adebd0c024f3f9f73639031b2ca97 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:31:53.351312 338 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fb7adebd0c024f3f9f73639031b2ca97 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:53.353441 338 raft_consensus.cc:504] T 00000000000000000000000000000000 P fb7adebd0c024f3f9f73639031b2ca97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb7adebd0c024f3f9f73639031b2ca97" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46819 } }
I20260808 11:31:53.353885 338 leader_election.cc:302] T 00000000000000000000000000000000 P fb7adebd0c024f3f9f73639031b2ca97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb7adebd0c024f3f9f73639031b2ca97; no voters:
I20260808 11:31:53.354429 338 leader_election.cc:288] T 00000000000000000000000000000000 P fb7adebd0c024f3f9f73639031b2ca97 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:31:53.354534 343 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fb7adebd0c024f3f9f73639031b2ca97 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:31:53.355257 343 raft_consensus.cc:686] T 00000000000000000000000000000000 P fb7adebd0c024f3f9f73639031b2ca97 [term 1 LEADER]: Becoming Leader. State: Replica: fb7adebd0c024f3f9f73639031b2ca97, State: Running, Role: LEADER
I20260808 11:31:53.355755 343 consensus_queue.cc:237] T 00000000000000000000000000000000 P fb7adebd0c024f3f9f73639031b2ca97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb7adebd0c024f3f9f73639031b2ca97" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46819 } }
I20260808 11:31:53.356678 338 sys_catalog.cc:564] T 00000000000000000000000000000000 P fb7adebd0c024f3f9f73639031b2ca97 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:31:53.358876 344 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb7adebd0c024f3f9f73639031b2ca97 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fb7adebd0c024f3f9f73639031b2ca97" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb7adebd0c024f3f9f73639031b2ca97" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46819 } } }
I20260808 11:31:53.359220 344 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb7adebd0c024f3f9f73639031b2ca97 [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:53.359683 345 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb7adebd0c024f3f9f73639031b2ca97 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fb7adebd0c024f3f9f73639031b2ca97. Latest consensus state: current_term: 1 leader_uuid: "fb7adebd0c024f3f9f73639031b2ca97" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb7adebd0c024f3f9f73639031b2ca97" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46819 } } }
I20260808 11:31:53.360002 345 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb7adebd0c024f3f9f73639031b2ca97 [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:53.361455 351 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:31:53.366662 351 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:31:53.375697 351 catalog_manager.cc:1347] Generated new cluster ID: c364c3aa19c54dd781553a0c6ce75baf
I20260808 11:31:53.375835 351 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:31:53.386930 351 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:31:53.388778 351 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:31:53.403123 351 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fb7adebd0c024f3f9f73639031b2ca97: Generated new TSK 0
I20260808 11:31:53.404157 351 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.66.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
I20260808 11:31:53.472972 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:0
--local_ip_for_outbound_sockets=127.26.66.129
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46819
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:53.809616 366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:53.809877 366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:53.809973 366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:53.816881 366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:53.816977 366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:53.817083 366 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:31:53.826208 366 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46819
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:53.827318 366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:53.828572 366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:53.841949 371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:53.841888 372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:53.842022 374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:53.842792 366 server_base.cc:1034] running on GCE node
I20260808 11:31:53.843374 366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:53.844352 366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:53.845566 366 hybrid_clock.cc:648] HybridClock initialized: now 1786188713845522 us; error 27 us; skew 500 ppm
I20260808 11:31:53.845917 366 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:53 dist-test-slave-zkpd krb5kdc[32725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188713, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:53.849216 366 init.cc:377] Logged in from keytab as kudu/127.26.66.129@KRBTEST.COM (short username kudu)
I20260808 11:31:53.850814 366 webserver.cc:460] Webserver started at http://127.26.66.129:36499/ using document root <none> and password file <none>
I20260808 11:31:53.851495 366 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:53.851648 366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:53.852031 366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:53.854945 366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-0/data/instance:
uuid: "16b124efd1464133bc99950bdb6b763a"
format_stamp: "Formatted at 2026-08-08 11:31:53 on dist-test-slave-zkpd"
server_key: "8101b15906b14a63dd0f651ea58ca55c"
server_key_iv: "a05f27be0710f9b753271c78985ce6f9"
server_key_version: "encryptionkey@0"
I20260808 11:31:53.855746 366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance:
uuid: "16b124efd1464133bc99950bdb6b763a"
format_stamp: "Formatted at 2026-08-08 11:31:53 on dist-test-slave-zkpd"
server_key: "8101b15906b14a63dd0f651ea58ca55c"
server_key_iv: "a05f27be0710f9b753271c78985ce6f9"
server_key_version: "encryptionkey@0"
I20260808 11:31:53.861066 366 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 11:31:53.864562 381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:53.865850 366 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:31:53.866034 366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "16b124efd1464133bc99950bdb6b763a"
format_stamp: "Formatted at 2026-08-08 11:31:53 on dist-test-slave-zkpd"
server_key: "8101b15906b14a63dd0f651ea58ca55c"
server_key_iv: "a05f27be0710f9b753271c78985ce6f9"
server_key_version: "encryptionkey@0"
I20260808 11:31:53.866258 366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:53.903568 366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:53.908025 366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:53.908317 366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:53.909296 366 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:31:53.910597 366 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:53.910702 366 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:53.910863 366 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:53.910940 366 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:53.945652 366 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:42779
I20260808 11:31:53.945695 498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:42779 every 8 connection(s)
I20260808 11:31:53.947016 366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:31:53.957531 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 366
I20260808 11:31:53.957783 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance
I20260808 11:31:53.958737 26890 external_mini_cluster.cc:1428] Setting key ab2b9b732c9b6049f7254f348fa68f76
Aug 08 11:31:53 dist-test-slave-zkpd krb5kdc[32725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188713, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:53.970950 501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:53.949659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:47349 (local address 127.26.66.190:46819)
0808 11:31:53.950134 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:53.950138 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:53.951122 (+ 984us) server_negotiation.cc:407] Connection header received
0808 11:31:53.952973 (+ 1851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:53.952977 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:53.953045 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:53.953147 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:53.954610 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:53.955775 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:53.958593 (+ 2818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:53.959407 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:53.959560 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:53.964330 (+ 4770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:53.964337 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:53.964341 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:53.964383 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:53.967657 (+ 3274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:53.968473 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:53.968480 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:53.968484 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:53.968619 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:53.969069 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:53.969074 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:53.969077 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:53.969411 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:53.969564 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:53.970324 (+ 760us) server_negotiation.cc:299] Negotiation successful
0808 11:31:53.970583 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":239,"threads_started":1}
I20260808 11:31:53.972114 503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:53.950257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:46819 (local address 127.26.66.129:47349)
0808 11:31:53.950967 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:53.951006 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:53.952700 (+ 1694us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:53.953357 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:53.953364 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:53.953889 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:53.954436 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:53.954453 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:53.956050 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:53.956058 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:53.958428 (+ 2370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:53.958447 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:53.959665 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:53.959675 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:53.960354 (+ 679us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:53.961169 (+ 815us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:53.961208 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:53.964117 (+ 2909us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:53.967825 (+ 3708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:53.967833 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:53.967849 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:53.968341 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:53.968741 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:53.968746 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:53.968750 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:53.968942 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:53.969536 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:53.969544 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:53.969897 (+ 353us) client_negotiation.cc:769] Sending connection context
0808 11:31:53.970204 (+ 307us) client_negotiation.cc:240] Negotiation successful
0808 11:31:53.970862 (+ 658us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":281,"threads_started":1}
I20260808 11:31:53.973712 499 heartbeater.cc:347] Connected to a master server at 127.26.66.190:46819
I20260808 11:31:53.974026 499 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:53.974874 499 heartbeater.cc:511] Master 127.26.66.190:46819 requested a full tablet report, sending...
I20260808 11:31:53.977416 302 ts_manager.cc:194] Registered new tserver with Master: 16b124efd1464133bc99950bdb6b763a (127.26.66.129:42779)
I20260808 11:31:53.979597 302 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.129@KRBTEST.COM'} at 127.26.66.129:47349
WARNING: no policy specified for kudu/127.26.66.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
I20260808 11:31:54.018565 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:0
--local_ip_for_outbound_sockets=127.26.66.130
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46819
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:54.353885 506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:54.354151 506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:54.354342 506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:54.361940 506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:54.362082 506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:54.362274 506 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:31:54.372061 506 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46819
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:54.373323 506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:54.374620 506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:54.387845 512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:54.387945 511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:54.387883 514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:54.388736 506 server_base.cc:1034] running on GCE node
I20260808 11:31:54.389320 506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:54.390277 506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:54.391505 506 hybrid_clock.cc:648] HybridClock initialized: now 1786188714391474 us; error 43 us; skew 500 ppm
I20260808 11:31:54.391808 506 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:54 dist-test-slave-zkpd krb5kdc[32725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188714, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:54.394994 506 init.cc:377] Logged in from keytab as kudu/127.26.66.130@KRBTEST.COM (short username kudu)
I20260808 11:31:54.396431 506 webserver.cc:460] Webserver started at http://127.26.66.130:45009/ using document root <none> and password file <none>
I20260808 11:31:54.397107 506 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:54.397274 506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:54.397589 506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:54.400523 506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-1/data/instance:
uuid: "6212d8ce557c4787b313560c7f59b0bd"
format_stamp: "Formatted at 2026-08-08 11:31:54 on dist-test-slave-zkpd"
server_key: "c69d4048d09c89d6070ae99f2e45b935"
server_key_iv: "f6de83fe26b54b432696235466ab3ddc"
server_key_version: "encryptionkey@0"
I20260808 11:31:54.401319 506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance:
uuid: "6212d8ce557c4787b313560c7f59b0bd"
format_stamp: "Formatted at 2026-08-08 11:31:54 on dist-test-slave-zkpd"
server_key: "c69d4048d09c89d6070ae99f2e45b935"
server_key_iv: "f6de83fe26b54b432696235466ab3ddc"
server_key_version: "encryptionkey@0"
I20260808 11:31:54.406580 506 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 11:31:54.409910 521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:54.411163 506 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 11:31:54.411343 506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "6212d8ce557c4787b313560c7f59b0bd"
format_stamp: "Formatted at 2026-08-08 11:31:54 on dist-test-slave-zkpd"
server_key: "c69d4048d09c89d6070ae99f2e45b935"
server_key_iv: "f6de83fe26b54b432696235466ab3ddc"
server_key_version: "encryptionkey@0"
I20260808 11:31:54.411571 506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:54.430989 506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:54.435245 506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:54.435564 506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:54.436554 506 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:31:54.437846 506 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:54.437952 506 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:54.438123 506 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:54.438197 506 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:54.472935 506 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:36971
I20260808 11:31:54.472960 640 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:36971 every 8 connection(s)
I20260808 11:31:54.474269 506 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:31:54.481635 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 506
I20260808 11:31:54.481859 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance
I20260808 11:31:54.482440 26890 external_mini_cluster.cc:1428] Setting key ecb76a62fab6a3fc2d20c3b5046f931f
Aug 08 11:31:54 dist-test-slave-zkpd krb5kdc[32725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188714, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:54.497291 643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:54.476925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:60917 (local address 127.26.66.190:46819)
0808 11:31:54.477381 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:54.477386 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:54.478450 (+ 1064us) server_negotiation.cc:407] Connection header received
0808 11:31:54.480236 (+ 1786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:54.480241 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:54.480327 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:54.480427 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:54.481978 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:54.483057 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:54.485004 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:54.485779 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:54.485924 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:54.490297 (+ 4373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:54.490306 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:54.490314 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:54.490363 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:54.494039 (+ 3676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:54.494766 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:54.494775 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:54.494781 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:54.494945 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:54.495362 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:54.495370 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:54.495376 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:54.495686 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:54.495807 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:54.496857 (+ 1050us) server_negotiation.cc:299] Negotiation successful
0808 11:31:54.497018 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":236,"threads_started":1}
I20260808 11:31:54.498747 644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:54.477492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:46819 (local address 127.26.66.130:60917)
0808 11:31:54.478286 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:54.478328 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:54.479992 (+ 1664us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:54.480631 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:54.480638 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:54.481177 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:54.481747 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:54.481796 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:54.483229 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:54.483235 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:54.484839 (+ 1604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:54.484856 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:54.486242 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:54.486251 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:54.486596 (+ 345us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:54.487353 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:54.487394 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:54.490062 (+ 2668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:54.494192 (+ 4130us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:54.494198 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:54.494209 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:54.494630 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:54.495053 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:54.495056 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:54.495058 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:54.495234 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:54.495943 (+ 709us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:54.495954 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:54.496404 (+ 450us) client_negotiation.cc:769] Sending connection context
0808 11:31:54.496739 (+ 335us) client_negotiation.cc:240] Negotiation successful
0808 11:31:54.497318 (+ 579us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":368,"threads_started":1}
I20260808 11:31:54.500468 641 heartbeater.cc:347] Connected to a master server at 127.26.66.190:46819
I20260808 11:31:54.500799 641 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:54.501538 641 heartbeater.cc:511] Master 127.26.66.190:46819 requested a full tablet report, sending...
I20260808 11:31:54.503084 302 ts_manager.cc:194] Registered new tserver with Master: 6212d8ce557c4787b313560c7f59b0bd (127.26.66.130:36971)
I20260808 11:31:54.504364 302 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.130@KRBTEST.COM'} at 127.26.66.130:60917
WARNING: no policy specified for kudu/127.26.66.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
I20260808 11:31:54.541707 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:0
--local_ip_for_outbound_sockets=127.26.66.131
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46819
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:54.886461 647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:54.886864 647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:54.887072 647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:54.899117 647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:54.899264 647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:54.899461 647 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:31:54.918913 647 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46819
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:54.920354 647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:54.921648 647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:54.934875 652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:54.935024 653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:54.935026 655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:54.936049 647 server_base.cc:1034] running on GCE node
I20260808 11:31:54.936686 647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:54.937639 647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:54.938874 647 hybrid_clock.cc:648] HybridClock initialized: now 1786188714938842 us; error 55 us; skew 500 ppm
I20260808 11:31:54.939186 647 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:54 dist-test-slave-zkpd krb5kdc[32725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188714, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:54.942435 647 init.cc:377] Logged in from keytab as kudu/127.26.66.131@KRBTEST.COM (short username kudu)
I20260808 11:31:54.943847 647 webserver.cc:460] Webserver started at http://127.26.66.131:39591/ using document root <none> and password file <none>
I20260808 11:31:54.944556 647 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:54.944661 647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:54.945019 647 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:54.949072 647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-2/data/instance:
uuid: "294d107beaaa445babb50b39883ad71c"
format_stamp: "Formatted at 2026-08-08 11:31:54 on dist-test-slave-zkpd"
server_key: "a1149e80c58973061463ff6abd82e228"
server_key_iv: "3bf342001c54936973502cd5a9fabe8e"
server_key_version: "encryptionkey@0"
I20260808 11:31:54.950085 647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance:
uuid: "294d107beaaa445babb50b39883ad71c"
format_stamp: "Formatted at 2026-08-08 11:31:54 on dist-test-slave-zkpd"
server_key: "a1149e80c58973061463ff6abd82e228"
server_key_iv: "3bf342001c54936973502cd5a9fabe8e"
server_key_version: "encryptionkey@0"
I20260808 11:31:54.955655 647 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 11:31:54.959219 662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:54.960638 647 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:31:54.960791 647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "294d107beaaa445babb50b39883ad71c"
format_stamp: "Formatted at 2026-08-08 11:31:54 on dist-test-slave-zkpd"
server_key: "a1149e80c58973061463ff6abd82e228"
server_key_iv: "3bf342001c54936973502cd5a9fabe8e"
server_key_version: "encryptionkey@0"
I20260808 11:31:54.960956 647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:54.982028 647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:54.982620 499 heartbeater.cc:503] Master 127.26.66.190:46819 was elected leader, sending a full tablet report...
I20260808 11:31:54.986920 647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:54.987277 647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:54.988368 647 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:31:54.989707 647 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:54.989820 647 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:54.989977 647 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:54.990051 647 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:55.022938 647 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:41301
I20260808 11:31:55.023049 775 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:41301 every 8 connection(s)
I20260808 11:31:55.024300 647 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:31:55.025959 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 647
I20260808 11:31:55.026165 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance
I20260808 11:31:55.026611 26890 external_mini_cluster.cc:1428] Setting key 8b3eb4aaefa3592c3e49d54097a8c802
Aug 08 11:31:55 dist-test-slave-zkpd krb5kdc[32725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188714, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:31:55.044414 778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:55.027073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:42863 (local address 127.26.66.190:46819)
0808 11:31:55.027590 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:55.027594 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:55.028770 (+ 1176us) server_negotiation.cc:407] Connection header received
0808 11:31:55.030597 (+ 1827us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:55.030601 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:55.030675 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:55.030771 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:55.032312 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:55.033086 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:55.034621 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:55.035011 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:55.035103 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:55.038518 (+ 3415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:55.038523 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:55.038526 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:55.038565 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:55.041464 (+ 2899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:55.042374 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:55.042378 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:55.042380 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:55.042502 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:55.042895 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:55.042899 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:55.042901 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:55.043157 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:55.043271 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:55.043979 (+ 708us) server_negotiation.cc:299] Negotiation successful
0808 11:31:55.044135 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":281,"threads_started":1}
I20260808 11:31:55.045346 779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:55.027669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:46819 (local address 127.26.66.131:42863)
0808 11:31:55.028595 (+ 926us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:55.028655 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:55.030355 (+ 1700us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:55.030987 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:55.030995 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:55.031511 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:55.032163 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:55.032183 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:55.033225 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:55.033229 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:55.034492 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:55.034504 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:55.035201 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:55.035205 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:55.035403 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:55.036090 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:55.036117 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:55.038336 (+ 2219us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:55.041622 (+ 3286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:55.041630 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:55.041645 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:55.042262 (+ 617us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:55.042610 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:55.042613 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:55.042615 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:55.042789 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:55.043260 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:55.043265 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:55.043580 (+ 315us) client_negotiation.cc:769] Sending connection context
0808 11:31:55.043803 (+ 223us) client_negotiation.cc:240] Negotiation successful
0808 11:31:55.044245 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"thread_start_us":418,"threads_started":1}
I20260808 11:31:55.046655 776 heartbeater.cc:347] Connected to a master server at 127.26.66.190:46819
I20260808 11:31:55.046916 776 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:55.047569 776 heartbeater.cc:511] Master 127.26.66.190:46819 requested a full tablet report, sending...
I20260808 11:31:55.049001 302 ts_manager.cc:194] Registered new tserver with Master: 294d107beaaa445babb50b39883ad71c (127.26.66.131:41301)
I20260808 11:31:55.049736 302 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.131@KRBTEST.COM'} at 127.26.66.131:42863
I20260808 11:31:55.054307 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/test-admin.keytab.
Aug 08 11:31:55 dist-test-slave-zkpd krb5kdc[32725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:55.089641 26890 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 11:31:55.095074 784 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:31:55.092396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60636 (local address 127.26.66.129:42779)
0808 11:31:55.093106 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:55.093117 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:55.093152 (+ 35us) server_negotiation.cc:407] Connection header received
0808 11:31:55.093244 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:55.093251 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:55.093478 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:55.093661 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:55.094650 (+ 989us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60636: BlockingRecv error: recv got EOF from 127.0.0.1:60636 (error 108)
Metrics: {"server-negotiator.queue_time_us":520,"thread_start_us":326,"threads_started":1}
W20260808 11:31:55.095392 26890 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/krb5cc' of type FILE
Aug 08 11:31:55 dist-test-slave-zkpd krb5kdc[32725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:55.097110 26890 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 11:31:55 dist-test-slave-zkpd krb5kdc[32725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:55.098521 26890 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 11:31:55 dist-test-slave-zkpd krb5kdc[32725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.129@KRBTEST.COM
I20260808 11:31:55.113950 784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:55.100246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60640 (local address 127.26.66.129:42779)
0808 11:31:55.100451 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:55.100461 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:55.100616 (+ 155us) server_negotiation.cc:407] Connection header received
0808 11:31:55.100753 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:55.100756 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:55.100816 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:55.100898 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:55.101843 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:55.102909 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:55.104202 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:55.104775 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:55.104886 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:55.108556 (+ 3670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:55.108573 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:55.108587 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:55.108620 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:55.111318 (+ 2698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:55.111996 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:55.112003 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:55.112005 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:55.112120 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:55.112474 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:55.112477 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:55.112479 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:55.112823 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:55.113050 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:55.113346 (+ 296us) server_negotiation.cc:299] Negotiation successful
0808 11:31:55.113634 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
W20260808 11:31:55.120206 784 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:31:55.118321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60654 (local address 127.26.66.129:42779)
0808 11:31:55.118542 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:55.118547 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:55.118778 (+ 231us) server_negotiation.cc:407] Connection header received
0808 11:31:55.118979 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:55.118984 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:55.119051 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:55.119151 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:55.119944 (+ 793us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60654: BlockingRecv error: recv got EOF from 127.0.0.1:60654 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260808 11:31:55.120425 26890 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/krb5cc' of type FILE
Aug 08 11:31:55 dist-test-slave-zkpd krb5kdc[32725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:55.121912 26890 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 11:31:55 dist-test-slave-zkpd krb5kdc[32725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:55.123212 26890 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 11:31:55 dist-test-slave-zkpd krb5kdc[32725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.129@KRBTEST.COM
I20260808 11:31:55.136996 784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:55.124615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60670 (local address 127.26.66.129:42779)
0808 11:31:55.124810 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:55.124815 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:55.125023 (+ 208us) server_negotiation.cc:407] Connection header received
0808 11:31:55.125199 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:55.125208 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:55.125260 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:55.125375 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:55.126295 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:55.127010 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:55.128388 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:55.128804 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:55.128954 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:55.132474 (+ 3520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:55.132478 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:55.132481 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:55.132523 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:55.134894 (+ 2371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:55.135453 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:55.135456 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:55.135459 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:55.135570 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:55.135880 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:55.135883 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:55.135885 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:55.136190 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:55.136384 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:55.136625 (+ 241us) server_negotiation.cc:299] Negotiation successful
0808 11:31:55.136775 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260808 11:31:55.141207 784 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:31:55.139472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60684 (local address 127.26.66.129:42779)
0808 11:31:55.139675 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:55.139683 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:55.139965 (+ 282us) server_negotiation.cc:407] Connection header received
0808 11:31:55.140141 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:55.140145 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:55.140208 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:55.140296 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:55.140946 (+ 650us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60684: BlockingRecv error: recv got EOF from 127.0.0.1:60684 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260808 11:31:55.141584 26890 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786188664137852-26890-0/krb5kdc/krb5cc)
Aug 08 11:31:55 dist-test-slave-zkpd krb5kdc[32725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:55.143092 26890 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 11:31:55 dist-test-slave-zkpd krb5kdc[32725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:55.144456 26890 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 11:31:55 dist-test-slave-zkpd krb5kdc[32725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.129@KRBTEST.COM
I20260808 11:31:55.158185 784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:55.145672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60698 (local address 127.26.66.129:42779)
0808 11:31:55.145809 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:55.145814 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:55.146193 (+ 379us) server_negotiation.cc:407] Connection header received
0808 11:31:55.146301 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:55.146305 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:55.146354 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:55.146427 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:55.147280 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:55.148032 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:55.149217 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:55.149626 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:55.149716 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:55.153127 (+ 3411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:55.153132 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:55.153135 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:55.153164 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:55.155757 (+ 2593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:55.156399 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:55.156403 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:55.156405 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:55.156612 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:55.156954 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:55.156957 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:55.156958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:55.157187 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:55.157430 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:55.157669 (+ 239us) server_negotiation.cc:299] Negotiation successful
0808 11:31:55.157882 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 11:31:55.159694 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 366
I20260808 11:31:55.171222 784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:55.160436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60708 (local address 127.26.66.129:42779)
0808 11:31:55.160627 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:55.160636 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:55.160978 (+ 342us) server_negotiation.cc:407] Connection header received
0808 11:31:55.161100 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:55.161103 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:55.161155 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:55.161259 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:55.162141 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:55.162776 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:55.163872 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:55.164357 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:55.164450 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:55.166525 (+ 2075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:55.166530 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:55.166533 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:55.166561 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:55.168802 (+ 2241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:55.169421 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:55.169428 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:55.169431 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:55.169561 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:55.169951 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:55.169956 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:55.169961 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:55.170204 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:55.170507 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:55.170827 (+ 320us) server_negotiation.cc:299] Negotiation successful
0808 11:31:55.170980 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 11:31:55.171815 494 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:55.256520 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 366
I20260808 11:31:55.277838 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 506
Aug 08 11:31:55 dist-test-slave-zkpd krb5kdc[32725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.130@KRBTEST.COM
I20260808 11:31:55.293399 798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:55.278772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59032 (local address 127.26.66.130:36971)
0808 11:31:55.279322 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:55.279329 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:55.279356 (+ 27us) server_negotiation.cc:407] Connection header received
0808 11:31:55.279418 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:55.279424 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:55.279623 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:55.279756 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:55.280778 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:55.281767 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:55.282971 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:55.283515 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:55.283609 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:55.287575 (+ 3966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:55.287586 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:55.287599 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:55.287637 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:55.290433 (+ 2796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:55.291066 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:55.291079 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:55.291082 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:55.291207 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:55.291611 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:55.291615 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:55.291617 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:55.292211 (+ 594us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:55.292522 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:55.292859 (+ 337us) server_negotiation.cc:299] Negotiation successful
0808 11:31:55.293108 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":268,"threads_started":1}
I20260808 11:31:55.294698 636 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:55.378619 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 506
I20260808 11:31:55.399137 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 647
Aug 08 11:31:55 dist-test-slave-zkpd krb5kdc[32725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.131@KRBTEST.COM
I20260808 11:31:55.414888 800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:55.400240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53104 (local address 127.26.66.131:41301)
0808 11:31:55.400955 (+ 715us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:55.400961 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:55.400988 (+ 27us) server_negotiation.cc:407] Connection header received
0808 11:31:55.401047 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:55.401052 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:55.401248 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:55.401469 (+ 221us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:55.402627 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:55.403747 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:55.405077 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:55.405641 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:55.405738 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:55.409617 (+ 3879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:55.409630 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:55.409644 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:55.409680 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:55.412476 (+ 2796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:55.413073 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:55.413079 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:55.413081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:55.413193 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:55.413513 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:55.413516 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:55.413517 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:55.413859 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:55.414082 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:55.414328 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 11:31:55.414606 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":393,"threads_started":1}
I20260808 11:31:55.416190 771 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:55.501211 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 647
I20260808 11:31:55.521791 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 32738
I20260808 11:31:55.523017 333 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:31:55.627504 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 32738
2026-08-08T11:31:55Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4122 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:31:55 dist-test-slave-zkpd krb5kdc[805](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:31:55 dist-test-slave-zkpd krb5kdc[805](info): set up 2 sockets
Aug 08 11:31:55 dist-test-slave-zkpd krb5kdc[805](info): commencing operation
krb5kdc: starting...
W20260808 11:31:56.762422 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.089s user 0.008s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:31:56 dist-test-slave-zkpd krb5kdc[805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188716, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:31:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:31:56Z Disabled control of system clock
WARNING: no policy specified for oryx/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.190.keytab.
Entry for principal oryx/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.190.keytab.
I20260808 11:31:57.023640 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:42549
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.190.keytab
--principal=oryx/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:32927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:42549
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:57.370913 818 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:57.371206 818 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:57.371382 818 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:57.379590 818 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:31:57.379720 818 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:57.379947 818 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:57.380070 818 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:31:57.380141 818 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:31:57.390374 818 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:32927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:42549
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.190.keytab
--principal=oryx/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:42549
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:57.391678 818 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:57.393153 818 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:57.405025 823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:57.404961 826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:57.405073 824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:57.413369 818 server_base.cc:1034] running on GCE node
I20260808 11:31:57.414213 818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:57.415616 818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:57.416869 818 hybrid_clock.cc:648] HybridClock initialized: now 1786188717416803 us; error 78 us; skew 500 ppm
I20260808 11:31:57.417212 818 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:57 dist-test-slave-zkpd krb5kdc[805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188717, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:57.420413 818 init.cc:377] Logged in from keytab as oryx/127.26.66.190@KRBTEST.COM (short username oryx)
I20260808 11:31:57.422034 818 webserver.cc:460] Webserver started at http://127.26.66.190:36055/ using document root <none> and password file <none>
I20260808 11:31:57.422742 818 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:57.422901 818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:57.423210 818 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:57.426244 818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "6316a06b9ecf40daa1a69236580155c2"
format_stamp: "Formatted at 2026-08-08 11:31:57 on dist-test-slave-zkpd"
server_key: "eab01d9f4317c26a5ad67a23f1599ca2"
server_key_iv: "64393c8a5310cd0d074b07b522ddf024"
server_key_version: "encryptionkey@0"
I20260808 11:31:57.427028 818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "6316a06b9ecf40daa1a69236580155c2"
format_stamp: "Formatted at 2026-08-08 11:31:57 on dist-test-slave-zkpd"
server_key: "eab01d9f4317c26a5ad67a23f1599ca2"
server_key_iv: "64393c8a5310cd0d074b07b522ddf024"
server_key_version: "encryptionkey@0"
I20260808 11:31:57.432106 818 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 11:31:57.435443 833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:57.436856 818 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:31:57.436986 818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "6316a06b9ecf40daa1a69236580155c2"
format_stamp: "Formatted at 2026-08-08 11:31:57 on dist-test-slave-zkpd"
server_key: "eab01d9f4317c26a5ad67a23f1599ca2"
server_key_iv: "64393c8a5310cd0d074b07b522ddf024"
server_key_version: "encryptionkey@0"
I20260808 11:31:57.437139 818 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:57.472859 818 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:57.477155 818 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:57.477495 818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:57.497186 818 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:42549
I20260808 11:31:57.497220 887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:42549 every 8 connection(s)
I20260808 11:31:57.498682 818 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:31:57.502585 888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:57.508402 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 818
I20260808 11:31:57.508625 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:31:57.509327 26890 external_mini_cluster.cc:1428] Setting key c09a37b5693de84070fc5009db73b688
I20260808 11:31:57.513375 888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2: Bootstrap starting.
I20260808 11:31:57.517191 888 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:57.518280 888 log.cc:824] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:57.521502 888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2: No bootstrap required, opened a new log
Aug 08 11:31:57 dist-test-slave-zkpd krb5kdc[805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188716, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM
I20260808 11:31:57.529935 888 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } }
I20260808 11:31:57.530351 888 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:57.530478 888 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6316a06b9ecf40daa1a69236580155c2, State: Initialized, Role: FOLLOWER
I20260808 11:31:57.531077 888 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } }
I20260808 11:31:57.531361 888 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:31:57.531540 888 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:31:57.531742 888 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:57.533293 891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:57.511405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42584 (local address 127.26.66.190:42549)
0808 11:31:57.512223 (+ 818us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:57.512234 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:57.512275 (+ 41us) server_negotiation.cc:407] Connection header received
0808 11:31:57.514139 (+ 1864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:57.514162 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:57.514525 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:57.514841 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:57.516776 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:57.518140 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:57.519718 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:57.520467 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:57.520603 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:57.525424 (+ 4821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:57.525435 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:57.525454 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:57.525505 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:57.528821 (+ 3316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:57.529546 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:57.529553 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:57.529560 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:57.529726 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:57.530135 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:57.530141 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:57.530146 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:57.530964 (+ 818us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:57.531329 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:57.531762 (+ 433us) server_negotiation.cc:299] Negotiation successful
0808 11:31:57.532234 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":616,"thread_start_us":396,"threads_started":1}
I20260808 11:31:57.534359 888 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } }
I20260808 11:31:57.534863 888 leader_election.cc:302] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6316a06b9ecf40daa1a69236580155c2; no voters:
I20260808 11:31:57.535544 888 leader_election.cc:288] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:31:57.535657 893 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:31:57.536887 893 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [term 1 LEADER]: Becoming Leader. State: Replica: 6316a06b9ecf40daa1a69236580155c2, State: Running, Role: LEADER
I20260808 11:31:57.537459 893 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } }
I20260808 11:31:57.537948 888 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:31:57.540416 894 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6316a06b9ecf40daa1a69236580155c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } }
I20260808 11:31:57.540877 894 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:57.541989 895 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6316a06b9ecf40daa1a69236580155c2. Latest consensus state: current_term: 1 leader_uuid: "6316a06b9ecf40daa1a69236580155c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } }
I20260808 11:31:57.542346 895 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [sys.catalog]: This master's current role is: LEADER
I20260808 11:31:57.543439 900 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:31:57.547677 900 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:31:57.556468 900 catalog_manager.cc:1347] Generated new cluster ID: 5297473404864234a5651d18db96dd17
I20260808 11:31:57.556578 900 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:31:57.568392 900 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:31:57.569702 900 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:31:57.586941 900 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2: Generated new TSK 0
I20260808 11:31:57.587771 900 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.26.66.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.66.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.66.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.129.keytab.
Entry for principal oryx/127.26.66.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.129.keytab.
I20260808 11:31:57.659360 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:0
--local_ip_for_outbound_sockets=127.26.66.129
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:42549
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.129.keytab
--principal=oryx/127.26.66.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:32927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:58.002637 914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:58.002894 914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:58.003062 914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:58.010365 914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:58.010474 914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:58.010679 914 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:31:58.020429 914 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:32927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.129.keytab
--principal=oryx/127.26.66.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:42549
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:58.021662 914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:58.023029 914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:58.036901 919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:58.036872 920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:58.037258 922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:58.037956 914 server_base.cc:1034] running on GCE node
I20260808 11:31:58.038653 914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:58.039630 914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:58.040856 914 hybrid_clock.cc:648] HybridClock initialized: now 1786188718040799 us; error 52 us; skew 500 ppm
I20260808 11:31:58.041182 914 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:58 dist-test-slave-zkpd krb5kdc[805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188718, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:58.044473 914 init.cc:377] Logged in from keytab as oryx/127.26.66.129@KRBTEST.COM (short username oryx)
I20260808 11:31:58.045986 914 webserver.cc:460] Webserver started at http://127.26.66.129:40145/ using document root <none> and password file <none>
I20260808 11:31:58.046664 914 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:58.046815 914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:58.047122 914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:58.050194 914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/data/instance:
uuid: "571ff9c747d54ad4b5082705b118489d"
format_stamp: "Formatted at 2026-08-08 11:31:58 on dist-test-slave-zkpd"
server_key: "85e9de57290a4a5ce110b884b85c647f"
server_key_iv: "f471baa978ec47311767f3e11bf40c75"
server_key_version: "encryptionkey@0"
I20260808 11:31:58.051043 914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance:
uuid: "571ff9c747d54ad4b5082705b118489d"
format_stamp: "Formatted at 2026-08-08 11:31:58 on dist-test-slave-zkpd"
server_key: "85e9de57290a4a5ce110b884b85c647f"
server_key_iv: "f471baa978ec47311767f3e11bf40c75"
server_key_version: "encryptionkey@0"
I20260808 11:31:58.056308 914 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 11:31:58.059669 929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:58.061018 914 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:31:58.061192 914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "571ff9c747d54ad4b5082705b118489d"
format_stamp: "Formatted at 2026-08-08 11:31:58 on dist-test-slave-zkpd"
server_key: "85e9de57290a4a5ce110b884b85c647f"
server_key_iv: "f471baa978ec47311767f3e11bf40c75"
server_key_version: "encryptionkey@0"
I20260808 11:31:58.061398 914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:58.082983 914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:58.087251 914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:58.087543 914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:58.088581 914 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:31:58.090071 914 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:58.090178 914 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:58.090332 914 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:58.090405 914 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:58.127151 914 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:37937
I20260808 11:31:58.127195 1044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:37937 every 8 connection(s)
I20260808 11:31:58.128731 914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:31:58.136490 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 914
I20260808 11:31:58.136741 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance
I20260808 11:31:58.137409 26890 external_mini_cluster.cc:1428] Setting key afc3f47d03206076cb3a92ae92764e55
Aug 08 11:31:58 dist-test-slave-zkpd krb5kdc[805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188718, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM
I20260808 11:31:58.152462 1047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:58.131531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:57453 (local address 127.26.66.190:42549)
0808 11:31:58.132058 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:58.132063 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:58.133124 (+ 1061us) server_negotiation.cc:407] Connection header received
0808 11:31:58.135245 (+ 2121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:58.135252 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:58.135380 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:58.135521 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:58.137378 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:58.138480 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:58.140794 (+ 2314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:58.141320 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:58.141442 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:58.145981 (+ 4539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:58.145986 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:58.145990 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:58.146025 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:58.148997 (+ 2972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:58.149825 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:58.149837 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:58.149839 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:58.149969 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:58.150463 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:58.150467 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:58.150469 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:58.150752 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:58.150925 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:58.151713 (+ 788us) server_negotiation.cc:299] Negotiation successful
0808 11:31:58.152007 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":233,"threads_started":1}
I20260808 11:31:58.153503 1048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:58.132154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.26.66.129:57453)
0808 11:31:58.132933 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:58.132987 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:58.134942 (+ 1955us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:58.135787 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:58.135796 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:58.136465 (+ 669us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:58.137182 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:58.137201 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:58.138643 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:58.138647 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:58.140603 (+ 1956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:58.140622 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:58.141573 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:58.141583 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:58.141938 (+ 355us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:58.142729 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:58.142767 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:58.145710 (+ 2943us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:58.149158 (+ 3448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:58.149168 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:58.149187 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:58.149671 (+ 484us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:58.150096 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:58.150102 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:58.150106 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:58.150320 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:58.150897 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:58.150906 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:58.151293 (+ 387us) client_negotiation.cc:769] Sending connection context
0808 11:31:58.151585 (+ 292us) client_negotiation.cc:240] Negotiation successful
0808 11:31:58.152227 (+ 642us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":294,"threads_started":1}
I20260808 11:31:58.155290 1045 heartbeater.cc:347] Connected to a master server at 127.26.66.190:42549
I20260808 11:31:58.155632 1045 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:58.156637 1045 heartbeater.cc:511] Master 127.26.66.190:42549 requested a full tablet report, sending...
I20260808 11:31:58.159123 851 ts_manager.cc:194] Registered new tserver with Master: 571ff9c747d54ad4b5082705b118489d (127.26.66.129:37937)
I20260808 11:31:58.161340 851 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.66.129@KRBTEST.COM'} at 127.26.66.129:57453
WARNING: no policy specified for oryx/127.26.66.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.66.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.66.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.130.keytab.
Entry for principal oryx/127.26.66.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.130.keytab.
I20260808 11:31:58.200881 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:0
--local_ip_for_outbound_sockets=127.26.66.130
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:42549
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.130.keytab
--principal=oryx/127.26.66.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:32927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:58.549891 1051 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:58.550237 1051 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:58.550412 1051 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:58.557852 1051 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:58.558012 1051 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:58.558184 1051 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:31:58.568454 1051 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:32927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.130.keytab
--principal=oryx/127.26.66.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:42549
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:58.569819 1051 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:58.571173 1051 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:58.584916 1059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:58.584971 1057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:58.585008 1056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:58.585829 1051 server_base.cc:1034] running on GCE node
I20260808 11:31:58.586491 1051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:58.587493 1051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:58.588749 1051 hybrid_clock.cc:648] HybridClock initialized: now 1786188718588699 us; error 34 us; skew 500 ppm
I20260808 11:31:58.589090 1051 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:58 dist-test-slave-zkpd krb5kdc[805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188718, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:58.592368 1051 init.cc:377] Logged in from keytab as oryx/127.26.66.130@KRBTEST.COM (short username oryx)
I20260808 11:31:58.593984 1051 webserver.cc:460] Webserver started at http://127.26.66.130:45147/ using document root <none> and password file <none>
I20260808 11:31:58.594738 1051 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:58.594882 1051 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:58.595196 1051 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:58.598371 1051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/data/instance:
uuid: "1dadf97038de45fc80e51464a0555345"
format_stamp: "Formatted at 2026-08-08 11:31:58 on dist-test-slave-zkpd"
server_key: "a0ab38c4e51e720d2db60c68211ecdad"
server_key_iv: "cd3522dfaa120d12dc8b7eabf97dee59"
server_key_version: "encryptionkey@0"
I20260808 11:31:58.599196 1051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance:
uuid: "1dadf97038de45fc80e51464a0555345"
format_stamp: "Formatted at 2026-08-08 11:31:58 on dist-test-slave-zkpd"
server_key: "a0ab38c4e51e720d2db60c68211ecdad"
server_key_iv: "cd3522dfaa120d12dc8b7eabf97dee59"
server_key_version: "encryptionkey@0"
I20260808 11:31:58.604391 1051 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 11:31:58.607872 1066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:58.609202 1051 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:31:58.609371 1051 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "1dadf97038de45fc80e51464a0555345"
format_stamp: "Formatted at 2026-08-08 11:31:58 on dist-test-slave-zkpd"
server_key: "a0ab38c4e51e720d2db60c68211ecdad"
server_key_iv: "cd3522dfaa120d12dc8b7eabf97dee59"
server_key_version: "encryptionkey@0"
I20260808 11:31:58.609583 1051 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:58.639232 1051 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:58.643496 1051 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:58.643813 1051 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:58.644934 1051 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:31:58.646467 1051 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:58.646541 1051 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:58.646696 1051 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:58.646775 1051 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:58.682937 1051 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:39409
I20260808 11:31:58.683039 1180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:39409 every 8 connection(s)
I20260808 11:31:58.684384 1051 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:31:58.687489 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 1051
I20260808 11:31:58.687708 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance
I20260808 11:31:58.688232 26890 external_mini_cluster.cc:1428] Setting key 8a8112eecf345827079c26420b34e787
Aug 08 11:31:58 dist-test-slave-zkpd krb5kdc[805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188718, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM
I20260808 11:31:58.705624 1183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:58.687000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:42719 (local address 127.26.66.190:42549)
0808 11:31:58.687577 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:58.687585 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:58.689043 (+ 1458us) server_negotiation.cc:407] Connection header received
0808 11:31:58.690962 (+ 1919us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:58.690968 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:58.691052 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:58.691188 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:58.692842 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:58.693604 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:58.695287 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:58.695835 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:58.696019 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:58.699483 (+ 3464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:58.699495 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:58.699499 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:58.699533 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:58.702421 (+ 2888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:58.703184 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:58.703191 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:58.703195 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:58.703341 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:58.703788 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:58.703794 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:58.703798 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:58.704140 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:58.704311 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:58.705003 (+ 692us) server_negotiation.cc:299] Negotiation successful
0808 11:31:58.705245 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":268,"threads_started":1}
I20260808 11:31:58.706630 1184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:58.687649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.26.66.130:42719)
0808 11:31:58.688607 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:58.688654 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:58.690675 (+ 2021us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:58.691442 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:58.691450 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:58.692069 (+ 619us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:58.692661 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:58.692680 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:58.693794 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:58.693798 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:58.695134 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:58.695146 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:58.696114 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:58.696122 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:58.696366 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:58.697069 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:58.697092 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:58.699268 (+ 2176us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:58.702583 (+ 3315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:58.702593 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:58.702610 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:58.703059 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:58.703461 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:58.703466 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:58.703470 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:58.703666 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:58.704273 (+ 607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:58.704281 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:58.704637 (+ 356us) client_negotiation.cc:769] Sending connection context
0808 11:31:58.704915 (+ 278us) client_negotiation.cc:240] Negotiation successful
0808 11:31:58.705462 (+ 547us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"thread_start_us":422,"threads_started":1}
I20260808 11:31:58.708266 1181 heartbeater.cc:347] Connected to a master server at 127.26.66.190:42549
I20260808 11:31:58.708633 1181 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:58.709594 1181 heartbeater.cc:511] Master 127.26.66.190:42549 requested a full tablet report, sending...
I20260808 11:31:58.711308 851 ts_manager.cc:194] Registered new tserver with Master: 1dadf97038de45fc80e51464a0555345 (127.26.66.130:39409)
I20260808 11:31:58.712657 851 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.66.130@KRBTEST.COM'} at 127.26.66.130:42719
WARNING: no policy specified for oryx/127.26.66.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.66.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.66.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.131.keytab.
Entry for principal oryx/127.26.66.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.131.keytab.
I20260808 11:31:58.751973 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:0
--local_ip_for_outbound_sockets=127.26.66.131
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:42549
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.131.keytab
--principal=oryx/127.26.66.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:32927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:59.093781 1187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:59.094051 1187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:59.094219 1187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:59.102993 1187 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:59.103124 1187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:59.103307 1187 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:31:59.113305 1187 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:32927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.131.keytab
--principal=oryx/127.26.66.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:42549
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:31:59.114619 1187 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:59.115983 1187 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:59.129292 1193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:59.129407 1195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:59.129988 1192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:59.132040 1187 server_base.cc:1034] running on GCE node
I20260808 11:31:59.132632 1187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:59.133558 1187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:59.134770 1187 hybrid_clock.cc:648] HybridClock initialized: now 1786188719134737 us; error 43 us; skew 500 ppm
I20260808 11:31:59.135094 1187 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:59 dist-test-slave-zkpd krb5kdc[805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188719, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:59.142455 1187 init.cc:377] Logged in from keytab as oryx/127.26.66.131@KRBTEST.COM (short username oryx)
I20260808 11:31:59.143955 1187 webserver.cc:460] Webserver started at http://127.26.66.131:44407/ using document root <none> and password file <none>
I20260808 11:31:59.144757 1187 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:59.144917 1187 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:59.145184 1187 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:59.148411 1187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/data/instance:
uuid: "ed4fddccd7004be7ae7b9d5ec506a12e"
format_stamp: "Formatted at 2026-08-08 11:31:59 on dist-test-slave-zkpd"
server_key: "dff4d781a9cd3ec1f464c4cd147d8ab2"
server_key_iv: "48d82f2105c6ebedfe67b0988b19f2ce"
server_key_version: "encryptionkey@0"
I20260808 11:31:59.149173 1187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance:
uuid: "ed4fddccd7004be7ae7b9d5ec506a12e"
format_stamp: "Formatted at 2026-08-08 11:31:59 on dist-test-slave-zkpd"
server_key: "dff4d781a9cd3ec1f464c4cd147d8ab2"
server_key_iv: "48d82f2105c6ebedfe67b0988b19f2ce"
server_key_version: "encryptionkey@0"
I20260808 11:31:59.154433 1187 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 11:31:59.157934 1202 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:59.159276 1187 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 11:31:59.159554 1187 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "ed4fddccd7004be7ae7b9d5ec506a12e"
format_stamp: "Formatted at 2026-08-08 11:31:59 on dist-test-slave-zkpd"
server_key: "dff4d781a9cd3ec1f464c4cd147d8ab2"
server_key_iv: "48d82f2105c6ebedfe67b0988b19f2ce"
server_key_version: "encryptionkey@0"
I20260808 11:31:59.159759 1187 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:59.165412 1045 heartbeater.cc:503] Master 127.26.66.190:42549 was elected leader, sending a full tablet report...
I20260808 11:31:59.175647 1187 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:59.179613 1187 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:59.179970 1187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:59.180985 1187 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:31:59.182287 1187 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:31:59.182360 1187 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:59.182444 1187 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:31:59.182492 1187 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:59.217334 1187 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:43687
I20260808 11:31:59.217368 1318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:43687 every 8 connection(s)
I20260808 11:31:59.218699 1187 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:31:59.227875 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 1187
I20260808 11:31:59.228133 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance
I20260808 11:31:59.228565 26890 external_mini_cluster.cc:1428] Setting key f5defdab83e714ebde4eeee73e57a098
Aug 08 11:31:59 dist-test-slave-zkpd krb5kdc[805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188719, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM
I20260808 11:31:59.239514 1321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:59.221485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:47763 (local address 127.26.66.190:42549)
0808 11:31:59.221980 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:59.221984 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:59.222987 (+ 1003us) server_negotiation.cc:407] Connection header received
0808 11:31:59.225239 (+ 2252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:59.225244 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:59.225325 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:59.225428 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:59.226857 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.227794 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.229552 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.230136 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.230293 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:59.233854 (+ 3561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:59.233858 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:59.233862 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:59.233892 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:59.236703 (+ 2811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:59.237350 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:59.237353 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:59.237355 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:59.237472 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:59.237897 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:59.237901 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:59.237905 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:59.238182 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:59.238298 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:59.239083 (+ 785us) server_negotiation.cc:299] Negotiation successful
0808 11:31:59.239249 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":243,"threads_started":1}
I20260808 11:31:59.240401 1322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:59.222039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.26.66.131:47763)
0808 11:31:59.222772 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:59.222826 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:59.224982 (+ 2156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:59.225631 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:59.225640 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:59.226152 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:59.226698 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:59.226715 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.228017 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.228022 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:59.229401 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:59.229414 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.230370 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.230379 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:59.230656 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:59.231409 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:59.231440 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:59.233651 (+ 2211us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:59.236849 (+ 3198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:59.236855 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:59.236865 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:59.237244 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:59.237561 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:59.237564 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:59.237566 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:59.237748 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:59.238291 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:59.238297 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:59.238650 (+ 353us) client_negotiation.cc:769] Sending connection context
0808 11:31:59.238876 (+ 226us) client_negotiation.cc:240] Negotiation successful
0808 11:31:59.239285 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":287,"threads_started":1}
I20260808 11:31:59.241884 1319 heartbeater.cc:347] Connected to a master server at 127.26.66.190:42549
I20260808 11:31:59.242172 1319 heartbeater.cc:464] Registering TS with master...
I20260808 11:31:59.243065 1319 heartbeater.cc:511] Master 127.26.66.190:42549 requested a full tablet report, sending...
I20260808 11:31:59.244560 851 ts_manager.cc:194] Registered new tserver with Master: ed4fddccd7004be7ae7b9d5ec506a12e (127.26.66.131:43687)
I20260808 11:31:59.245451 851 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.66.131@KRBTEST.COM'} at 127.26.66.131:47763
I20260808 11:31:59.256074 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.26.66.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.66.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.66.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.189.keytab.
Entry for principal oryx/127.26.66.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.189.keytab.
I20260808 11:31:59.315685 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.189:40689
--webserver_interface=127.26.66.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.189.keytab
--principal=oryx/127.26.66.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:32927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:42549,127.26.66.189:40689
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:31:59.654053 1325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:31:59.654320 1325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:31:59.654492 1325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:31:59.662045 1325 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:31:59.662180 1325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:31:59.662292 1325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:31:59.662396 1325 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:31:59.662477 1325 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:31:59.672636 1325 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:32927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:42549,127.26.66.189:40689
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.189.keytab
--principal=oryx/127.26.66.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.189:40689
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.66.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
W20260808 11:31:59.673007 1325 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.26.66.190:42549,127.26.66.189:40689'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 11:31:59.674010 1325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:31:59.675287 1325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:31:59.687373 1331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:31:59.688135 1333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:59.688496 1325 server_base.cc:1034] running on GCE node
W20260808 11:31:59.688663 1330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:31:59.689456 1325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:31:59.690743 1325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:31:59.691990 1325 hybrid_clock.cc:648] HybridClock initialized: now 1786188719691918 us; error 47 us; skew 500 ppm
I20260808 11:31:59.692307 1325 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:31:59 dist-test-slave-zkpd krb5kdc[805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188719, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:31:59.695345 1325 init.cc:377] Logged in from keytab as oryx/127.26.66.189@KRBTEST.COM (short username oryx)
I20260808 11:31:59.696844 1325 webserver.cc:460] Webserver started at http://127.26.66.189:35599/ using document root <none> and password file <none>
I20260808 11:31:59.697542 1325 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:59.697640 1325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:59.697901 1325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:31:59.700681 1325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-1/data/instance:
uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6"
format_stamp: "Formatted at 2026-08-08 11:31:59 on dist-test-slave-zkpd"
server_key: "dcb936df5f0bb007e242aca0ff5c70bf"
server_key_iv: "23d85843639364d00c0bb1a830a41f5f"
server_key_version: "encryptionkey@0"
I20260808 11:31:59.701371 1325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-1/wal/instance:
uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6"
format_stamp: "Formatted at 2026-08-08 11:31:59 on dist-test-slave-zkpd"
server_key: "dcb936df5f0bb007e242aca0ff5c70bf"
server_key_iv: "23d85843639364d00c0bb1a830a41f5f"
server_key_version: "encryptionkey@0"
I20260808 11:31:59.706125 1325 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260808 11:31:59.709370 1340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:59.710572 1325 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 11:31:59.710747 1325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-1/wal
uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6"
format_stamp: "Formatted at 2026-08-08 11:31:59 on dist-test-slave-zkpd"
server_key: "dcb936df5f0bb007e242aca0ff5c70bf"
server_key_iv: "23d85843639364d00c0bb1a830a41f5f"
server_key_version: "encryptionkey@0"
I20260808 11:31:59.710959 1325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:59.716045 1181 heartbeater.cc:503] Master 127.26.66.190:42549 was elected leader, sending a full tablet report...
I20260808 11:31:59.733011 1325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:31:59.736930 1325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:31:59.737195 1325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:31:59.756436 1325 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.189:40689
I20260808 11:31:59.756480 1393 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.189:40689 every 8 connection(s)
I20260808 11:31:59.757736 1325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-1/data/info.pb
I20260808 11:31:59.760198 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 1325
I20260808 11:31:59.761906 1394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:31:59.771386 1394 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 11:31:59 dist-test-slave-zkpd krb5kdc[805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188716, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.66.189@KRBTEST.COM
Aug 08 11:31:59 dist-test-slave-zkpd krb5kdc[805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188719, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.189@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM
I20260808 11:31:59.786726 1397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:59.762504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53672 (local address 127.26.66.189:40689)
0808 11:31:59.764383 (+ 1879us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:59.764399 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:59.764490 (+ 91us) server_negotiation.cc:407] Connection header received
0808 11:31:59.767695 (+ 3205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:59.767720 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:59.768182 (+ 462us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:59.768592 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:59.770208 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.771478 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.772927 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.773883 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.774068 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:59.779335 (+ 5267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:59.779343 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:59.779353 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:59.779387 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:59.782828 (+ 3441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:59.783482 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:59.783491 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:59.783505 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:59.783661 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:59.784128 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:59.784133 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:59.784138 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:59.784613 (+ 475us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:59.784933 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:59.785407 (+ 474us) server_negotiation.cc:299] Negotiation successful
0808 11:31:59.785773 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1611,"thread_start_us":1345,"threads_started":1}
I20260808 11:31:59.789443 1398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:59.773876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42596 (local address 127.26.66.190:42549)
0808 11:31:59.774351 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:59.774357 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:59.775142 (+ 785us) server_negotiation.cc:407] Connection header received
0808 11:31:59.775380 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:59.775384 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:59.775464 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:59.775553 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:59.777127 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.777918 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.779364 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.779768 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.779944 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:59.783605 (+ 3661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:59.783610 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:59.783613 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:59.783647 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:59.786477 (+ 2830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:59.787283 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:59.787291 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:59.787297 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:59.787423 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:59.787797 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:59.787804 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:59.787807 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:59.788226 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:59.788395 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:59.788858 (+ 463us) server_negotiation.cc:299] Negotiation successful
0808 11:31:59.789078 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":244,"threads_started":1}
I20260808 11:31:59.789633 1399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:59.774004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.0.0.1:42596)
0808 11:31:59.774982 (+ 978us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:59.775036 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:59.775212 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:59.775666 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:59.775673 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:59.776579 (+ 906us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:59.776964 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:59.776981 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.778072 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.778076 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:59.779197 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:59.779210 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.780073 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.780081 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:59.780272 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:59.780907 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:59.780932 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:59.783411 (+ 2479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:59.786605 (+ 3194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:59.786617 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:59.786623 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:59.787160 (+ 537us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:59.787536 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:59.787541 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:59.787544 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:59.787689 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:59.788368 (+ 679us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:59.788376 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:59.788561 (+ 185us) client_negotiation.cc:769] Sending connection context
0808 11:31:59.788752 (+ 191us) client_negotiation.cc:240] Negotiation successful
0808 11:31:59.789073 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":676,"thread_start_us":514,"threads_started":1}
I20260808 11:31:59.791186 1394 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 11:31:59 dist-test-slave-zkpd krb5kdc[805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188719, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.189@KRBTEST.COM for oryx/127.26.66.189@KRBTEST.COM
I20260808 11:31:59.803052 1399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:59.791798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:40689 (local address 127.0.0.1:53678)
0808 11:31:59.792013 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:59.792029 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:59.792133 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:59.792404 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:59.792408 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:59.792743 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:59.792884 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:59.792892 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.793876 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.793881 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:59.794722 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:59.794732 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.795401 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.795406 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:59.795655 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:59.796137 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:59.796153 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:59.798141 (+ 1988us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:59.800776 (+ 2635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:59.800790 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:59.800794 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:59.801130 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:59.801486 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:59.801492 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:59.801496 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:59.801620 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:59.802107 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:59.802112 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:59.802262 (+ 150us) client_negotiation.cc:769] Sending connection context
0808 11:31:59.802397 (+ 135us) client_negotiation.cc:240] Negotiation successful
0808 11:31:59.802668 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53,"mutex_wait_us":54}
I20260808 11:31:59.803202 1397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:59.792016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53678 (local address 127.26.66.189:40689)
0808 11:31:59.792152 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:59.792160 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:59.792181 (+ 21us) server_negotiation.cc:407] Connection header received
0808 11:31:59.792223 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:59.792228 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:59.792292 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:59.792387 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:59.793012 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.793711 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.794867 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.795255 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.795392 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:59.798305 (+ 2913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:59.798311 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:59.798315 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:59.798352 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:59.800649 (+ 2297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:59.801242 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:59.801249 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:59.801253 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:59.801372 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:59.801720 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:59.801727 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:59.801730 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:59.801992 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:59.802141 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:59.802471 (+ 330us) server_negotiation.cc:299] Negotiation successful
0808 11:31:59.802838 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":180,"server-negotiator.queue_time_us":48}
I20260808 11:31:59.807706 1394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6: Bootstrap starting.
I20260808 11:31:59.810710 1394 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6: Neither blocks nor log segments found. Creating new log.
I20260808 11:31:59.811674 1394 log.cc:824] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6: Log is configured to *not* fsync() on all Append() calls
I20260808 11:31:59.814419 1394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6: No bootstrap required, opened a new log
I20260808 11:31:59.821568 1394 raft_consensus.cc:348] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } }
I20260808 11:31:59.821856 1394 raft_consensus.cc:374] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:31:59.821928 1394 raft_consensus.cc:729] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecf36c976ef54ee08b29fc4ddb7c9cc6, State: Initialized, Role: FOLLOWER
I20260808 11:31:59.822377 1394 consensus_queue.cc:260] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } }
I20260808 11:31:59.823101 1401 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } } }
I20260808 11:31:59.823455 1401 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 11:31:59.824141 1394 sys_catalog.cc:564] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 11:31:59.832630 1412 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 11:31:59.832863 1412 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 11:31:59.835157 1325 master_runner.cc:428] Detected that this master ecf36c976ef54ee08b29fc4ddb7c9cc6 is joining an existing cluster
I20260808 11:31:59.835259 1325 master_runner.cc:432] Initiating AddMaster RPC to add 127.26.66.189:40689
I20260808 11:31:59.856212 1398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:59.839317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42612 (local address 127.26.66.190:42549)
0808 11:31:59.839525 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:59.839531 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:59.840362 (+ 831us) server_negotiation.cc:407] Connection header received
0808 11:31:59.840616 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:59.840622 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:59.840711 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:59.840781 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:59.842370 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.843452 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.845754 (+ 2302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.846434 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.846535 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:59.849155 (+ 2620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:59.849162 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:59.849167 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:59.849209 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:59.852932 (+ 3723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:59.853771 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:59.853776 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:59.853780 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:59.853939 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:59.854437 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:59.854444 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:59.854449 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:59.854800 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:59.854953 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:59.855595 (+ 642us) server_negotiation.cc:299] Negotiation successful
0808 11:31:59.855841 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 11:31:59.857640 1419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:59.839518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.0.0.1:42612)
0808 11:31:59.840247 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:59.840273 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:59.840471 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:59.841095 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:59.841101 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:59.841783 (+ 682us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:59.842169 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:59.842182 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.843643 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.843648 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:59.845587 (+ 1939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:59.845603 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.846822 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.846831 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:59.847006 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:59.847694 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:59.847717 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:59.848931 (+ 1214us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:59.853090 (+ 4159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:59.853096 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:59.853102 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:59.853604 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:59.854094 (+ 490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:59.854100 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:59.854103 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:59.854279 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:59.855039 (+ 760us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:59.855045 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:59.855258 (+ 213us) client_negotiation.cc:769] Sending connection context
0808 11:31:59.856777 (+ 1519us) client_negotiation.cc:240] Negotiation successful
0808 11:31:59.857142 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":409,"threads_started":1}
WARNING: no policy specified for oryx/127.26.66.188@KRBTEST.COM; defaulting to no policy
I20260808 11:31:59.878831 1397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:59.840700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53680 (local address 127.26.66.189:40689)
0808 11:31:59.840939 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:59.840947 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:59.858386 (+ 17439us) server_negotiation.cc:407] Connection header received
0808 11:31:59.858635 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:59.858641 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:59.858723 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:59.858822 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:59.860201 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.861340 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.863304 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.864097 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.864195 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:59.869623 (+ 5428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:59.869631 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:59.869638 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:59.869678 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:59.874059 (+ 4381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:59.874941 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:59.874947 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:59.874951 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:59.875090 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:59.875533 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:59.875538 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:59.875543 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:59.877548 (+ 2005us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:59.877717 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:59.878180 (+ 463us) server_negotiation.cc:299] Negotiation successful
0808 11:31:59.878417 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":61}
I20260808 11:31:59.880210 1420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:59.840406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:40689 (local address 127.0.0.1:53680)
0808 11:31:59.856989 (+ 16583us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:59.857022 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:59.858487 (+ 1465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:59.858987 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:59.858993 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:59.859661 (+ 668us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:59.860047 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:59.860062 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.861566 (+ 1504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.861572 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:59.863144 (+ 1572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:59.863165 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.865440 (+ 2275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.865449 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:59.865678 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:59.868075 (+ 2397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:59.868103 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:59.869383 (+ 1280us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:59.874218 (+ 4835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:59.874223 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:59.874230 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:59.874820 (+ 590us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:59.875220 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:59.875226 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:59.875237 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:59.875413 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:59.877746 (+ 2333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:59.877753 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:59.877904 (+ 151us) client_negotiation.cc:769] Sending connection context
0808 11:31:59.879454 (+ 1550us) client_negotiation.cc:240] Negotiation successful
0808 11:31:59.879724 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16429,"mutex_wait_us":22,"thread_start_us":16252,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.66.188@KRBTEST.COM" created.
Aug 08 11:31:59 dist-test-slave-zkpd krb5kdc[805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188717, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.190@KRBTEST.COM for oryx/127.26.66.189@KRBTEST.COM
I20260808 11:31:59.900413 1422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:59.868986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:40689 (local address 127.0.0.1:53688)
0808 11:31:59.882780 (+ 13794us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:59.882833 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:59.883064 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:59.883636 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:59.883643 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:59.884550 (+ 907us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:59.884849 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:59.884865 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.886366 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.886373 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:59.888005 (+ 1632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:59.888020 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.889157 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.889164 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:59.889397 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:59.890148 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:59.890175 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:59.893037 (+ 2862us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:59.896813 (+ 3776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:59.896829 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:59.896840 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:59.897621 (+ 781us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:59.898100 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:59.898106 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:59.898110 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:59.898320 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:59.899088 (+ 768us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:59.899099 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:59.899319 (+ 220us) client_negotiation.cc:769] Sending connection context
0808 11:31:59.899533 (+ 214us) client_negotiation.cc:240] Negotiation successful
0808 11:31:59.899953 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13528,"thread_start_us":13369,"threads_started":1}
I20260808 11:31:59.900493 1397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:59.869961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53688 (local address 127.26.66.189:40689)
0808 11:31:59.879416 (+ 9455us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:59.879422 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:59.882913 (+ 3491us) server_negotiation.cc:407] Connection header received
0808 11:31:59.883288 (+ 375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:59.883296 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:59.883456 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:59.883577 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:59.885045 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.886194 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.888162 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.888970 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.889113 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:59.893254 (+ 4141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:59.893259 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:59.893262 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:59.893290 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:59.896660 (+ 3370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:59.897777 (+ 1117us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:59.897785 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:59.897791 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:59.897953 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:59.898460 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:59.898468 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:59.898474 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:59.898920 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:59.899105 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:59.899696 (+ 591us) server_negotiation.cc:299] Negotiation successful
0808 11:31:59.899993 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9340,"thread_start_us":13439,"threads_started":1}
I20260808 11:31:59.903268 851 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.26.66.189:40689: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6"
member_type: NON_VOTER
last_known_addr {
host: "127.26.66.189"
port: 40689
}
attrs {
promote: true
}
}
dest_uuid: "6316a06b9ecf40daa1a69236580155c2"
cas_config_opid_index: -1
I20260808 11:31:59.905025 851 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: NON_VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: true } }
I20260808 11:31:59.914917 1367 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:31:59.913720 1427 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER ecf36c976ef54ee08b29fc4ddb7c9cc6 (127.26.66.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: NON_VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: true } } }
I20260808 11:31:59.920449 1367 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [term 1 FOLLOWER]: Refusing update from remote peer 6316a06b9ecf40daa1a69236580155c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 11:31:59.921512 1426 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: NON_VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.66.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.188.keytab.
Entry for principal oryx/127.26.66.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.188.keytab.
I20260808 11:31:59.926422 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.188:33241
--webserver_interface=127.26.66.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.188.keytab
--principal=oryx/127.26.66.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:32927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:42549,127.26.66.189:40689,127.26.66.188:33241
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 11:31:59.929698 1427 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.26.66.189:40689
I20260808 11:31:59.930495 1325 master.cc:537] Master@127.26.66.189:40689 shutting down...
I20260808 11:31:59.930680 1426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6316a06b9ecf40daa1a69236580155c2" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: NON_VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: true } } }
I20260808 11:31:59.931053 1426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [sys.catalog]: This master's current role is: LEADER
W20260808 11:31:59.932637 836 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260808 11:31:59.940219 836 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 -> Peer ecf36c976ef54ee08b29fc4ddb7c9cc6 (127.26.66.189:40689): Couldn't send request to peer ecf36c976ef54ee08b29fc4ddb7c9cc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 11:31:59.942660 1325 raft_consensus.cc:2229] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:31:59.943053 1325 raft_consensus.cc:2258] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:31:59.943256 1325 tablet_replica.cc:330] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6: stopping tablet replica
I20260808 11:31:59.949713 1325 master.cc:552] Master@127.26.66.189:40689 shutdown complete.
I20260808 11:31:59.949819 1325 master_runner.cc:305] Clearing existing system tablet
I20260808 11:31:59.950183 1325 fs_manager.cc:359] Metadata directory not provided
I20260808 11:31:59.950294 1325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:31:59.952581 1325 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 11:31:59.954078 1433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:31:59.954414 1325 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:31:59.954703 1325 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 11:31:59.954800 1325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-1/wal
uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6"
format_stamp: "Formatted at 2026-08-08 11:31:59 on dist-test-slave-zkpd"
server_key: "dcb936df5f0bb007e242aca0ff5c70bf"
server_key_iv: "23d85843639364d00c0bb1a830a41f5f"
server_key_version: "encryptionkey@0"
I20260808 11:31:59.958247 1325 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:31:59.962761 1325 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 11:31:59.962970 1325 log.cc:1196] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 11:31:59.963405 1325 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6: Deleting consensus metadata
I20260808 11:31:59.963708 1325 master_runner.cc:315] Copying system tablet from 127.26.66.190:42549
I20260808 11:31:59.966534 1325 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6: tablet copy: Beginning tablet copy session from remote peer at address 127.26.66.190:42549
I20260808 11:31:59.984169 1398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:59.967280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42618 (local address 127.26.66.190:42549)
0808 11:31:59.967497 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 11:31:59.967506 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:31:59.972711 (+ 5205us) server_negotiation.cc:407] Connection header received
0808 11:31:59.972938 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:31:59.972942 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:31:59.973044 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:31:59.973160 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:31:59.974081 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.974805 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.976097 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.976585 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.976718 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:59.978568 (+ 1850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:31:59.978573 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:31:59.978577 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:31:59.978609 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:31:59.981330 (+ 2721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:59.982117 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:59.982125 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:59.982129 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:59.982262 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:31:59.982673 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:31:59.982678 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:31:59.982682 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:31:59.982961 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:31:59.983128 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 11:31:59.983505 (+ 377us) server_negotiation.cc:299] Negotiation successful
0808 11:31:59.983728 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 11:31:59.984521 1439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:31:59.967245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.0.0.1:42618)
0808 11:31:59.972589 (+ 5344us) negotiation.cc:107] Waiting for socket to connect
0808 11:31:59.972615 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 11:31:59.972778 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:31:59.973189 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:31:59.973194 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:31:59.973668 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:31:59.973920 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:59.973929 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.974959 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.974964 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:59.975938 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:31:59.975953 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:31:59.976733 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:31:59.976739 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:31:59.976957 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:31:59.977640 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:31:59.977658 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:31:59.978354 (+ 696us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:31:59.981480 (+ 3126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:59.981485 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:59.981490 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:59.981992 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:59.982387 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:31:59.982392 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:31:59.982396 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:31:59.982561 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:31:59.983091 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:31:59.983096 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:31:59.983260 (+ 164us) client_negotiation.cc:769] Sending connection context
0808 11:31:59.983407 (+ 147us) client_negotiation.cc:240] Negotiation successful
0808 11:31:59.984053 (+ 646us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5212,"thread_start_us":5124,"threads_started":1}
I20260808 11:31:59.985471 872 tablet_copy_service.cc:140] P 6316a06b9ecf40daa1a69236580155c2: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer ecf36c976ef54ee08b29fc4ddb7c9cc6 ({username='oryx', principal='oryx/127.26.66.189@KRBTEST.COM'} at 127.0.0.1:42618)
I20260808 11:31:59.985747 872 tablet_copy_service.cc:161] P 6316a06b9ecf40daa1a69236580155c2: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer ecf36c976ef54ee08b29fc4ddb7c9cc6 at {username='oryx', principal='oryx/127.26.66.189@KRBTEST.COM'} at 127.0.0.1:42618: session id = ecf36c976ef54ee08b29fc4ddb7c9cc6-00000000000000000000000000000000
I20260808 11:31:59.988873 872 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 11:31:59.990684 1325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 11:31:59.995450 1325 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6: tablet copy: Starting download of 0 data blocks...
I20260808 11:31:59.995806 1325 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6: tablet copy: Starting download of 1 WAL segments...
I20260808 11:31:59.998325 1325 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 11:32:00.001463 872 tablet_copy_service.cc:342] P 6316a06b9ecf40daa1a69236580155c2: Request end of tablet copy session ecf36c976ef54ee08b29fc4ddb7c9cc6-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.26.66.189@KRBTEST.COM'} at 127.0.0.1:42618
I20260808 11:32:00.001645 872 tablet_copy_service.cc:433] P 6316a06b9ecf40daa1a69236580155c2: ending tablet copy session ecf36c976ef54ee08b29fc4ddb7c9cc6-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer ecf36c976ef54ee08b29fc4ddb7c9cc6
I20260808 11:32:00.011965 1325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:00.014678 1440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:00.025475 1441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:00.027513 1443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:00.027987 1325 server_base.cc:1034] running on GCE node
I20260808 11:32:00.028350 1325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:00.029043 1325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:00.030256 1325 hybrid_clock.cc:648] HybridClock initialized: now 1786188720030183 us; error 50 us; skew 500 ppm
I20260808 11:32:00.030491 1325 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:32:00 dist-test-slave-zkpd krb5kdc[805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188720, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:32:00.032512 1325 init.cc:377] Logged in from keytab as oryx/127.26.66.189@KRBTEST.COM (short username oryx)
I20260808 11:32:00.033893 1325 webserver.cc:460] Webserver started at http://127.26.66.189:46073/ using document root <none> and password file <none>
I20260808 11:32:00.034296 1325 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:00.034391 1325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:00.037330 1325 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260808 11:32:00.039137 1451 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:00.039659 1325 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260808 11:32:00.039820 1325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-1/wal
uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6"
format_stamp: "Formatted at 2026-08-08 11:31:59 on dist-test-slave-zkpd"
server_key: "dcb936df5f0bb007e242aca0ff5c70bf"
server_key_iv: "23d85843639364d00c0bb1a830a41f5f"
server_key_version: "encryptionkey@0"
I20260808 11:32:00.040134 1325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:00.049784 1325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:00.053917 1325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:00.082923 1325 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.189:40689
I20260808 11:32:00.082957 1503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.189:40689 every 8 connection(s)
I20260808 11:32:00.083864 1325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-1/data/info.pb
I20260808 11:32:00.090900 1504 sys_catalog.cc:263] Verifying existing consensus state
I20260808 11:32:00.093477 1504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6: Bootstrap starting.
I20260808 11:32:00.107859 1504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 11:32:00.108429 1504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6: Bootstrap complete.
I20260808 11:32:00.109413 1504 raft_consensus.cc:348] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: NON_VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: true } }
I20260808 11:32:00.109665 1504 raft_consensus.cc:729] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ecf36c976ef54ee08b29fc4ddb7c9cc6, State: Initialized, Role: LEARNER
I20260808 11:32:00.109951 1504 consensus_queue.cc:260] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: NON_VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: true } }
I20260808 11:32:00.110759 1507 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: NON_VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: true } } }
I20260808 11:32:00.111150 1507 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [sys.catalog]: This master's current role is: LEARNER
I20260808 11:32:00.111159 1504 sys_catalog.cc:564] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:32:00.121397 1518 catalog_manager.cc:1259] Loaded cluster ID: 5297473404864234a5651d18db96dd17
I20260808 11:32:00.121567 1518 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6: loading cluster ID for follower catalog manager: success
I20260808 11:32:00.124027 1518 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6: acquiring CA information for follower catalog manager: success
I20260808 11:32:00.125803 1518 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 11:32:00.247851 1319 heartbeater.cc:503] Master 127.26.66.190:42549 was elected leader, sending a full tablet report...
W20260808 11:32:00.414986 1431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:00.415405 1431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:00.415565 1431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:00.427395 1431 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:32:00.427537 1431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:00.427616 1431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:00.427723 1431 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:32:00.427788 1431 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:32:00.441210 1431 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:32927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:42549,127.26.66.189:40689,127.26.66.188:33241
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.188.keytab
--principal=oryx/127.26.66.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.188:33241
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.66.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:00.442639 1431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:00.444089 1431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:00.456351 1523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:00.456261 1526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:00.456303 1524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:00.457526 1431 server_base.cc:1034] running on GCE node
I20260808 11:32:00.458254 1431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:00.459561 1431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:00.460757 1431 hybrid_clock.cc:648] HybridClock initialized: now 1786188720460695 us; error 57 us; skew 500 ppm
I20260808 11:32:00.461061 1431 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:32:00 dist-test-slave-zkpd krb5kdc[805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188720, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:32:00.464342 1431 init.cc:377] Logged in from keytab as oryx/127.26.66.188@KRBTEST.COM (short username oryx)
I20260808 11:32:00.465823 1431 webserver.cc:460] Webserver started at http://127.26.66.188:44543/ using document root <none> and password file <none>
I20260808 11:32:00.466513 1431 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:00.466619 1431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:00.466874 1431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:32:00.469868 1431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-2/data/instance:
uuid: "6745c77285434df49b46cc45469e4791"
format_stamp: "Formatted at 2026-08-08 11:32:00 on dist-test-slave-zkpd"
server_key: "6c012e7cc4bab1b510b80aeab1633683"
server_key_iv: "638c5cdebae5b061bfb68b62cfd29453"
server_key_version: "encryptionkey@0"
I20260808 11:32:00.470611 1431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-2/wal/instance:
uuid: "6745c77285434df49b46cc45469e4791"
format_stamp: "Formatted at 2026-08-08 11:32:00 on dist-test-slave-zkpd"
server_key: "6c012e7cc4bab1b510b80aeab1633683"
server_key_iv: "638c5cdebae5b061bfb68b62cfd29453"
server_key_version: "encryptionkey@0"
I20260808 11:32:00.475833 1431 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 11:32:00.479233 1533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:00.480669 1431 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:32:00.480818 1431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-2/wal
uuid: "6745c77285434df49b46cc45469e4791"
format_stamp: "Formatted at 2026-08-08 11:32:00 on dist-test-slave-zkpd"
server_key: "6c012e7cc4bab1b510b80aeab1633683"
server_key_iv: "638c5cdebae5b061bfb68b62cfd29453"
server_key_version: "encryptionkey@0"
I20260808 11:32:00.480983 1431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:00.522310 1431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:00.526754 1431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:00.527015 1431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:00.550768 1431 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.188:33241
I20260808 11:32:00.550787 1589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.188:33241 every 8 connection(s)
I20260808 11:32:00.552623 1431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-2/data/info.pb
I20260808 11:32:00.555832 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 1431
I20260808 11:32:00.556617 1582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:00.546380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:40689 (local address 127.0.0.1:60250)
0808 11:32:00.547199 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:00.547225 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:00.547395 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:00.549663 (+ 2268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:00.549672 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:00.549710 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:00.549989 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:00.550008 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.552173 (+ 2165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.552180 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:00.553958 (+ 1778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:00.553979 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.555623 (+ 1644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.555630 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:00.555831 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:00.555962 (+ 131us) client_negotiation.cc:769] Sending connection context
0808 11:32:00.556071 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 11:32:00.556239 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":694,"thread_start_us":594,"threads_started":1}
I20260808 11:32:00.556933 1583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:00.546556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60250 (local address 127.26.66.189:40689)
0808 11:32:00.548223 (+ 1667us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:00.548231 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:00.548259 (+ 28us) server_negotiation.cc:407] Connection header received
0808 11:32:00.548340 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:00.548348 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:00.548452 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:00.548587 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:00.550213 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.551954 (+ 1741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.554163 (+ 2209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.555394 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.555556 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:00.555775 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:00.556130 (+ 355us) server_negotiation.cc:299] Negotiation successful
0808 11:32:00.556288 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1513,"thread_start_us":1374,"threads_started":1}
I20260808 11:32:00.558234 1478 raft_consensus.cc:1203] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260808 11:32:00.559303 1590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:00.559198 1507 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6316a06b9ecf40daa1a69236580155c2. Latest consensus state: current_term: 1 leader_uuid: "6316a06b9ecf40daa1a69236580155c2" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: NON_VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: true } } }
I20260808 11:32:00.559566 1507 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [sys.catalog]: This master's current role is: LEARNER
I20260808 11:32:00.571045 1590 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 11:32:00 dist-test-slave-zkpd krb5kdc[805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188716, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.66.188@KRBTEST.COM
Aug 08 11:32:00 dist-test-slave-zkpd krb5kdc[805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188720, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.188@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM
I20260808 11:32:00.586489 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:00.558118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48030 (local address 127.26.66.188:33241)
0808 11:32:00.564112 (+ 5994us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:00.564128 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:00.564470 (+ 342us) server_negotiation.cc:407] Connection header received
0808 11:32:00.566209 (+ 1739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:00.566231 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:00.566634 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:00.566973 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:00.568899 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.570175 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.572018 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.572782 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.572916 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:00.578425 (+ 5509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:00.578433 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:00.578443 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:00.578486 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:00.581748 (+ 3262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:00.582460 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:00.582467 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:00.582473 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:00.582622 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:00.583059 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:00.583068 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:00.583071 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:00.583657 (+ 586us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:00.584029 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:00.584496 (+ 467us) server_negotiation.cc:299] Negotiation successful
0808 11:32:00.584969 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5647,"thread_start_us":5345,"threads_started":1}
I20260808 11:32:00.590188 1594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:00.574151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.0.0.1:57956)
0808 11:32:00.575094 (+ 943us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:00.575153 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:00.575329 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:00.576264 (+ 935us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:00.576269 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:00.576889 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:00.577134 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:00.577142 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.578309 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.578323 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:00.579462 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:00.579475 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.580367 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.580378 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:00.580557 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:00.581135 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:00.581156 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:00.583413 (+ 2257us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:00.587434 (+ 4021us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:00.587444 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:00.587449 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:00.587959 (+ 510us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:00.588343 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:00.588346 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:00.588348 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:00.588486 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:00.589094 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:00.589099 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:00.589245 (+ 146us) client_negotiation.cc:769] Sending connection context
0808 11:32:00.589456 (+ 211us) client_negotiation.cc:240] Negotiation successful
0808 11:32:00.589763 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"thread_start_us":429,"threads_started":1}
I20260808 11:32:00.590188 1595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:00.574333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57956 (local address 127.26.66.190:42549)
0808 11:32:00.575829 (+ 1496us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:00.575835 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:00.575861 (+ 26us) server_negotiation.cc:407] Connection header received
0808 11:32:00.575963 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:00.575970 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:00.576062 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:00.576176 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:00.577316 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.578159 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.579625 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.580146 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.580278 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:00.583611 (+ 3333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:00.583619 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:00.583624 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:00.583665 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:00.587313 (+ 3648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:00.588063 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:00.588068 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:00.588071 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:00.588223 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:00.588598 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:00.588602 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:00.588605 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:00.588962 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:00.589126 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:00.589556 (+ 430us) server_negotiation.cc:299] Negotiation successful
0808 11:32:00.589771 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1329,"thread_start_us":1207,"threads_started":1}
I20260808 11:32:00.591522 1590 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 11:32:00 dist-test-slave-zkpd krb5kdc[805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188720, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.188@KRBTEST.COM for oryx/127.26.66.189@KRBTEST.COM
I20260808 11:32:00.604327 1594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:00.592135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:40689 (local address 127.0.0.1:60264)
0808 11:32:00.592320 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:00.592336 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:00.592410 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:00.592888 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:00.592891 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:00.593180 (+ 289us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:00.593310 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:00.593317 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.594337 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.594341 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:00.595256 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:00.595266 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.595973 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.595978 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:00.596113 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:00.596667 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:00.596683 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:00.598725 (+ 2042us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:00.601907 (+ 3182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:00.601914 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:00.601918 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:00.602299 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:00.602688 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:00.602693 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:00.602696 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:00.602838 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:00.603351 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:00.603357 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:00.603495 (+ 138us) client_negotiation.cc:769] Sending connection context
0808 11:32:00.603637 (+ 142us) client_negotiation.cc:240] Negotiation successful
0808 11:32:00.603963 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 11:32:00.604359 1583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:00.592424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60264 (local address 127.26.66.189:40689)
0808 11:32:00.592614 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:00.592618 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:00.592633 (+ 15us) server_negotiation.cc:407] Connection header received
0808 11:32:00.592701 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:00.592705 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:00.592763 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:00.592843 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:00.593434 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.594208 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.595390 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.595782 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.595880 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:00.598925 (+ 3045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:00.598932 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:00.598938 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:00.599000 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:00.601762 (+ 2762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:00.602429 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:00.602436 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:00.602441 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:00.602573 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:00.602947 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:00.602953 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:00.602957 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:00.603220 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:00.603377 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:00.603728 (+ 351us) server_negotiation.cc:299] Negotiation successful
0808 11:32:00.604031 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 11:32:00.605365 1590 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.188" port: 33241 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 11:32:00 dist-test-slave-zkpd krb5kdc[805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188720, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.188@KRBTEST.COM for oryx/127.26.66.188@KRBTEST.COM
I20260808 11:32:00.617482 1594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:00.606156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:33241 (local address 127.0.0.1:48032)
0808 11:32:00.606292 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:00.606307 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:00.606392 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:00.606681 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:00.606684 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:00.607077 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:00.607223 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:00.607230 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.608252 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.608259 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:00.609125 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:00.609136 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.609788 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.609792 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:00.609978 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:00.610532 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:00.610549 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:00.612535 (+ 1986us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:00.615349 (+ 2814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:00.615352 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:00.615355 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:00.615699 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:00.616077 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:00.616081 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:00.616083 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:00.616230 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:00.616740 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:00.616743 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:00.616892 (+ 149us) client_negotiation.cc:769] Sending connection context
0808 11:32:00.617000 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 11:32:00.617183 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 11:32:00.617677 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:00.606326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48032 (local address 127.26.66.188:33241)
0808 11:32:00.606467 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:00.606471 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:00.606485 (+ 14us) server_negotiation.cc:407] Connection header received
0808 11:32:00.606522 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:00.606525 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:00.606574 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:00.606647 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:00.607359 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.608115 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.609250 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.609648 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.609744 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:00.612721 (+ 2977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:00.612725 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:00.612728 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:00.612792 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:00.615232 (+ 2440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:00.615796 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:00.615802 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:00.615804 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:00.615982 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:00.616331 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:00.616334 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:00.616336 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:00.616624 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:00.616754 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:00.617099 (+ 345us) server_negotiation.cc:299] Negotiation successful
0808 11:32:00.617382 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":51}
I20260808 11:32:00.622491 1590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791: Bootstrap starting.
I20260808 11:32:00.625747 1590 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:00.626825 1590 log.cc:824] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791: Log is configured to *not* fsync() on all Append() calls
I20260808 11:32:00.629411 1590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791: No bootstrap required, opened a new log
I20260808 11:32:00.636771 1590 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 33241 } }
I20260808 11:32:00.637089 1590 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:00.637179 1590 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6745c77285434df49b46cc45469e4791, State: Initialized, Role: FOLLOWER
I20260808 11:32:00.637758 1590 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 33241 } }
I20260808 11:32:00.638660 1597 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 33241 } } }
I20260808 11:32:00.639061 1597 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 11:32:00.639710 1590 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 11:32:00.649121 1608 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 11:32:00.649276 1608 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 11:32:00.653890 1431 master_runner.cc:428] Detected that this master 6745c77285434df49b46cc45469e4791 is joining an existing cluster
I20260808 11:32:00.654023 1431 master_runner.cc:432] Initiating AddMaster RPC to add 127.26.66.188:33241
I20260808 11:32:00.679445 1595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:00.659670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57970 (local address 127.26.66.190:42549)
0808 11:32:00.659862 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:00.659870 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:00.660812 (+ 942us) server_negotiation.cc:407] Connection header received
0808 11:32:00.661162 (+ 350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:00.661171 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:00.661275 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:00.661363 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:00.663395 (+ 2032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.664921 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.667873 (+ 2952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.668800 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.668930 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:00.672214 (+ 3284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:00.672220 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:00.672225 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:00.672264 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:00.676050 (+ 3786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:00.676908 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:00.676914 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:00.676918 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:00.677076 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:00.677608 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:00.677615 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:00.677621 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:00.677985 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:00.678114 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:00.678816 (+ 702us) server_negotiation.cc:299] Negotiation successful
0808 11:32:00.679054 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 11:32:00.680552 1614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:00.659737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.0.0.1:57970)
0808 11:32:00.660667 (+ 930us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:00.660696 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:00.660968 (+ 272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:00.661627 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:00.661634 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:00.662678 (+ 1044us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:00.663167 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:00.663184 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.665277 (+ 2093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.665286 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:00.667641 (+ 2355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:00.667662 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.669282 (+ 1620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.669291 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:00.669554 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:00.670541 (+ 987us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:00.670568 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:00.671942 (+ 1374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:00.676207 (+ 4265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:00.676213 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:00.676217 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:00.676756 (+ 539us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:00.677232 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:00.677237 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:00.677240 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:00.677466 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:00.678211 (+ 745us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:00.678216 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:00.678468 (+ 252us) client_negotiation.cc:769] Sending connection context
0808 11:32:00.679707 (+ 1239us) client_negotiation.cc:240] Negotiation successful
0808 11:32:00.680062 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":758,"thread_start_us":582,"threads_started":1}
I20260808 11:32:00.684343 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:00.659670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48036 (local address 127.26.66.188:33241)
0808 11:32:00.659874 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:00.659885 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:00.665094 (+ 5209us) server_negotiation.cc:407] Connection header received
0808 11:32:00.665550 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:00.665558 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:00.665640 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:00.665710 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:00.667164 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.668326 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.671107 (+ 2781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.671946 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.672066 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:00.676008 (+ 3942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:00.676014 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:00.676018 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:00.676052 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:00.679993 (+ 3941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:00.681978 (+ 1985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:00.681986 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:00.681990 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:00.682106 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:00.682443 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:00.682451 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:00.682454 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:00.682745 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:00.682935 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:00.683695 (+ 760us) server_negotiation.cc:299] Negotiation successful
0808 11:32:00.683966 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 11:32:00.685354 1616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:00.660498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:33241 (local address 127.0.0.1:48036)
0808 11:32:00.664990 (+ 4492us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:00.665009 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:00.665385 (+ 376us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:00.665892 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:00.665897 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:00.666659 (+ 762us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:00.666996 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:00.667012 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.668568 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.668573 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:00.670221 (+ 1648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:00.670236 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.672364 (+ 2128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.672372 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:00.672557 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:00.674594 (+ 2037us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:00.674617 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:00.675817 (+ 1200us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:00.681352 (+ 5535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:00.681356 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:00.681360 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:00.681854 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:00.682217 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:00.682221 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:00.682224 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:00.682345 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:00.682895 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:00.682904 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:00.683047 (+ 143us) client_negotiation.cc:769] Sending connection context
0808 11:32:00.684604 (+ 1557us) client_negotiation.cc:240] Negotiation successful
0808 11:32:00.684892 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4347,"mutex_wait_us":3,"thread_start_us":9967,"threads_started":1}
I20260808 11:32:00.686892 1583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:00.660983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60274 (local address 127.26.66.189:40689)
0808 11:32:00.661171 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:00.661177 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:00.670922 (+ 9745us) server_negotiation.cc:407] Connection header received
0808 11:32:00.671062 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:00.671067 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:00.671151 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:00.671261 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:00.672845 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.673675 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.675735 (+ 2060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.676415 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.676519 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:00.679407 (+ 2888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:00.679414 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:00.679419 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:00.679459 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:00.682995 (+ 3536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:00.683693 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:00.683698 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:00.683702 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:00.683861 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:00.684636 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:00.684646 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:00.684650 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:00.685059 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:00.685182 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:00.686310 (+ 1128us) server_negotiation.cc:299] Negotiation successful
0808 11:32:00.686536 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 11:32:00.687819 1615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:00.661299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:40689 (local address 127.0.0.1:60274)
0808 11:32:00.670783 (+ 9484us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:00.670812 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:00.670933 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:00.671452 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:00.671456 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:00.672236 (+ 780us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:00.672643 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:00.672653 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.673838 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.673841 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:00.675552 (+ 1711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:00.675568 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.676820 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.676829 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:00.677091 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:00.677695 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:00.677718 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:00.679170 (+ 1452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:00.683114 (+ 3944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:00.683119 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:00.683122 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:00.683568 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:00.684032 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:00.684037 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:00.684041 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:00.684203 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:00.685287 (+ 1084us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:00.685295 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:00.685989 (+ 694us) client_negotiation.cc:769] Sending connection context
0808 11:32:00.687271 (+ 1282us) client_negotiation.cc:240] Negotiation successful
0808 11:32:00.687495 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9338,"thread_start_us":3872,"threads_started":1}
I20260808 11:32:00.692610 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 914
Aug 08 11:32:00 dist-test-slave-zkpd krb5kdc[805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188717, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.190@KRBTEST.COM for oryx/127.26.66.188@KRBTEST.COM
I20260808 11:32:00.703122 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:00.688220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48038 (local address 127.26.66.188:33241)
0808 11:32:00.688380 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:00.688402 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:00.688421 (+ 19us) server_negotiation.cc:407] Connection header received
0808 11:32:00.688509 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:00.688515 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:00.688597 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:00.688698 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:00.690181 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.690897 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.692720 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.693419 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.693541 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:00.696851 (+ 3310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:00.696857 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:00.696862 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:00.696900 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:00.700247 (+ 3347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:00.701061 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:00.701068 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:00.701075 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:00.701217 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:00.701641 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:00.701646 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:00.701650 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:00.702000 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:00.702145 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:00.702688 (+ 543us) server_negotiation.cc:299] Negotiation successful
0808 11:32:00.702870 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 11:32:00.703209 1582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:00.687724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:33241 (local address 127.0.0.1:48038)
0808 11:32:00.687973 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:00.687994 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:00.688092 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:00.689366 (+ 1274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:00.689371 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:00.689827 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:00.690028 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:00.690040 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.691036 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.691041 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:00.692547 (+ 1506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:00.692565 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.693570 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.693577 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:00.693777 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:00.694294 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:00.694309 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:00.696680 (+ 2371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:00.700389 (+ 3709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:00.700394 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:00.700399 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:00.700908 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:00.701338 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:00.701343 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:00.701347 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:00.701508 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:00.702215 (+ 707us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:00.702221 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:00.702405 (+ 184us) client_negotiation.cc:769] Sending connection context
0808 11:32:00.702562 (+ 157us) client_negotiation.cc:240] Negotiation successful
0808 11:32:00.702835 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260808 11:32:00.704999 851 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.26.66.188:33241: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "6745c77285434df49b46cc45469e4791"
member_type: NON_VOTER
last_known_addr {
host: "127.26.66.188"
port: 33241
}
attrs {
promote: true
}
}
dest_uuid: "6316a06b9ecf40daa1a69236580155c2"
cas_config_opid_index: 5
I20260808 11:32:00.706090 851 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: NON_VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: true } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: NON_VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: true } }
Aug 08 11:32:00 dist-test-slave-zkpd krb5kdc[805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188716, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.66.129@KRBTEST.COM
I20260808 11:32:00.708022 1574 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 6745c77285434df49b46cc45469e4791 (127.26.66.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: NON_VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: true } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: NON_VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: true } } }
I20260808 11:32:00.711663 1478 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [term 1 LEARNER]: Refusing update from remote peer 6316a06b9ecf40daa1a69236580155c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 11:32:00.713356 1560 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:00.717289 1560 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [term 1 FOLLOWER]: Refusing update from remote peer 6316a06b9ecf40daa1a69236580155c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 11:32:00.718824 1617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:00.693920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37946 (local address 127.26.66.129:37937)
0808 11:32:00.695380 (+ 1460us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:00.695391 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:00.695423 (+ 32us) server_negotiation.cc:407] Connection header received
0808 11:32:00.695497 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:00.695506 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:00.695811 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:00.696054 (+ 243us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:00.698322 (+ 2268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.699530 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.701158 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.701929 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.702065 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:00.707528 (+ 5463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:00.707544 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:00.707562 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:00.707618 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:00.712904 (+ 5286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:00.714230 (+ 1326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:00.714242 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:00.714249 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:00.714461 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:00.715071 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:00.715078 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:00.715085 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:00.715623 (+ 538us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:00.717619 (+ 1996us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:00.717855 (+ 236us) server_negotiation.cc:299] Negotiation successful
0808 11:32:00.718209 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1245,"thread_start_us":349,"threads_started":1}
I20260808 11:32:00.720352 1619 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: NON_VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 11:32:00.721050 1619 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: NON_VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:32:00.721870 1040 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:00.728539 1478 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 6745c77285434df49b46cc45469e4791 (127.26.66.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: NON_VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: true } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: NON_VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: true } } }
I20260808 11:32:00.739784 1507 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6316a06b9ecf40daa1a69236580155c2" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: NON_VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: true } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: NON_VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: true } } }
I20260808 11:32:00.740129 1507 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [sys.catalog]: This master's current role is: LEARNER
I20260808 11:32:00.741268 1559 raft_consensus.cc:858] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 33241 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: NON_VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: NON_VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: true } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: NON_VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: true } }
W20260808 11:32:00.741501 1559 raft_consensus.cc:1565] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 33241 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: NON_VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: NON_VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: true } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: NON_VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: true } }
I20260808 11:32:00.750890 1574 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.26.66.188:33241
I20260808 11:32:00.751657 1431 master.cc:537] Master@127.26.66.188:33241 shutting down...
I20260808 11:32:00.754460 1574 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2: attempting to promote NON_VOTER ecf36c976ef54ee08b29fc4ddb7c9cc6 to VOTER
I20260808 11:32:00.755488 1574 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: NON_VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: true } }
I20260808 11:32:00.757157 1619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6316a06b9ecf40daa1a69236580155c2" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: NON_VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: true } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: NON_VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: true } } } pending_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: NON_VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: true } } }
I20260808 11:32:00.757704 1619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [sys.catalog]: This master's current role is: LEADER
I20260808 11:32:00.759353 1478 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [term 1 LEARNER]: Refusing update from remote peer 6316a06b9ecf40daa1a69236580155c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 11:32:00.760061 1619 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260808 11:32:00.760121 1620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6316a06b9ecf40daa1a69236580155c2" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: NON_VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: true } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: NON_VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: true } } } pending_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: NON_VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: true } } }
I20260808 11:32:00.760679 1620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [sys.catalog]: This master's current role is: LEADER
I20260808 11:32:00.762590 1619 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, ecf36c976ef54ee08b29fc4ddb7c9cc6 (127.26.66.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: NON_VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: true } } }
I20260808 11:32:00.763572 1478 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, ecf36c976ef54ee08b29fc4ddb7c9cc6 (127.26.66.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: NON_VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: true } } }
I20260808 11:32:00.768137 1507 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6316a06b9ecf40daa1a69236580155c2" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: NON_VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: true } } }
I20260808 11:32:00.768393 1507 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 11:32:00.771152 1619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6316a06b9ecf40daa1a69236580155c2" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: NON_VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: true } } }
I20260808 11:32:00.771411 1619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [sys.catalog]: This master's current role is: LEADER
I20260808 11:32:00.771581 1625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6316a06b9ecf40daa1a69236580155c2" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: NON_VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: true } } }
I20260808 11:32:00.771989 1625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [sys.catalog]: This master's current role is: LEADER
W20260808 11:32:00.780390 837 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 -> Peer 6745c77285434df49b46cc45469e4791 (127.26.66.188:33241): Couldn't send request to peer 6745c77285434df49b46cc45469e4791. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 11:32:00.785851 1559 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER ecf36c976ef54ee08b29fc4ddb7c9cc6 (127.26.66.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: NON_VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: true } } }
I20260808 11:32:00.791072 1632 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6316a06b9ecf40daa1a69236580155c2" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: NON_VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: true } } }
I20260808 11:32:00.791368 1632 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260808 11:32:00.792431 1597 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6316a06b9ecf40daa1a69236580155c2. Latest consensus state: current_term: 1 leader_uuid: "6316a06b9ecf40daa1a69236580155c2" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: NON_VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: true } } }
I20260808 11:32:00.792680 1597 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260808 11:32:00.792606 1629 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6316a06b9ecf40daa1a69236580155c2" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: NON_VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: true } } }
I20260808 11:32:00.792835 1629 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260808 11:32:00.793977 1431 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260808 11:32:00.794418 1431 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260808 11:32:00.794595 1431 tablet_replica.cc:330] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791: stopping tablet replica
I20260808 11:32:00.802222 1431 master.cc:552] Master@127.26.66.188:33241 shutdown complete.
I20260808 11:32:00.802309 1431 master_runner.cc:305] Clearing existing system tablet
I20260808 11:32:00.802690 1431 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:00.802809 1431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:00.805779 1431 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.004s
I20260808 11:32:00.807511 1634 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:00.807951 1431 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:00.808199 1431 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260808 11:32:00.808300 1431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-2/wal
uuid: "6745c77285434df49b46cc45469e4791"
format_stamp: "Formatted at 2026-08-08 11:32:00 on dist-test-slave-zkpd"
server_key: "6c012e7cc4bab1b510b80aeab1633683"
server_key_iv: "638c5cdebae5b061bfb68b62cfd29453"
server_key_version: "encryptionkey@0"
I20260808 11:32:00.813061 1431 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:32:00.820034 1431 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 11:32:00.820189 1431 log.cc:1196] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 11:32:00.820739 1431 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791: Deleting consensus metadata
I20260808 11:32:00.821019 1431 master_runner.cc:315] Copying system tablet from 127.26.66.190:42549
I20260808 11:32:00.827876 1431 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791: tablet copy: Beginning tablet copy session from remote peer at address 127.26.66.190:42549
I20260808 11:32:00.847719 1640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:00.828746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.0.0.1:57980)
0808 11:32:00.832304 (+ 3558us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:00.832344 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:00.832516 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:00.832949 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:00.832954 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:00.833508 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:00.833775 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:00.833788 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.835275 (+ 1487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.835281 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:00.836899 (+ 1618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:00.836914 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.837953 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.837960 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:00.838163 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:00.838982 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:00.839007 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:00.840217 (+ 1210us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:00.844548 (+ 4331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:00.844555 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:00.844559 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:00.845081 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:00.845572 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:00.845577 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:00.845581 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:00.845772 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:00.846542 (+ 770us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:00.846548 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:00.846740 (+ 192us) client_negotiation.cc:769] Sending connection context
0808 11:32:00.846882 (+ 142us) client_negotiation.cc:240] Negotiation successful
0808 11:32:00.847206 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3421,"thread_start_us":3282,"threads_started":1}
I20260808 11:32:00.848718 1595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:00.828799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57980 (local address 127.26.66.190:42549)
0808 11:32:00.829022 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:00.829029 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:00.832461 (+ 3432us) server_negotiation.cc:407] Connection header received
0808 11:32:00.832679 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:00.832685 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:00.832781 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:00.832893 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:00.833946 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.835120 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.837057 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:00.837745 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:00.837891 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:00.840397 (+ 2506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:00.840403 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:00.840408 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:00.840445 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:00.844392 (+ 3947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:00.845230 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:00.845235 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:00.845240 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:00.845421 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:00.845937 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:00.845942 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:00.845946 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:00.846309 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:00.846466 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:00.848096 (+ 1630us) server_negotiation.cc:299] Negotiation successful
0808 11:32:00.848348 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 11:32:00.849265 872 tablet_copy_service.cc:140] P 6316a06b9ecf40daa1a69236580155c2: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 6745c77285434df49b46cc45469e4791 ({username='oryx', principal='oryx/127.26.66.188@KRBTEST.COM'} at 127.0.0.1:57980)
I20260808 11:32:00.849454 872 tablet_copy_service.cc:161] P 6316a06b9ecf40daa1a69236580155c2: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 6745c77285434df49b46cc45469e4791 at {username='oryx', principal='oryx/127.26.66.188@KRBTEST.COM'} at 127.0.0.1:57980: session id = 6745c77285434df49b46cc45469e4791-00000000000000000000000000000000
I20260808 11:32:00.853266 872 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 11:32:00.854633 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 914
I20260808 11:32:00.855152 1431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 11:32:00.862206 1431 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791: tablet copy: Starting download of 0 data blocks...
I20260808 11:32:00.862519 1431 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791: tablet copy: Starting download of 1 WAL segments...
I20260808 11:32:00.865125 1431 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 11:32:00.869524 872 tablet_copy_service.cc:342] P 6316a06b9ecf40daa1a69236580155c2: Request end of tablet copy session 6745c77285434df49b46cc45469e4791-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.26.66.188@KRBTEST.COM'} at 127.0.0.1:57980
I20260808 11:32:00.869666 872 tablet_copy_service.cc:433] P 6316a06b9ecf40daa1a69236580155c2: ending tablet copy session 6745c77285434df49b46cc45469e4791-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 6745c77285434df49b46cc45469e4791
I20260808 11:32:00.880515 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:37937
--local_ip_for_outbound_sockets=127.26.66.129
--tserver_master_addrs=127.26.66.190:42549
--webserver_port=40145
--webserver_interface=127.26.66.129
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.129.keytab
--principal=oryx/127.26.66.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:32927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.66.190:42549,127.26.66.189:40689
--tserver_master_addrs=127.26.66.190:42549,127.26.66.189:40689,127.26.66.188:33241 with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 11:32:00.886401 1431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:00.890914 1641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:00.892553 1642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:00.894343 1644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:00.895244 1431 server_base.cc:1034] running on GCE node
I20260808 11:32:00.895594 1431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:00.896323 1431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:00.897555 1431 hybrid_clock.cc:648] HybridClock initialized: now 1786188720897505 us; error 32 us; skew 500 ppm
I20260808 11:32:00.897845 1431 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:32:00 dist-test-slave-zkpd krb5kdc[805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188720, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:32:00.900200 1431 init.cc:377] Logged in from keytab as oryx/127.26.66.188@KRBTEST.COM (short username oryx)
I20260808 11:32:00.904896 1431 webserver.cc:460] Webserver started at http://127.26.66.188:37289/ using document root <none> and password file <none>
I20260808 11:32:00.905259 1431 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:00.905369 1431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:00.908631 1431 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.002s
I20260808 11:32:00.910727 1653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:00.911346 1431 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260808 11:32:00.911482 1431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-2/wal
uuid: "6745c77285434df49b46cc45469e4791"
format_stamp: "Formatted at 2026-08-08 11:32:00 on dist-test-slave-zkpd"
server_key: "6c012e7cc4bab1b510b80aeab1633683"
server_key_iv: "638c5cdebae5b061bfb68b62cfd29453"
server_key_version: "encryptionkey@0"
I20260808 11:32:00.911701 1431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:00.925180 1431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:00.929569 1431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:00.954377 1431 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.188:33241
I20260808 11:32:00.954528 1704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.188:33241 every 8 connection(s)
I20260808 11:32:00.955403 1431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/master-2/data/info.pb
I20260808 11:32:00.960457 1705 sys_catalog.cc:263] Verifying existing consensus state
I20260808 11:32:00.964041 1705 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791: Bootstrap starting.
I20260808 11:32:00.979393 1705 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 11:32:00.979945 1705 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791: Bootstrap complete.
I20260808 11:32:00.981069 1705 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: NON_VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: true } }
I20260808 11:32:00.981384 1705 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6745c77285434df49b46cc45469e4791, State: Initialized, Role: LEARNER
I20260808 11:32:00.981647 1705 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: NON_VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: true } }
I20260808 11:32:00.982615 1708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: NON_VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: true } } }
I20260808 11:32:00.982954 1705 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:32:00.983079 1708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [sys.catalog]: This master's current role is: LEARNER
I20260808 11:32:00.992744 1720 catalog_manager.cc:1259] Loaded cluster ID: 5297473404864234a5651d18db96dd17
I20260808 11:32:00.992854 1720 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791: loading cluster ID for follower catalog manager: success
I20260808 11:32:00.996369 1720 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791: acquiring CA information for follower catalog manager: success
I20260808 11:32:00.998785 1720 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 11:32:01.260890 1647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:01.261344 1647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:01.261521 1647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 11:32:01.267298 1725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:01.259009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48046 (local address 127.26.66.188:33241)
0808 11:32:01.261560 (+ 2551us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:01.261566 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:01.261787 (+ 221us) server_negotiation.cc:407] Connection header received
0808 11:32:01.262020 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:01.262025 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:01.262100 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:01.262227 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:01.262666 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:01.263782 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:01.265449 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:01.266257 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:01.266409 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:01.266663 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:01.266789 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 11:32:01.266939 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2359,"thread_start_us":2190,"threads_started":1}
I20260808 11:32:01.267326 1724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:01.258844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:33241 (local address 127.0.0.1:48046)
0808 11:32:01.261658 (+ 2814us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:01.261701 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:01.261862 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:01.262246 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:01.262251 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:01.262279 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:01.262524 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:01.262533 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:01.263949 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:01.263955 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:01.265290 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:01.265302 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:01.266429 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:01.266434 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:01.266632 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:01.266669 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 11:32:01.266766 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 11:32:01.266936 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2700,"thread_start_us":2615,"threads_started":1}
I20260808 11:32:01.268384 1680 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260808 11:32:01.268859 1708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6316a06b9ecf40daa1a69236580155c2. Latest consensus state: current_term: 1 leader_uuid: "6316a06b9ecf40daa1a69236580155c2" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: NON_VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: true } } }
I20260808 11:32:01.269200 1708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [sys.catalog]: This master's current role is: LEARNER
W20260808 11:32:01.269999 1647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:01.270144 1647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:01.270328 1647 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:32:01.280606 1647 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:32927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.129.keytab
--principal=oryx/127.26.66.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:37937
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=40145
--tserver_master_addrs=127.26.66.190:42549,127.26.66.189:40689,127.26.66.188:33241
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:01.282039 1647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:01.283504 1647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:01.297865 1727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:01.298090 1728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:01.298125 1731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:01.298784 1647 server_base.cc:1034] running on GCE node
I20260808 11:32:01.299383 1647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:01.300498 1647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:01.301739 1647 hybrid_clock.cc:648] HybridClock initialized: now 1786188721301700 us; error 50 us; skew 500 ppm
I20260808 11:32:01.302062 1647 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:32:01 dist-test-slave-zkpd krb5kdc[805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188721, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:32:01.305454 1647 init.cc:377] Logged in from keytab as oryx/127.26.66.129@KRBTEST.COM (short username oryx)
I20260808 11:32:01.307000 1647 webserver.cc:460] Webserver started at http://127.26.66.129:40145/ using document root <none> and password file <none>
I20260808 11:32:01.307696 1647 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:01.307866 1647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:01.313866 1647 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 11:32:01.316859 1739 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:01.318337 1647 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:32:01.318536 1647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "571ff9c747d54ad4b5082705b118489d"
format_stamp: "Formatted at 2026-08-08 11:31:58 on dist-test-slave-zkpd"
server_key: "85e9de57290a4a5ce110b884b85c647f"
server_key_iv: "f471baa978ec47311767f3e11bf40c75"
server_key_version: "encryptionkey@0"
I20260808 11:32:01.319618 1647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:01.364499 1647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:01.369181 1647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:01.369513 1647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:01.370551 1647 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:32:01.372035 1647 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:32:01.372162 1647 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:01.372298 1647 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:32:01.372388 1647 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:01.408095 1647 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:37937
I20260808 11:32:01.408179 1852 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:37937 every 8 connection(s)
I20260808 11:32:01.409601 1647 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:32:01.413851 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 1647
I20260808 11:32:01.414208 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 1051
Aug 08 11:32:01 dist-test-slave-zkpd krb5kdc[805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188721, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.188@KRBTEST.COM
I20260808 11:32:01.442160 1725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:01.413095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:50947 (local address 127.26.66.188:33241)
0808 11:32:01.414917 (+ 1822us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:01.414927 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:01.425476 (+ 10549us) server_negotiation.cc:407] Connection header received
0808 11:32:01.425640 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:01.425646 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:01.425729 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:01.425848 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:01.427759 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:01.428569 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:01.430201 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:01.430638 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:01.430783 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:01.434906 (+ 4123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:01.434912 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:01.434915 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:01.434949 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:01.438275 (+ 3326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:01.439342 (+ 1067us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:01.439348 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:01.439352 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:01.439504 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:01.440091 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:01.440097 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:01.440100 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:01.440458 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:01.440589 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:01.441471 (+ 882us) server_negotiation.cc:299] Negotiation successful
0808 11:32:01.441808 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1625}
I20260808 11:32:01.444094 1858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:01.413652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:33241 (local address 127.26.66.129:50947)
0808 11:32:01.425341 (+ 11689us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:01.425364 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:01.425522 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:01.426130 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:01.426138 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:01.426928 (+ 790us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:01.427580 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:01.427598 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:01.428753 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:01.428759 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:01.430051 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:01.430063 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:01.430887 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:01.430894 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:01.431261 (+ 367us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:01.432241 (+ 980us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:01.432274 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:01.434661 (+ 2387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:01.438415 (+ 3754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:01.438425 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:01.438442 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:01.439188 (+ 746us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:01.439667 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:01.439672 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:01.439675 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:01.439947 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:01.440689 (+ 742us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:01.440701 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:01.441032 (+ 331us) client_negotiation.cc:769] Sending connection context
0808 11:32:01.441363 (+ 331us) client_negotiation.cc:240] Negotiation successful
0808 11:32:01.441899 (+ 536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11528,"mutex_wait_us":171,"thread_start_us":11145,"threads_started":1}
Aug 08 11:32:01 dist-test-slave-zkpd krb5kdc[805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188721, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM
I20260808 11:32:01.446447 1853 heartbeater.cc:347] Connected to a master server at 127.26.66.188:33241
I20260808 11:32:01.446789 1853 heartbeater.cc:464] Registering TS with master...
I20260808 11:32:01.447636 1853 heartbeater.cc:511] Master 127.26.66.188:33241 requested a full tablet report, sending...
I20260808 11:32:01.450294 1670 ts_manager.cc:194] Registered new tserver with Master: 571ff9c747d54ad4b5082705b118489d (127.26.66.129:37937)
I20260808 11:32:01.453627 1860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:01.415189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:48433 (local address 127.26.66.190:42549)
0808 11:32:01.435590 (+ 20401us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:01.435599 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:01.435625 (+ 26us) server_negotiation.cc:407] Connection header received
0808 11:32:01.435697 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:01.435706 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:01.435802 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:01.436037 (+ 235us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:01.437292 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:01.438693 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:01.440644 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:01.441464 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:01.441594 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:01.446489 (+ 4895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:01.446497 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:01.446503 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:01.446545 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:01.450340 (+ 3795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:01.451351 (+ 1011us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:01.451357 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:01.451360 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:01.451523 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:01.452011 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:01.452015 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:01.452020 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:01.452390 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:01.452559 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:01.452995 (+ 436us) server_negotiation.cc:299] Negotiation successful
0808 11:32:01.453210 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20221,"thread_start_us":20102,"threads_started":1}
I20260808 11:32:01.453686 1857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:01.413641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.26.66.129:48433)
0808 11:32:01.420803 (+ 7162us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:01.420869 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:01.424414 (+ 3545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:01.436068 (+ 11654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:01.436072 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:01.436531 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:01.437144 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:01.437162 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:01.438834 (+ 1672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:01.438848 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:01.440442 (+ 1594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:01.440455 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:01.442497 (+ 2042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:01.442503 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:01.442722 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:01.443393 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:01.443416 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:01.446298 (+ 2882us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:01.450624 (+ 4326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:01.450629 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:01.450632 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:01.451181 (+ 549us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:01.451663 (+ 482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:01.451668 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:01.451671 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:01.451820 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:01.452521 (+ 701us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:01.452526 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:01.452703 (+ 177us) client_negotiation.cc:769] Sending connection context
0808 11:32:01.452872 (+ 169us) client_negotiation.cc:240] Negotiation successful
0808 11:32:01.453193 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6711,"thread_start_us":6381,"threads_started":1}
I20260808 11:32:01.454980 1854 heartbeater.cc:347] Connected to a master server at 127.26.66.190:42549
I20260808 11:32:01.455134 1854 heartbeater.cc:464] Registering TS with master...
I20260808 11:32:01.455665 1854 heartbeater.cc:511] Master 127.26.66.190:42549 requested a full tablet report, sending...
I20260808 11:32:01.457106 850 ts_manager.cc:194] Re-registered known tserver with Master: 571ff9c747d54ad4b5082705b118489d (127.26.66.129:37937)
Aug 08 11:32:01 dist-test-slave-zkpd krb5kdc[805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188721, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.189@KRBTEST.COM
I20260808 11:32:01.458158 850 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.66.129@KRBTEST.COM'} at 127.26.66.129:48433
Aug 08 11:32:01 dist-test-slave-zkpd krb5kdc[805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188716, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.66.130@KRBTEST.COM
I20260808 11:32:01.467864 1864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:01.429963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:40689 (local address 127.26.66.129:36439)
0808 11:32:01.431377 (+ 1414us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:01.431401 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:01.431964 (+ 563us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:01.449826 (+ 17862us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:01.449833 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:01.450512 (+ 679us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:01.450864 (+ 352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:01.450879 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:01.452658 (+ 1779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:01.452664 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:01.454252 (+ 1588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:01.454268 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:01.455285 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:01.455291 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:01.455491 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:01.456211 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:01.456238 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:01.459014 (+ 2776us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:01.464561 (+ 5547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:01.464567 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:01.464572 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:01.465133 (+ 561us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:01.465628 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:01.465634 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:01.465638 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:01.465825 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:01.466607 (+ 782us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:01.466612 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:01.466800 (+ 188us) client_negotiation.cc:769] Sending connection context
0808 11:32:01.466965 (+ 165us) client_negotiation.cc:240] Negotiation successful
0808 11:32:01.467315 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1293,"mutex_wait_us":1,"thread_start_us":1107,"threads_started":1}
I20260808 11:32:01.468879 1863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:01.423954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:36439 (local address 127.26.66.189:40689)
0808 11:32:01.449406 (+ 25452us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:01.449413 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:01.449440 (+ 27us) server_negotiation.cc:407] Connection header received
0808 11:32:01.449507 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:01.449513 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:01.449621 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:01.451041 (+ 1420us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:01.451303 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:01.452475 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:01.454462 (+ 1987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:01.455062 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:01.455842 (+ 780us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:01.459297 (+ 3455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:01.459305 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:01.459312 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:01.459359 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:01.464262 (+ 4903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:01.465273 (+ 1011us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:01.465279 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:01.465283 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:01.465463 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:01.465962 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:01.465968 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:01.465972 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:01.466359 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:01.466507 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:01.468224 (+ 1717us) server_negotiation.cc:299] Negotiation successful
0808 11:32:01.468474 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25326,"thread_start_us":25205,"threads_started":1}
I20260808 11:32:01.469897 1855 heartbeater.cc:347] Connected to a master server at 127.26.66.189:40689
I20260808 11:32:01.470057 1855 heartbeater.cc:464] Registering TS with master...
I20260808 11:32:01.470484 1855 heartbeater.cc:511] Master 127.26.66.189:40689 requested a full tablet report, sending...
I20260808 11:32:01.472294 1468 ts_manager.cc:194] Registered new tserver with Master: 571ff9c747d54ad4b5082705b118489d (127.26.66.129:37937)
I20260808 11:32:01.472788 1862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:01.416604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58532 (local address 127.26.66.130:39409)
0808 11:32:01.446895 (+ 30291us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:01.446906 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:01.448116 (+ 1210us) server_negotiation.cc:407] Connection header received
0808 11:32:01.448217 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:01.448230 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:01.448582 (+ 352us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:01.448772 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:01.451579 (+ 2807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:01.453174 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:01.457658 (+ 4484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:01.458829 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:01.458990 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:01.465544 (+ 6554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:01.465561 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:01.465581 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:01.465628 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:01.469731 (+ 4103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:01.470571 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:01.470579 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:01.470585 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:01.470746 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:01.471145 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:01.471150 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:01.471153 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:01.471488 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:01.471837 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:01.472134 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 11:32:01.472417 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30077,"thread_start_us":30290,"threads_started":1}
I20260808 11:32:01.474118 1176 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:01.559839 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 1051
I20260808 11:32:01.581818 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:39409
--local_ip_for_outbound_sockets=127.26.66.130
--tserver_master_addrs=127.26.66.190:42549
--webserver_port=45147
--webserver_interface=127.26.66.130
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.130.keytab
--principal=oryx/127.26.66.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:32927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.66.190:42549,127.26.66.189:40689
--tserver_master_addrs=127.26.66.190:42549,127.26.66.189:40689,127.26.66.188:33241 with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 11:32:01.668159 1574 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6316a06b9ecf40daa1a69236580155c2" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: NON_VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: true } } }
I20260808 11:32:01.668497 1574 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [sys.catalog]: This master's current role is: LEADER
I20260808 11:32:01.670758 1868 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2: attempting to promote NON_VOTER 6745c77285434df49b46cc45469e4791 to VOTER
I20260808 11:32:01.671592 1868 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: false } }
I20260808 11:32:01.673784 1680 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [term 1 LEARNER]: Refusing update from remote peer 6316a06b9ecf40daa1a69236580155c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260808 11:32:01.674018 1478 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [term 1 FOLLOWER]: Refusing update from remote peer 6316a06b9ecf40daa1a69236580155c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260808 11:32:01.674537 1574 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 11:32:01.674925 1867 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 11:32:01.677587 1574 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 6745c77285434df49b46cc45469e4791 (127.26.66.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: false } } }
I20260808 11:32:01.678310 1478 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 6745c77285434df49b46cc45469e4791 (127.26.66.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: false } } }
I20260808 11:32:01.681994 1868 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6316a06b9ecf40daa1a69236580155c2" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: false } } }
I20260808 11:32:01.682264 1868 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [sys.catalog]: This master's current role is: LEADER
I20260808 11:32:01.682745 1868 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6316a06b9ecf40daa1a69236580155c2" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: false } } }
I20260808 11:32:01.683043 1868 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [sys.catalog]: This master's current role is: LEADER
I20260808 11:32:01.684473 1871 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6316a06b9ecf40daa1a69236580155c2" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: false } } }
I20260808 11:32:01.684932 1871 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 11:32:01.686576 1868 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6316a06b9ecf40daa1a69236580155c2" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: false } } }
I20260808 11:32:01.686822 1868 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2 [sys.catalog]: This master's current role is: LEADER
I20260808 11:32:01.687386 1680 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 6745c77285434df49b46cc45469e4791 (127.26.66.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: false } } }
I20260808 11:32:01.691445 1708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6316a06b9ecf40daa1a69236580155c2" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: false } } }
I20260808 11:32:01.691735 1708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 11:32:01.935657 1866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:01.936007 1866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:01.936116 1866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:01.943703 1866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:01.943809 1866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:01.944000 1866 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:32:01.953964 1866 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:32927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.130.keytab
--principal=oryx/127.26.66.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:39409
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=45147
--tserver_master_addrs=127.26.66.190:42549,127.26.66.189:40689,127.26.66.188:33241
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:01.955313 1866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:01.956683 1866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:01.970422 1879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:01.970525 1878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:01.970492 1881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:01.971294 1866 server_base.cc:1034] running on GCE node
I20260808 11:32:01.971858 1866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:01.972980 1866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:01.974247 1866 hybrid_clock.cc:648] HybridClock initialized: now 1786188721974180 us; error 56 us; skew 500 ppm
I20260808 11:32:01.974622 1866 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:32:01 dist-test-slave-zkpd krb5kdc[805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188721, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:32:01.977942 1866 init.cc:377] Logged in from keytab as oryx/127.26.66.130@KRBTEST.COM (short username oryx)
I20260808 11:32:01.979338 1866 webserver.cc:460] Webserver started at http://127.26.66.130:45147/ using document root <none> and password file <none>
I20260808 11:32:01.980098 1866 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:01.980265 1866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:01.985744 1866 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 11:32:01.988673 1888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:01.989987 1866 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:32:01.990172 1866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "1dadf97038de45fc80e51464a0555345"
format_stamp: "Formatted at 2026-08-08 11:31:58 on dist-test-slave-zkpd"
server_key: "a0ab38c4e51e720d2db60c68211ecdad"
server_key_iv: "cd3522dfaa120d12dc8b7eabf97dee59"
server_key_version: "encryptionkey@0"
I20260808 11:32:01.991192 1866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:02.008364 1866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:02.012498 1866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:02.012841 1866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:02.013899 1866 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:32:02.015224 1866 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:32:02.015352 1866 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:02.015503 1866 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:32:02.015592 1866 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:02.050945 1866 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:39409
I20260808 11:32:02.051005 2001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:39409 every 8 connection(s)
I20260808 11:32:02.052502 1866 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:32:02.059646 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 1866
I20260808 11:32:02.060026 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 1187
Aug 08 11:32:02 dist-test-slave-zkpd krb5kdc[805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188716, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.66.131@KRBTEST.COM
Aug 08 11:32:02 dist-test-slave-zkpd krb5kdc[805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188721, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.189@KRBTEST.COM
Aug 08 11:32:02 dist-test-slave-zkpd krb5kdc[805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188721, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.188@KRBTEST.COM
I20260808 11:32:02.113481 2013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:02.061214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59920 (local address 127.26.66.131:43687)
0808 11:32:02.080473 (+ 19259us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:02.080487 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:02.080524 (+ 37us) server_negotiation.cc:407] Connection header received
0808 11:32:02.080622 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:02.080635 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:02.080956 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:02.081165 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:02.084362 (+ 3197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.085976 (+ 1614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.094049 (+ 8073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.096192 (+ 2143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.100787 (+ 4595us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:02.102763 (+ 1976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:02.102779 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:02.102798 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:02.102849 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:02.109162 (+ 6313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:02.110187 (+ 1025us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:02.110198 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:02.110203 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:02.110387 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:02.110875 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:02.110879 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:02.110882 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:02.111313 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:02.111627 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:02.112696 (+ 1069us) server_negotiation.cc:299] Negotiation successful
0808 11:32:02.113005 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19017,"thread_start_us":20167,"threads_started":1}
I20260808 11:32:02.115294 1314 generic_service.cc:196] Checking for leaks (request via RPC)
Aug 08 11:32:02 dist-test-slave-zkpd krb5kdc[805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188721, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM
I20260808 11:32:02.118007 2008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:02.055461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:38277 (local address 127.26.66.189:40689)
0808 11:32:02.076973 (+ 21512us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:02.076982 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:02.081597 (+ 4615us) server_negotiation.cc:407] Connection header received
0808 11:32:02.085194 (+ 3597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:02.085203 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:02.085339 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:02.085465 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:02.088447 (+ 2982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.090058 (+ 1611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.093241 (+ 3183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.094187 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.094321 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:02.106873 (+ 12552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:02.106878 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:02.106881 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:02.106930 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:02.114627 (+ 7697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:02.115517 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:02.115523 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:02.115527 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:02.115730 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:02.116325 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:02.116332 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:02.116336 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:02.116689 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:02.116880 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:02.117394 (+ 514us) server_negotiation.cc:299] Negotiation successful
0808 11:32:02.117614 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21350,"thread_start_us":21182,"threads_started":1}
I20260808 11:32:02.118682 2011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:02.056110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:40689 (local address 127.26.66.130:38277)
0808 11:32:02.081410 (+ 25300us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:02.081469 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:02.084542 (+ 3073us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:02.086079 (+ 1537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:02.086093 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:02.087129 (+ 1036us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:02.088189 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:02.088223 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.090332 (+ 2109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.090340 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:02.093022 (+ 2682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:02.093044 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.094829 (+ 1785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.094839 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:02.095295 (+ 456us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:02.096440 (+ 1145us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:02.096487 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:02.106587 (+ 10100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:02.114817 (+ 8230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:02.114822 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:02.114825 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:02.115359 (+ 534us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:02.115911 (+ 552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:02.115916 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:02.115920 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:02.116151 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:02.116963 (+ 812us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:02.116966 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:02.117104 (+ 138us) client_negotiation.cc:769] Sending connection context
0808 11:32:02.117276 (+ 172us) client_negotiation.cc:240] Negotiation successful
0808 11:32:02.117583 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24942,"thread_start_us":26965,"threads_started":1}
I20260808 11:32:02.119411 2009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:02.055597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:36389 (local address 127.26.66.188:33241)
0808 11:32:02.076488 (+ 20891us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:02.076498 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:02.095948 (+ 19450us) server_negotiation.cc:407] Connection header received
0808 11:32:02.096049 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:02.096058 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:02.096171 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:02.097075 (+ 904us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:02.097951 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.099522 (+ 1571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.102222 (+ 2700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.102927 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.103067 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:02.108249 (+ 5182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:02.108256 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:02.108261 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:02.108317 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:02.112613 (+ 4296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:02.113726 (+ 1113us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:02.113731 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:02.113734 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:02.113882 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:02.114437 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:02.114442 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:02.114444 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:02.114779 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:02.116203 (+ 1424us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:02.118535 (+ 2332us) server_negotiation.cc:299] Negotiation successful
0808 11:32:02.118849 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20675,"thread_start_us":20497,"threads_started":1}
I20260808 11:32:02.120322 2004 heartbeater.cc:347] Connected to a master server at 127.26.66.189:40689
I20260808 11:32:02.120658 2004 heartbeater.cc:464] Registering TS with master...
I20260808 11:32:02.121163 2010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:02.056110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:33241 (local address 127.26.66.130:36389)
0808 11:32:02.083020 (+ 26910us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:02.083038 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:02.084883 (+ 1845us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:02.096383 (+ 11500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:02.096391 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:02.097227 (+ 836us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:02.097677 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:02.097694 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.099770 (+ 2076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.099779 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:02.102043 (+ 2264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:02.102063 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.103348 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.103357 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:02.103595 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:02.105092 (+ 1497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:02.105126 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:02.108024 (+ 2898us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:02.112777 (+ 4753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:02.112785 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:02.112803 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:02.113466 (+ 663us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:02.114029 (+ 563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:02.114033 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:02.114036 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:02.114277 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:02.115061 (+ 784us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:02.115068 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:02.115774 (+ 706us) client_negotiation.cc:769] Sending connection context
0808 11:32:02.116456 (+ 682us) client_negotiation.cc:240] Negotiation successful
0808 11:32:02.117218 (+ 762us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26741,"mutex_wait_us":387,"thread_start_us":25083,"threads_started":1}
I20260808 11:32:02.121707 2004 heartbeater.cc:511] Master 127.26.66.189:40689 requested a full tablet report, sending...
I20260808 11:32:02.122315 2002 heartbeater.cc:347] Connected to a master server at 127.26.66.188:33241
I20260808 11:32:02.122493 2002 heartbeater.cc:464] Registering TS with master...
I20260808 11:32:02.123056 2002 heartbeater.cc:511] Master 127.26.66.188:33241 requested a full tablet report, sending...
I20260808 11:32:02.123797 1468 ts_manager.cc:194] Registered new tserver with Master: 1dadf97038de45fc80e51464a0555345 (127.26.66.130:39409)
I20260808 11:32:02.124467 1670 ts_manager.cc:194] Registered new tserver with Master: 1dadf97038de45fc80e51464a0555345 (127.26.66.130:39409)
I20260808 11:32:02.128846 2014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:02.083798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.26.66.130:33419)
0808 11:32:02.104302 (+ 20504us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:02.104318 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:02.104408 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:02.106117 (+ 1709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:02.106123 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:02.106940 (+ 817us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:02.107325 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:02.107343 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.109040 (+ 1697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.109048 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:02.110614 (+ 1566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:02.110630 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.111949 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.111958 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:02.112216 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:02.113537 (+ 1321us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:02.113560 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:02.116425 (+ 2865us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:02.125700 (+ 9275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:02.125708 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:02.125713 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:02.126262 (+ 549us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:02.127024 (+ 762us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:02.127031 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:02.127037 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:02.127208 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:02.127777 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:02.127781 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:02.127986 (+ 205us) client_negotiation.cc:769] Sending connection context
0808 11:32:02.128137 (+ 151us) client_negotiation.cc:240] Negotiation successful
0808 11:32:02.128429 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20371,"thread_start_us":20217,"threads_started":1}
I20260808 11:32:02.128872 2015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:02.086540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:33419 (local address 127.26.66.190:42549)
0808 11:32:02.105746 (+ 19206us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:02.105754 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:02.105773 (+ 19us) server_negotiation.cc:407] Connection header received
0808 11:32:02.105836 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:02.105842 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:02.105922 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:02.106044 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:02.107649 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.108802 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.110810 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.111539 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.111664 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:02.119781 (+ 8117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:02.119801 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:02.119809 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:02.119867 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:02.125543 (+ 5676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:02.126384 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:02.126390 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:02.126393 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:02.126555 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:02.127309 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:02.127321 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:02.127325 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:02.127673 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:02.127812 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:02.128272 (+ 460us) server_negotiation.cc:299] Negotiation successful
0808 11:32:02.128496 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19074,"thread_start_us":18948,"threads_started":1}
I20260808 11:32:02.130065 2003 heartbeater.cc:347] Connected to a master server at 127.26.66.190:42549
I20260808 11:32:02.130209 2003 heartbeater.cc:464] Registering TS with master...
I20260808 11:32:02.130618 2003 heartbeater.cc:511] Master 127.26.66.190:42549 requested a full tablet report, sending...
I20260808 11:32:02.131551 850 ts_manager.cc:194] Re-registered known tserver with Master: 1dadf97038de45fc80e51464a0555345 (127.26.66.130:39409)
I20260808 11:32:02.132565 850 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.66.130@KRBTEST.COM'} at 127.26.66.130:33419
I20260808 11:32:02.210971 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 1187
I20260808 11:32:02.232344 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:43687
--local_ip_for_outbound_sockets=127.26.66.131
--tserver_master_addrs=127.26.66.190:42549
--webserver_port=44407
--webserver_interface=127.26.66.131
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.131.keytab
--principal=oryx/127.26.66.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:32927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.66.190:42549,127.26.66.189:40689
--tserver_master_addrs=127.26.66.190:42549,127.26.66.189:40689,127.26.66.188:33241 with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 11:32:02.464398 1854 heartbeater.cc:503] Master 127.26.66.190:42549 was elected leader, sending a full tablet report...
W20260808 11:32:02.578280 2017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:02.578564 2017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:02.578667 2017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:02.586159 2017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:02.586263 2017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:02.586385 2017 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:32:02.596594 2017 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:32927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.131.keytab
--principal=oryx/127.26.66.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:43687
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=44407
--tserver_master_addrs=127.26.66.190:42549,127.26.66.189:40689,127.26.66.188:33241
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:02.597981 2017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:02.599349 2017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:02.612514 2022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:02.612582 2023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:02.613443 2025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:02.614490 2017 server_base.cc:1034] running on GCE node
I20260808 11:32:02.615059 2017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:02.616034 2017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:02.617278 2017 hybrid_clock.cc:648] HybridClock initialized: now 1786188722617232 us; error 49 us; skew 500 ppm
I20260808 11:32:02.617602 2017 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:32:02 dist-test-slave-zkpd krb5kdc[805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188722, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:32:02.620895 2017 init.cc:377] Logged in from keytab as oryx/127.26.66.131@KRBTEST.COM (short username oryx)
I20260808 11:32:02.622243 2017 webserver.cc:460] Webserver started at http://127.26.66.131:44407/ using document root <none> and password file <none>
I20260808 11:32:02.622925 2017 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:02.623086 2017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:02.628347 2017 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:32:02.631489 2032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:02.632843 2017 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:32:02.633024 2017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "ed4fddccd7004be7ae7b9d5ec506a12e"
format_stamp: "Formatted at 2026-08-08 11:31:59 on dist-test-slave-zkpd"
server_key: "dff4d781a9cd3ec1f464c4cd147d8ab2"
server_key_iv: "48d82f2105c6ebedfe67b0988b19f2ce"
server_key_version: "encryptionkey@0"
I20260808 11:32:02.634021 2017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:02.653229 2017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:02.657230 2017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:02.657546 2017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:02.658483 2017 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:32:02.659826 2017 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:32:02.659965 2017 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:02.660099 2017 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:32:02.660198 2017 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:02.694470 2017 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:43687
I20260808 11:32:02.694556 2148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:43687 every 8 connection(s)
I20260808 11:32:02.696043 2017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:32:02.698557 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 2017
Aug 08 11:32:02 dist-test-slave-zkpd krb5kdc[805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188722, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.188@KRBTEST.COM
Aug 08 11:32:02 dist-test-slave-zkpd krb5kdc[805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188722, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM
Aug 08 11:32:02 dist-test-slave-zkpd krb5kdc[805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188722, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.189@KRBTEST.COM
I20260808 11:32:02.771881 2168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:02.745449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57990 (local address 127.26.66.190:42549)
0808 11:32:02.746007 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:02.746014 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:02.746039 (+ 25us) server_negotiation.cc:407] Connection header received
0808 11:32:02.746115 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:02.746123 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:02.746217 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:02.746393 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:02.749413 (+ 3020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.750629 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.753172 (+ 2543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.754957 (+ 1785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.755091 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:02.759431 (+ 4340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:02.759437 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:02.759442 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:02.759485 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:02.763402 (+ 3917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:02.766464 (+ 3062us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:02.766470 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:02.766473 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:02.766634 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:02.768708 (+ 2074us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:02.768715 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:02.768722 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:02.769120 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:02.769414 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:02.770454 (+ 1040us) server_negotiation.cc:299] Negotiation successful
0808 11:32:02.771474 (+ 1020us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":1734,"threads_started":1}
I20260808 11:32:02.778951 2157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:02.708013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.26.66.131:53199)
0808 11:32:02.746638 (+ 38625us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:02.746652 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:02.746797 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:02.747668 (+ 871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:02.747684 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:02.748747 (+ 1063us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:02.749469 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:02.749499 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.751428 (+ 1929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.751432 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:02.758040 (+ 6608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:02.758056 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.759220 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.759226 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:02.763663 (+ 4437us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:02.764325 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:02.764349 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:02.767141 (+ 2792us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:02.772228 (+ 5087us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:02.772238 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:02.772255 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:02.772860 (+ 605us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:02.773436 (+ 576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:02.773442 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:02.773446 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:02.774341 (+ 895us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:02.776014 (+ 1673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:02.776026 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:02.776515 (+ 489us) client_negotiation.cc:769] Sending connection context
0808 11:32:02.776878 (+ 363us) client_negotiation.cc:240] Negotiation successful
0808 11:32:02.777430 (+ 552us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38514,"mutex_wait_us":1589,"thread_start_us":37100,"threads_started":1}
I20260808 11:32:02.779503 2159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:02.706590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:40689 (local address 127.26.66.131:60249)
0808 11:32:02.744515 (+ 37925us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:02.744541 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:02.744675 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:02.749712 (+ 5037us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:02.749716 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:02.750322 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:02.750617 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:02.750627 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.752048 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.752054 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:02.757602 (+ 5548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:02.757627 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.758654 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.758661 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:02.758845 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:02.766872 (+ 8027us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:02.766895 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:02.770187 (+ 3292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:02.775032 (+ 4845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:02.775038 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:02.775044 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:02.776857 (+ 1813us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:02.777656 (+ 799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:02.777660 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:02.777663 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:02.777800 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:02.778428 (+ 628us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:02.778434 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:02.778583 (+ 149us) client_negotiation.cc:769] Sending connection context
0808 11:32:02.778743 (+ 160us) client_negotiation.cc:240] Negotiation successful
0808 11:32:02.779041 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37773,"thread_start_us":395,"threads_started":1}
I20260808 11:32:02.779999 2167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:02.698998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:60249 (local address 127.26.66.189:40689)
0808 11:32:02.747229 (+ 48231us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:02.747239 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:02.747263 (+ 24us) server_negotiation.cc:407] Connection header received
0808 11:32:02.747330 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:02.747336 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:02.747434 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:02.747582 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:02.750750 (+ 3168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.751756 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.757771 (+ 6015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.758446 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.758575 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:02.770442 (+ 11867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:02.770451 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:02.770458 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:02.770507 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:02.774843 (+ 4336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:02.777105 (+ 2262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:02.777114 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:02.777117 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:02.777256 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:02.777903 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:02.777907 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:02.777910 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:02.778242 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:02.778395 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:02.779315 (+ 920us) server_negotiation.cc:299] Negotiation successful
0808 11:32:02.779548 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48094,"thread_start_us":53418,"threads_started":1}
I20260808 11:32:02.781073 2158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:02.705903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:33241 (local address 127.26.66.131:54997)
0808 11:32:02.707440 (+ 1537us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:02.707490 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:02.710636 (+ 3146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:02.751836 (+ 41200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:02.751841 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:02.752380 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:02.752637 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:02.752650 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.754174 (+ 1524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.754181 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:02.756440 (+ 2259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:02.756455 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.757548 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.757557 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:02.757902 (+ 345us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:02.759876 (+ 1974us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:02.759941 (+ 65us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:02.765669 (+ 5728us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:02.775779 (+ 10110us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:02.775786 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:02.775789 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:02.776352 (+ 563us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:02.777334 (+ 982us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:02.777340 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:02.777344 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:02.777551 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:02.779954 (+ 2403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:02.779960 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:02.780222 (+ 262us) client_negotiation.cc:769] Sending connection context
0808 11:32:02.780358 (+ 136us) client_negotiation.cc:240] Negotiation successful
0808 11:32:02.780650 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1232,"mutex_wait_us":1,"thread_start_us":40900,"threads_started":1}
I20260808 11:32:02.781272 2151 heartbeater.cc:347] Connected to a master server at 127.26.66.189:40689
I20260808 11:32:02.781585 2151 heartbeater.cc:464] Registering TS with master...
I20260808 11:32:02.782079 2154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:02.698916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:54997 (local address 127.26.66.188:33241)
0808 11:32:02.751524 (+ 52608us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:02.751533 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:02.751555 (+ 22us) server_negotiation.cc:407] Connection header received
0808 11:32:02.751616 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:02.751623 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:02.751696 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:02.751834 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:02.752831 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.754005 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.756599 (+ 2594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.757274 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.761366 (+ 4092us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:02.766183 (+ 4817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:02.766191 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:02.766195 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:02.766233 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:02.774330 (+ 8097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:02.777019 (+ 2689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:02.777026 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:02.777030 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:02.777182 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:02.777963 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:02.777969 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:02.777972 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:02.778311 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:02.781320 (+ 3009us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:02.781446 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 11:32:02.781700 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52457,"thread_start_us":54017,"threads_started":1}
I20260808 11:32:02.782507 2151 heartbeater.cc:511] Master 127.26.66.189:40689 requested a full tablet report, sending...
I20260808 11:32:02.782752 2160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:02.708384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:53199 (local address 127.26.66.190:42549)
0808 11:32:02.745101 (+ 36717us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:02.745106 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:02.746750 (+ 1644us) server_negotiation.cc:407] Connection header received
0808 11:32:02.746932 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:02.746937 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:02.747021 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:02.747226 (+ 205us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:02.749716 (+ 2490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.751229 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.758171 (+ 6942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.758851 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.758958 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:02.767361 (+ 8403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:02.767369 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:02.767374 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:02.767416 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:02.771258 (+ 3842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:02.773026 (+ 1768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:02.773031 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:02.773035 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:02.773177 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:02.774518 (+ 1341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:02.774525 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:02.774528 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:02.774919 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:02.775088 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:02.781540 (+ 6452us) server_negotiation.cc:299] Negotiation successful
0808 11:32:02.781836 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36617,"thread_start_us":36872,"threads_started":1}
I20260808 11:32:02.782918 2149 heartbeater.cc:347] Connected to a master server at 127.26.66.188:33241
I20260808 11:32:02.783056 2149 heartbeater.cc:464] Registering TS with master...
I20260808 11:32:02.783499 2149 heartbeater.cc:511] Master 127.26.66.188:33241 requested a full tablet report, sending...
I20260808 11:32:02.784477 1468 ts_manager.cc:194] Registered new tserver with Master: ed4fddccd7004be7ae7b9d5ec506a12e (127.26.66.131:43687)
I20260808 11:32:02.784698 1670 ts_manager.cc:194] Registered new tserver with Master: ed4fddccd7004be7ae7b9d5ec506a12e (127.26.66.131:43687)
I20260808 11:32:02.784724 2169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:02.753123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48054 (local address 127.26.66.188:33241)
0808 11:32:02.753604 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:02.753610 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:02.753627 (+ 17us) server_negotiation.cc:407] Connection header received
0808 11:32:02.753678 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:02.753684 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:02.753763 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:02.755607 (+ 1844us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:02.756896 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.759119 (+ 2223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.761112 (+ 1993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.761715 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.761863 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:02.764751 (+ 2888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:02.764781 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:02.764786 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:02.764826 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:02.773718 (+ 8892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:02.780583 (+ 6865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:02.780589 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:02.780593 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:02.780745 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:02.781452 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:02.781457 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:02.781460 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:02.781825 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:02.783668 (+ 1843us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:02.783804 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 11:32:02.784104 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":254,"threads_started":1}
I20260808 11:32:02.786268 2155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:02.740517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60278 (local address 127.26.66.189:40689)
0808 11:32:02.752663 (+ 12146us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:02.752668 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:02.752688 (+ 20us) server_negotiation.cc:407] Connection header received
0808 11:32:02.752738 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:02.752745 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:02.752833 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:02.759406 (+ 6573us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:02.759638 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.760936 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.763833 (+ 2897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.764619 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.764807 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:02.768405 (+ 3598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:02.768413 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:02.768418 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:02.768460 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:02.775576 (+ 7116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:02.776467 (+ 891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:02.776472 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:02.776476 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:02.776643 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:02.777398 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:02.777403 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:02.777405 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:02.777742 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:02.785627 (+ 7885us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:02.785717 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 11:32:02.785887 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12015,"thread_start_us":8839,"threads_started":1}
I20260808 11:32:02.788208 2150 heartbeater.cc:347] Connected to a master server at 127.26.66.190:42549
I20260808 11:32:02.788332 2150 heartbeater.cc:464] Registering TS with master...
I20260808 11:32:02.788662 2150 heartbeater.cc:511] Master 127.26.66.190:42549 requested a full tablet report, sending...
I20260808 11:32:02.789712 851 ts_manager.cc:194] Re-registered known tserver with Master: ed4fddccd7004be7ae7b9d5ec506a12e (127.26.66.131:43687)
I20260808 11:32:02.790889 851 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.66.131@KRBTEST.COM'} at 127.26.66.131:53199
I20260808 11:32:02.776919 850 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57990:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 11:32:02.794545 850 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:32:02.828171 2181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:02.815682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:37937 (local address 127.0.0.1:37958)
0808 11:32:02.816309 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:02.816377 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:02.816510 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:02.817679 (+ 1169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:02.817688 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:02.817722 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:02.818228 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:02.818244 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.820826 (+ 2582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.820836 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:02.823869 (+ 3033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:02.823913 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.826795 (+ 2882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.826806 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:02.827074 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:02.827136 (+ 62us) client_negotiation.cc:769] Sending connection context
0808 11:32:02.827390 (+ 254us) client_negotiation.cc:240] Negotiation successful
0808 11:32:02.827612 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":334,"threads_started":1}
I20260808 11:32:02.829116 2182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:02.816121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37958 (local address 127.26.66.129:37937)
0808 11:32:02.816639 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:02.816648 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:02.816680 (+ 32us) server_negotiation.cc:407] Connection header received
0808 11:32:02.816792 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:02.816800 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:02.817073 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:02.817366 (+ 293us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:02.818487 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.820591 (+ 2104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.824097 (+ 3506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.826170 (+ 2073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.826361 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:02.826649 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:02.828474 (+ 1825us) server_negotiation.cc:299] Negotiation successful
0808 11:32:02.828718 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":759,"threads_started":1}
I20260808 11:32:02.834488 1788 tablet_service.cc:1467] Processing CreateTablet for tablet 88487020f78e4c83846c25f3ea018087 (DEFAULT_TABLE table=test-table [id=6004121fa25441e9915196717132a0e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:32:02.836364 1788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88487020f78e4c83846c25f3ea018087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:02.845990 2183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:02.817055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:43687 (local address 127.0.0.1:59928)
0808 11:32:02.831103 (+ 14048us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:02.831123 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:02.831249 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:02.837617 (+ 6368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:02.837622 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:02.837650 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:02.838099 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:02.838112 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.841303 (+ 3191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.841308 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:02.843458 (+ 2150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:02.843473 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.845112 (+ 1639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.845121 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:02.845322 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:02.845357 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 11:32:02.845447 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 11:32:02.845585 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13883,"thread_start_us":19662,"threads_started":1}
I20260808 11:32:02.846822 2186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:02.817847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59928 (local address 127.26.66.131:43687)
0808 11:32:02.836993 (+ 19146us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:02.836999 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:02.837028 (+ 29us) server_negotiation.cc:407] Connection header received
0808 11:32:02.837111 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:02.837117 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:02.837384 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:02.838489 (+ 1105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:02.839068 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.841157 (+ 2089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.843709 (+ 2552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.844834 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.845918 (+ 1084us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:02.846408 (+ 490us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:02.846471 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 11:32:02.846579 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18470,"thread_start_us":18270,"threads_started":1}
I20260808 11:32:02.848335 2181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:02.816212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:39409 (local address 127.0.0.1:58546)
0808 11:32:02.829558 (+ 13346us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:02.829583 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:02.829716 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:02.841595 (+ 11879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:02.841600 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:02.841626 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:02.841878 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:02.841891 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.843672 (+ 1781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.843677 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:02.845747 (+ 2070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:02.845762 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.847538 (+ 1776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.847544 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:02.847736 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:02.847778 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 11:32:02.847923 (+ 145us) client_negotiation.cc:240] Negotiation successful
0808 11:32:02.848067 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13201,"thread_start_us":15173,"threads_started":1}
I20260808 11:32:02.848443 2184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:02.816684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58546 (local address 127.26.66.130:39409)
0808 11:32:02.840363 (+ 23679us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:02.840369 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:02.840392 (+ 23us) server_negotiation.cc:407] Connection header received
0808 11:32:02.840467 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:02.840473 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:02.841377 (+ 904us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:02.841581 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:02.842068 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.843495 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.845985 (+ 2490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:02.847357 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:02.847491 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:02.847689 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:02.847973 (+ 284us) server_negotiation.cc:299] Negotiation successful
0808 11:32:02.848142 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23524,"thread_start_us":23345,"threads_started":1}
I20260808 11:32:02.850385 2081 tablet_service.cc:1467] Processing CreateTablet for tablet 88487020f78e4c83846c25f3ea018087 (DEFAULT_TABLE table=test-table [id=6004121fa25441e9915196717132a0e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:32:02.851780 2081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88487020f78e4c83846c25f3ea018087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:02.851820 2187 tablet_bootstrap.cc:492] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d: Bootstrap starting.
I20260808 11:32:02.852322 1937 tablet_service.cc:1467] Processing CreateTablet for tablet 88487020f78e4c83846c25f3ea018087 (DEFAULT_TABLE table=test-table [id=6004121fa25441e9915196717132a0e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:32:02.853435 1937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88487020f78e4c83846c25f3ea018087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:02.855798 2187 tablet_bootstrap.cc:654] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:02.857241 2187 log.cc:824] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d: Log is configured to *not* fsync() on all Append() calls
I20260808 11:32:02.860430 2187 tablet_bootstrap.cc:492] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d: No bootstrap required, opened a new log
I20260808 11:32:02.860703 2187 ts_tablet_manager.cc:1397] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260808 11:32:02.866242 2189 tablet_bootstrap.cc:492] T 88487020f78e4c83846c25f3ea018087 P 1dadf97038de45fc80e51464a0555345: Bootstrap starting.
I20260808 11:32:02.867770 2190 tablet_bootstrap.cc:492] T 88487020f78e4c83846c25f3ea018087 P ed4fddccd7004be7ae7b9d5ec506a12e: Bootstrap starting.
I20260808 11:32:02.870167 2189 tablet_bootstrap.cc:654] T 88487020f78e4c83846c25f3ea018087 P 1dadf97038de45fc80e51464a0555345: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:02.870486 2187 raft_consensus.cc:348] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "571ff9c747d54ad4b5082705b118489d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37937 } } peers { permanent_uuid: "1dadf97038de45fc80e51464a0555345" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39409 } } peers { permanent_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43687 } }
I20260808 11:32:02.870857 2187 raft_consensus.cc:374] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:02.870988 2187 raft_consensus.cc:729] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 571ff9c747d54ad4b5082705b118489d, State: Initialized, Role: FOLLOWER
I20260808 11:32:02.871376 2190 tablet_bootstrap.cc:654] T 88487020f78e4c83846c25f3ea018087 P ed4fddccd7004be7ae7b9d5ec506a12e: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:02.871495 2189 log.cc:824] T 88487020f78e4c83846c25f3ea018087 P 1dadf97038de45fc80e51464a0555345: Log is configured to *not* fsync() on all Append() calls
I20260808 11:32:02.871702 2187 consensus_queue.cc:260] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "571ff9c747d54ad4b5082705b118489d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37937 } } peers { permanent_uuid: "1dadf97038de45fc80e51464a0555345" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39409 } } peers { permanent_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43687 } }
I20260808 11:32:02.872895 2190 log.cc:824] T 88487020f78e4c83846c25f3ea018087 P ed4fddccd7004be7ae7b9d5ec506a12e: Log is configured to *not* fsync() on all Append() calls
I20260808 11:32:02.873618 2187 ts_tablet_manager.cc:1428] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260808 11:32:02.882758 2190 tablet_bootstrap.cc:492] T 88487020f78e4c83846c25f3ea018087 P ed4fddccd7004be7ae7b9d5ec506a12e: No bootstrap required, opened a new log
I20260808 11:32:02.882755 2189 tablet_bootstrap.cc:492] T 88487020f78e4c83846c25f3ea018087 P 1dadf97038de45fc80e51464a0555345: No bootstrap required, opened a new log
I20260808 11:32:02.883061 2189 ts_tablet_manager.cc:1397] T 88487020f78e4c83846c25f3ea018087 P 1dadf97038de45fc80e51464a0555345: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.012s
I20260808 11:32:02.883051 2190 ts_tablet_manager.cc:1397] T 88487020f78e4c83846c25f3ea018087 P ed4fddccd7004be7ae7b9d5ec506a12e: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.005s
I20260808 11:32:02.894210 2190 raft_consensus.cc:348] T 88487020f78e4c83846c25f3ea018087 P ed4fddccd7004be7ae7b9d5ec506a12e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "571ff9c747d54ad4b5082705b118489d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37937 } } peers { permanent_uuid: "1dadf97038de45fc80e51464a0555345" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39409 } } peers { permanent_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43687 } }
I20260808 11:32:02.894166 2189 raft_consensus.cc:348] T 88487020f78e4c83846c25f3ea018087 P 1dadf97038de45fc80e51464a0555345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "571ff9c747d54ad4b5082705b118489d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37937 } } peers { permanent_uuid: "1dadf97038de45fc80e51464a0555345" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39409 } } peers { permanent_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43687 } }
I20260808 11:32:02.894649 2189 raft_consensus.cc:374] T 88487020f78e4c83846c25f3ea018087 P 1dadf97038de45fc80e51464a0555345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:02.894649 2190 raft_consensus.cc:374] T 88487020f78e4c83846c25f3ea018087 P ed4fddccd7004be7ae7b9d5ec506a12e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:02.894768 2189 raft_consensus.cc:729] T 88487020f78e4c83846c25f3ea018087 P 1dadf97038de45fc80e51464a0555345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dadf97038de45fc80e51464a0555345, State: Initialized, Role: FOLLOWER
I20260808 11:32:02.894759 2190 raft_consensus.cc:729] T 88487020f78e4c83846c25f3ea018087 P ed4fddccd7004be7ae7b9d5ec506a12e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4fddccd7004be7ae7b9d5ec506a12e, State: Initialized, Role: FOLLOWER
I20260808 11:32:02.895453 2189 consensus_queue.cc:260] T 88487020f78e4c83846c25f3ea018087 P 1dadf97038de45fc80e51464a0555345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "571ff9c747d54ad4b5082705b118489d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37937 } } peers { permanent_uuid: "1dadf97038de45fc80e51464a0555345" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39409 } } peers { permanent_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43687 } }
I20260808 11:32:02.895447 2190 consensus_queue.cc:260] T 88487020f78e4c83846c25f3ea018087 P ed4fddccd7004be7ae7b9d5ec506a12e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "571ff9c747d54ad4b5082705b118489d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37937 } } peers { permanent_uuid: "1dadf97038de45fc80e51464a0555345" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39409 } } peers { permanent_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43687 } }
I20260808 11:32:02.897029 2003 heartbeater.cc:503] Master 127.26.66.190:42549 was elected leader, sending a full tablet report...
I20260808 11:32:02.897507 2189 ts_tablet_manager.cc:1428] T 88487020f78e4c83846c25f3ea018087 P 1dadf97038de45fc80e51464a0555345: Time spent starting tablet: real 0.014s user 0.010s sys 0.005s
I20260808 11:32:02.897636 2190 ts_tablet_manager.cc:1428] T 88487020f78e4c83846c25f3ea018087 P ed4fddccd7004be7ae7b9d5ec506a12e: Time spent starting tablet: real 0.014s user 0.013s sys 0.002s
I20260808 11:32:02.898077 2150 heartbeater.cc:503] Master 127.26.66.190:42549 was elected leader, sending a full tablet report...
W20260808 11:32:02.919173 1856 tablet.cc:2369] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 11:32:02.985419 2153 tablet.cc:2369] T 88487020f78e4c83846c25f3ea018087 P ed4fddccd7004be7ae7b9d5ec506a12e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 11:32:03.074419 2006 tablet.cc:2369] T 88487020f78e4c83846c25f3ea018087 P 1dadf97038de45fc80e51464a0555345: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:32:03.132011 2192 raft_consensus.cc:482] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:32:03.132309 2192 raft_consensus.cc:504] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "571ff9c747d54ad4b5082705b118489d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37937 } } peers { permanent_uuid: "1dadf97038de45fc80e51464a0555345" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39409 } } peers { permanent_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43687 } }
I20260808 11:32:03.133986 2192 leader_election.cc:288] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1dadf97038de45fc80e51464a0555345 (127.26.66.130:39409), ed4fddccd7004be7ae7b9d5ec506a12e (127.26.66.131:43687)
I20260808 11:32:03.141887 2184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:03.134452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:43909 (local address 127.26.66.130:39409)
0808 11:32:03.134687 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:03.134696 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:03.135724 (+ 1028us) server_negotiation.cc:407] Connection header received
0808 11:32:03.135939 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:03.135945 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:03.136019 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:03.136118 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:03.136747 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:03.137524 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:03.139722 (+ 2198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:03.140823 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:03.140972 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:03.141077 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:03.141457 (+ 380us) server_negotiation.cc:299] Negotiation successful
0808 11:32:03.141606 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 11:32:03.141990 2186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:03.134532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:41689 (local address 127.26.66.131:43687)
0808 11:32:03.134769 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:03.134778 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:03.135630 (+ 852us) server_negotiation.cc:407] Connection header received
0808 11:32:03.135865 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:03.135870 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:03.135984 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:03.136089 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:03.136671 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:03.137494 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:03.139742 (+ 2248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:03.140978 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:03.141139 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:03.141212 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:03.141619 (+ 407us) server_negotiation.cc:299] Negotiation successful
0808 11:32:03.141736 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 11:32:03.142125 2196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:03.134430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:39409 (local address 127.26.66.129:43909)
0808 11:32:03.135605 (+ 1175us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:03.135619 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:03.135769 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:03.136135 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:03.136139 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:03.136162 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:03.136559 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:03.136569 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:03.137691 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:03.137696 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:03.139557 (+ 1861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:03.139570 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:03.141098 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:03.141104 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:03.141287 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:03.141320 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 11:32:03.141508 (+ 188us) client_negotiation.cc:240] Negotiation successful
0808 11:32:03.141660 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1053,"mutex_wait_us":78,"thread_start_us":561,"threads_started":1}
I20260808 11:32:03.142549 2197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:03.134273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:43687 (local address 127.26.66.129:41689)
0808 11:32:03.135511 (+ 1238us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:03.135527 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:03.135704 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:03.136108 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:03.136112 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:03.136136 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:03.136515 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:03.136529 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:03.137735 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:03.137749 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:03.139563 (+ 1814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:03.139575 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:03.141266 (+ 1691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:03.141271 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:03.141452 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:03.141485 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 11:32:03.141576 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 11:32:03.141686 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1102,"mutex_wait_us":48,"thread_start_us":896,"threads_started":1}
I20260808 11:32:03.143455 1957 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88487020f78e4c83846c25f3ea018087" candidate_uuid: "571ff9c747d54ad4b5082705b118489d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dadf97038de45fc80e51464a0555345" is_pre_election: true
I20260808 11:32:03.143637 2102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88487020f78e4c83846c25f3ea018087" candidate_uuid: "571ff9c747d54ad4b5082705b118489d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e" is_pre_election: true
I20260808 11:32:03.144007 1957 raft_consensus.cc:2454] T 88487020f78e4c83846c25f3ea018087 P 1dadf97038de45fc80e51464a0555345 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 571ff9c747d54ad4b5082705b118489d in term 0.
I20260808 11:32:03.144150 2102 raft_consensus.cc:2454] T 88487020f78e4c83846c25f3ea018087 P ed4fddccd7004be7ae7b9d5ec506a12e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 571ff9c747d54ad4b5082705b118489d in term 0.
I20260808 11:32:03.144812 1742 leader_election.cc:302] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1dadf97038de45fc80e51464a0555345, 571ff9c747d54ad4b5082705b118489d, ed4fddccd7004be7ae7b9d5ec506a12e; no voters:
I20260808 11:32:03.145246 2192 raft_consensus.cc:2781] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:32:03.145395 2192 raft_consensus.cc:482] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:32:03.145565 2192 raft_consensus.cc:3037] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:03.147768 2192 raft_consensus.cc:504] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "571ff9c747d54ad4b5082705b118489d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37937 } } peers { permanent_uuid: "1dadf97038de45fc80e51464a0555345" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39409 } } peers { permanent_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43687 } }
I20260808 11:32:03.148517 2192 leader_election.cc:288] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d [CANDIDATE]: Term 1 election: Requested vote from peers 1dadf97038de45fc80e51464a0555345 (127.26.66.130:39409), ed4fddccd7004be7ae7b9d5ec506a12e (127.26.66.131:43687)
I20260808 11:32:03.148867 1957 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88487020f78e4c83846c25f3ea018087" candidate_uuid: "571ff9c747d54ad4b5082705b118489d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dadf97038de45fc80e51464a0555345"
I20260808 11:32:03.149015 2102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88487020f78e4c83846c25f3ea018087" candidate_uuid: "571ff9c747d54ad4b5082705b118489d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e"
I20260808 11:32:03.149078 1957 raft_consensus.cc:3037] T 88487020f78e4c83846c25f3ea018087 P 1dadf97038de45fc80e51464a0555345 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:03.149219 2102 raft_consensus.cc:3037] T 88487020f78e4c83846c25f3ea018087 P ed4fddccd7004be7ae7b9d5ec506a12e [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:03.152458 2102 raft_consensus.cc:2454] T 88487020f78e4c83846c25f3ea018087 P ed4fddccd7004be7ae7b9d5ec506a12e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 571ff9c747d54ad4b5082705b118489d in term 1.
I20260808 11:32:03.152458 1957 raft_consensus.cc:2454] T 88487020f78e4c83846c25f3ea018087 P 1dadf97038de45fc80e51464a0555345 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 571ff9c747d54ad4b5082705b118489d in term 1.
I20260808 11:32:03.152909 1742 leader_election.cc:302] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1dadf97038de45fc80e51464a0555345, 571ff9c747d54ad4b5082705b118489d, ed4fddccd7004be7ae7b9d5ec506a12e; no voters:
I20260808 11:32:03.153251 2192 raft_consensus.cc:2781] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:32:03.153707 2192 raft_consensus.cc:686] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d [term 1 LEADER]: Becoming Leader. State: Replica: 571ff9c747d54ad4b5082705b118489d, State: Running, Role: LEADER
I20260808 11:32:03.154192 2192 consensus_queue.cc:237] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "571ff9c747d54ad4b5082705b118489d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37937 } } peers { permanent_uuid: "1dadf97038de45fc80e51464a0555345" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39409 } } peers { permanent_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43687 } }
I20260808 11:32:03.159471 850 catalog_manager.cc:5495] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d reported cstate change: term changed from 0 to 1, leader changed from <none> to 571ff9c747d54ad4b5082705b118489d (127.26.66.129). New cstate: current_term: 1 leader_uuid: "571ff9c747d54ad4b5082705b118489d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "571ff9c747d54ad4b5082705b118489d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dadf97038de45fc80e51464a0555345" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260808 11:32:03.190568 2182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:03.185199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37960 (local address 127.26.66.129:37937)
0808 11:32:03.185422 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:03.185429 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:03.185586 (+ 157us) server_negotiation.cc:407] Connection header received
0808 11:32:03.185737 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:03.185741 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:03.185841 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:03.185960 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:32:03.186317 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:03.187063 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:03.188511 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:03.188975 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:03.189071 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:03.189505 (+ 434us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:32:03.190006 (+ 501us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:32:03.190112 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:03.190202 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 11:32:03.190265 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 11:32:03.198861 1957 raft_consensus.cc:1261] T 88487020f78e4c83846c25f3ea018087 P 1dadf97038de45fc80e51464a0555345 [term 1 FOLLOWER]: Refusing update from remote peer 571ff9c747d54ad4b5082705b118489d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:32:03.198855 2102 raft_consensus.cc:1261] T 88487020f78e4c83846c25f3ea018087 P ed4fddccd7004be7ae7b9d5ec506a12e [term 1 FOLLOWER]: Refusing update from remote peer 571ff9c747d54ad4b5082705b118489d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:32:03.199972 2198 consensus_queue.cc:1035] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dadf97038de45fc80e51464a0555345" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:32:03.200420 2192 consensus_queue.cc:1035] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:32:03.224956 2203 mvcc.cc:205] Tried to move back new op lower bound from 7316229010212323328 to 7316229010042966016. Current Snapshot: MvccSnapshot[applied={T|T < 7316229010212323328}]
I20260808 11:32:03.235010 851 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57990:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:32:03.235319 851 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57990:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:32:03.243430 851 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6316a06b9ecf40daa1a69236580155c2: Sending DeleteTablet for 3 replicas of tablet 88487020f78e4c83846c25f3ea018087
I20260808 11:32:03.244645 2081 tablet_service.cc:1514] Processing DeleteTablet for tablet 88487020f78e4c83846c25f3ea018087 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:32:03 UTC) from {username='oryx', principal='oryx/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:59928
I20260808 11:32:03.244810 2079 tablet_service.cc:1514] Processing DeleteTablet for tablet 88487020f78e4c83846c25f3ea018087 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:32:03 UTC) from {username='oryx', principal='oryx/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:59928
I20260808 11:32:03.245708 1937 tablet_service.cc:1514] Processing DeleteTablet for tablet 88487020f78e4c83846c25f3ea018087 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:32:03 UTC) from {username='oryx', principal='oryx/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:58546
I20260808 11:32:03.247092 1788 tablet_service.cc:1514] Processing DeleteTablet for tablet 88487020f78e4c83846c25f3ea018087 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:32:03 UTC) from {username='oryx', principal='oryx/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:37958
I20260808 11:32:03.260344 2213 tablet_replica.cc:330] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d: stopping tablet replica
I20260808 11:32:03.260934 2213 raft_consensus.cc:2229] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d [term 1 LEADER]: Raft consensus shutting down.
I20260808 11:32:03.261757 2213 raft_consensus.cc:2258] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:32:03.262794 2211 tablet_replica.cc:330] T 88487020f78e4c83846c25f3ea018087 P ed4fddccd7004be7ae7b9d5ec506a12e: stopping tablet replica
I20260808 11:32:03.263310 2211 raft_consensus.cc:2229] T 88487020f78e4c83846c25f3ea018087 P ed4fddccd7004be7ae7b9d5ec506a12e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:32:03.264708 2212 tablet_replica.cc:330] T 88487020f78e4c83846c25f3ea018087 P 1dadf97038de45fc80e51464a0555345: stopping tablet replica
I20260808 11:32:03.265096 2212 raft_consensus.cc:2229] T 88487020f78e4c83846c25f3ea018087 P 1dadf97038de45fc80e51464a0555345 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:32:03.265532 2212 raft_consensus.cc:2258] T 88487020f78e4c83846c25f3ea018087 P 1dadf97038de45fc80e51464a0555345 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:32:03.267741 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 818
I20260808 11:32:03.268270 2211 raft_consensus.cc:2258] T 88487020f78e4c83846c25f3ea018087 P ed4fddccd7004be7ae7b9d5ec506a12e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:32:03.268324 2212 ts_tablet_manager.cc:1905] T 88487020f78e4c83846c25f3ea018087 P 1dadf97038de45fc80e51464a0555345: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:32:03.268847 2213 ts_tablet_manager.cc:1905] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:32:03.269496 883 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:03.276095 2212 ts_tablet_manager.cc:1918] T 88487020f78e4c83846c25f3ea018087 P 1dadf97038de45fc80e51464a0555345: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:32:03.276150 2213 ts_tablet_manager.cc:1918] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:32:03.276294 2213 log.cc:1196] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/wal/wals/88487020f78e4c83846c25f3ea018087
I20260808 11:32:03.276404 2212 log.cc:1196] T 88487020f78e4c83846c25f3ea018087 P 1dadf97038de45fc80e51464a0555345: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/wal/wals/88487020f78e4c83846c25f3ea018087
I20260808 11:32:03.276912 2213 ts_tablet_manager.cc:1939] T 88487020f78e4c83846c25f3ea018087 P 571ff9c747d54ad4b5082705b118489d: Deleting consensus metadata
I20260808 11:32:03.277076 2212 ts_tablet_manager.cc:1939] T 88487020f78e4c83846c25f3ea018087 P 1dadf97038de45fc80e51464a0555345: Deleting consensus metadata
I20260808 11:32:03.280411 2211 ts_tablet_manager.cc:1905] T 88487020f78e4c83846c25f3ea018087 P ed4fddccd7004be7ae7b9d5ec506a12e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:32:03.286003 2211 ts_tablet_manager.cc:1918] T 88487020f78e4c83846c25f3ea018087 P ed4fddccd7004be7ae7b9d5ec506a12e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:32:03.286180 2211 log.cc:1196] T 88487020f78e4c83846c25f3ea018087 P ed4fddccd7004be7ae7b9d5ec506a12e: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/wal/wals/88487020f78e4c83846c25f3ea018087
I20260808 11:32:03.286814 2211 ts_tablet_manager.cc:1939] T 88487020f78e4c83846c25f3ea018087 P ed4fddccd7004be7ae7b9d5ec506a12e: Deleting consensus metadata
I20260808 11:32:03.296010 2155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:03.250175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60280 (local address 127.26.66.189:40689)
0808 11:32:03.250358 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:03.250364 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:03.266436 (+ 16072us) server_negotiation.cc:407] Connection header received
0808 11:32:03.266531 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:03.266536 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:03.266624 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:03.266742 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:03.270549 (+ 3807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:03.272092 (+ 1543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:03.284076 (+ 11984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:03.285077 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:03.285223 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:03.290123 (+ 4900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:03.290129 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:03.290132 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:03.290168 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:03.292995 (+ 2827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:03.293687 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:03.293692 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:03.293706 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:03.293840 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:03.294308 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:03.294313 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:03.294316 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:03.294611 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:03.295031 (+ 420us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:03.295322 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 11:32:03.295557 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 11:32:03.311334 2169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:03.266397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48066 (local address 127.26.66.188:33241)
0808 11:32:03.266597 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:03.266603 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:03.296037 (+ 29434us) server_negotiation.cc:407] Connection header received
0808 11:32:03.296308 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:03.296315 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:03.296411 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:03.296486 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:03.298312 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:03.299210 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:03.300742 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:03.301142 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:03.301287 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:03.304105 (+ 2818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:03.304111 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:03.304116 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:03.304159 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:03.308138 (+ 3979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:03.309001 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:03.309010 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:03.309017 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:03.309175 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:03.309659 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:03.309668 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:03.309674 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:03.310065 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:03.310314 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:03.310911 (+ 597us) server_negotiation.cc:299] Negotiation successful
0808 11:32:03.311090 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 11:32:03.440553 834 catalog_manager.cc:4841] TS 571ff9c747d54ad4b5082705b118489d (127.26.66.129:37937): tablet 88487020f78e4c83846c25f3ea018087 (table test-table [id=6004121fa25441e9915196717132a0e1]) successfully deleted
W20260808 11:32:03.441514 834 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.26.66.129:37937, user_credentials={real_user=slave}} blocked reactor thread for 162121us
I20260808 11:32:03.441960 836 catalog_manager.cc:4841] TS ed4fddccd7004be7ae7b9d5ec506a12e (127.26.66.131:43687): tablet 88487020f78e4c83846c25f3ea018087 (table test-table [id=6004121fa25441e9915196717132a0e1]) successfully deleted
I20260808 11:32:03.442091 835 catalog_manager.cc:4841] TS 1dadf97038de45fc80e51464a0555345 (127.26.66.130:39409): tablet 88487020f78e4c83846c25f3ea018087 (table test-table [id=6004121fa25441e9915196717132a0e1]) successfully deleted
I20260808 11:32:03.442468 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 818
I20260808 11:32:03.503962 2169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:03.482764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48070 (local address 127.26.66.188:33241)
0808 11:32:03.483033 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:03.483042 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:03.484790 (+ 1748us) server_negotiation.cc:407] Connection header received
0808 11:32:03.485174 (+ 384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:03.485185 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:03.485318 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:03.485413 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:03.488693 (+ 3280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:03.490230 (+ 1537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:03.492276 (+ 2046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:03.492701 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:03.492840 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:03.497455 (+ 4615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:03.497462 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:03.497467 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:03.497518 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:03.501177 (+ 3659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:03.501846 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:03.501853 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:03.501858 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:03.502006 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:03.502430 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:03.502435 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:03.502439 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:03.502719 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:03.503001 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:03.503311 (+ 310us) server_negotiation.cc:299] Negotiation successful
0808 11:32:03.503513 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260808 11:32:03.507292 2155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:03.483796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60284 (local address 127.26.66.189:40689)
0808 11:32:03.484204 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:03.484213 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:03.490387 (+ 6174us) server_negotiation.cc:407] Connection header received
0808 11:32:03.490473 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:03.490481 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:03.490592 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:03.490684 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:03.492952 (+ 2268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:03.493686 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:03.495821 (+ 2135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:03.496623 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:03.496769 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:03.499882 (+ 3113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:03.499909 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:03.499914 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:03.499954 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:03.503378 (+ 3424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:03.505311 (+ 1933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:03.505317 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:03.505321 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:03.505455 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:03.505876 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:03.505882 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:03.505888 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:03.506211 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:03.506445 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:03.506708 (+ 263us) server_negotiation.cc:299] Negotiation successful
0808 11:32:03.506932 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186}
I20260808 11:32:04.229898 2223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.229084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.26.66.129:54183)
0808 11:32:04.229599 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:04.229729 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":274,"threads_started":1}
W20260808 11:32:04.230290 1854 heartbeater.cc:644] Failed to heartbeat to 127.26.66.190:42549 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
I20260808 11:32:04.236167 2224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.235467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.26.66.130:50125)
0808 11:32:04.235856 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:04.236013 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":193,"threads_started":1}
W20260808 11:32:04.236537 2003 heartbeater.cc:644] Failed to heartbeat to 127.26.66.190:42549 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
I20260808 11:32:04.249253 2225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.248532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.26.66.131:53927)
0808 11:32:04.248958 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:04.249071 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":202,"threads_started":1}
W20260808 11:32:04.249718 2150 heartbeater.cc:644] Failed to heartbeat to 127.26.66.190:42549 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
I20260808 11:32:04.743597 2226 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6316a06b9ecf40daa1a69236580155c2)
I20260808 11:32:04.743944 2226 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: false } }
I20260808 11:32:04.744652 2227 raft_consensus.cc:482] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6316a06b9ecf40daa1a69236580155c2)
I20260808 11:32:04.744928 2227 raft_consensus.cc:504] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: false } }
I20260808 11:32:04.745426 2226 leader_election.cc:288] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6316a06b9ecf40daa1a69236580155c2 (127.26.66.190:42549), ecf36c976ef54ee08b29fc4ddb7c9cc6 (127.26.66.189:40689)
I20260808 11:32:04.746383 2227 leader_election.cc:288] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6316a06b9ecf40daa1a69236580155c2 (127.26.66.190:42549), 6745c77285434df49b46cc45469e4791 (127.26.66.188:33241)
I20260808 11:32:04.746587 2228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.745634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.0.0.1:58456)
0808 11:32:04.746085 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:04.746301 (+ 216us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":219,"threads_started":1}
I20260808 11:32:04.748045 2232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.746603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.0.0.1:58464)
0808 11:32:04.747480 (+ 877us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:04.747688 (+ 208us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":756,"thread_start_us":1041,"threads_started":1}
W20260808 11:32:04.748306 1454 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
W20260808 11:32:04.749006 1656 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
I20260808 11:32:04.750280 2232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.749615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.0.0.1:58478)
0808 11:32:04.750061 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:04.750146 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":333}
W20260808 11:32:04.750550 1454 leader_election.cc:334] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6316a06b9ecf40daa1a69236580155c2 (127.26.66.190:42549): Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
I20260808 11:32:04.751286 2229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.750605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.0.0.1:58492)
0808 11:32:04.750839 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:04.751102 (+ 263us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
W20260808 11:32:04.751452 1656 leader_election.cc:334] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6316a06b9ecf40daa1a69236580155c2 (127.26.66.190:42549): Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
I20260808 11:32:04.754503 2228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.746271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:40689 (local address 127.0.0.1:60290)
0808 11:32:04.746938 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:04.746971 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:04.747101 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:04.747862 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:04.747867 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:04.747917 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:04.748316 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:04.748337 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:04.749886 (+ 1549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:04.749894 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:04.752328 (+ 2434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:04.752343 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:04.753958 (+ 1615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:04.753962 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:04.754102 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:04.754125 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 11:32:04.754198 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 11:32:04.754290 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"mutex_wait_us":1,"thread_start_us":2433,"threads_started":1}
I20260808 11:32:04.754757 2230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.746364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60290 (local address 127.26.66.189:40689)
0808 11:32:04.747058 (+ 694us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:04.747066 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:04.747092 (+ 26us) server_negotiation.cc:407] Connection header received
0808 11:32:04.747308 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:04.747314 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:04.747424 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:04.747508 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:04.748579 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:04.749693 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:04.752471 (+ 2778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:04.753810 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:04.753939 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:04.754031 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:04.754247 (+ 216us) server_negotiation.cc:299] Negotiation successful
0808 11:32:04.754396 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":51,"server-negotiator.queue_time_us":542,"thread_start_us":331,"threads_started":1}
I20260808 11:32:04.755334 1478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6745c77285434df49b46cc45469e4791" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" is_pre_election: true
I20260808 11:32:04.755694 1478 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6745c77285434df49b46cc45469e4791 in term 1.
I20260808 11:32:04.756242 1656 leader_election.cc:302] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6745c77285434df49b46cc45469e4791, ecf36c976ef54ee08b29fc4ddb7c9cc6; no voters: 6316a06b9ecf40daa1a69236580155c2
I20260808 11:32:04.756596 2226 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 11:32:04.756753 2226 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6316a06b9ecf40daa1a69236580155c2)
I20260808 11:32:04.756883 2226 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [term 1 FOLLOWER]: Advancing to term 2
I20260808 11:32:04.756999 2235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.749858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48078 (local address 127.26.66.188:33241)
0808 11:32:04.750613 (+ 755us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:04.750619 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:04.750640 (+ 21us) server_negotiation.cc:407] Connection header received
0808 11:32:04.750701 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:04.750708 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:04.750776 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:04.750889 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:04.751504 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:04.752644 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:04.755052 (+ 2408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:04.755936 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:04.756096 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:04.756205 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:04.756490 (+ 285us) server_negotiation.cc:299] Negotiation successful
0808 11:32:04.756616 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":628,"thread_start_us":494,"threads_started":1}
I20260808 11:32:04.757032 2231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.747043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:33241 (local address 127.0.0.1:48078)
0808 11:32:04.747952 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:04.747973 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:04.748078 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:04.750946 (+ 2868us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:04.750951 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:04.750979 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:04.751287 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:04.751297 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:04.752757 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:04.752763 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:04.754873 (+ 2110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:04.754888 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:04.756145 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:04.756151 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:04.756327 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:04.756349 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 11:32:04.756456 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 11:32:04.756576 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":762,"mutex_wait_us":1,"thread_start_us":284,"threads_started":1}
I20260808 11:32:04.757750 1680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "6745c77285434df49b46cc45469e4791" is_pre_election: true
I20260808 11:32:04.759488 2226 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: false } }
I20260808 11:32:04.759939 1680 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecf36c976ef54ee08b29fc4ddb7c9cc6 in current term 2: Already voted for candidate 6745c77285434df49b46cc45469e4791 in this term.
I20260808 11:32:04.760223 2226 leader_election.cc:288] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [CANDIDATE]: Term 2 election: Requested vote from peers 6316a06b9ecf40daa1a69236580155c2 (127.26.66.190:42549), ecf36c976ef54ee08b29fc4ddb7c9cc6 (127.26.66.189:40689)
I20260808 11:32:04.760725 2228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.760290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.0.0.1:58496)
0808 11:32:04.760542 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:04.760610 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178}
I20260808 11:32:04.760871 1478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6745c77285434df49b46cc45469e4791" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6"
I20260808 11:32:04.761109 1478 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [term 1 FOLLOWER]: Advancing to term 2
I20260808 11:32:04.761051 1455 leader_election.cc:302] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecf36c976ef54ee08b29fc4ddb7c9cc6; no voters: 6316a06b9ecf40daa1a69236580155c2, 6745c77285434df49b46cc45469e4791
I20260808 11:32:04.762112 2228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.761692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.0.0.1:58512)
0808 11:32:04.761899 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:04.761991 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260808 11:32:04.762287 1656 leader_election.cc:334] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6316a06b9ecf40daa1a69236580155c2 (127.26.66.190:42549): Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
I20260808 11:32:04.763571 1478 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6745c77285434df49b46cc45469e4791 in term 2.
I20260808 11:32:04.763746 2227 raft_consensus.cc:2726] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 11:32:04.764010 1656 leader_election.cc:302] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6745c77285434df49b46cc45469e4791, ecf36c976ef54ee08b29fc4ddb7c9cc6; no voters: 6316a06b9ecf40daa1a69236580155c2
I20260808 11:32:04.764307 2226 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 11:32:04.764863 2226 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [term 2 LEADER]: Becoming Leader. State: Replica: 6745c77285434df49b46cc45469e4791, State: Running, Role: LEADER
I20260808 11:32:04.765257 2226 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: false } }
I20260808 11:32:04.766846 2236 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6745c77285434df49b46cc45469e4791. Latest consensus state: current_term: 2 leader_uuid: "6745c77285434df49b46cc45469e4791" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: false } } }
I20260808 11:32:04.767164 2236 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [sys.catalog]: This master's current role is: LEADER
I20260808 11:32:04.767931 2238 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:32:04.771369 2238 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:32:04.772241 2238 catalog_manager.cc:1259] Loaded cluster ID: 5297473404864234a5651d18db96dd17
I20260808 11:32:04.772341 2238 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:32:04.773475 2238 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:32:04.774305 2238 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791: Loaded TSK: 0
I20260808 11:32:04.775115 2238 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:32:04.794451 1669 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48070:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 11:32:04.801477 1669 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:32:04.805434 2228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.804980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.0.0.1:58518)
0808 11:32:04.805125 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:04.805237 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 11:32:04.805814 1478 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [term 2 FOLLOWER]: Refusing update from remote peer 6745c77285434df49b46cc45469e4791: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260808 11:32:04.806490 2228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.806083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.0.0.1:58532)
0808 11:32:04.806253 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:04.806335 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 11:32:04.806644 2226 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260808 11:32:04.806942 1656 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 -> Peer 6316a06b9ecf40daa1a69236580155c2 (127.26.66.190:42549): Couldn't send request to peer 6316a06b9ecf40daa1a69236580155c2. Status: Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 11:32:04.809384 2227 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6745c77285434df49b46cc45469e4791. Latest consensus state: current_term: 2 leader_uuid: "6745c77285434df49b46cc45469e4791" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: false } } }
I20260808 11:32:04.809664 2227 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 11:32:04.811280 2240 mvcc.cc:205] Tried to move back new op lower bound from 7316229016797106176 to 7316229016641961984. Current Snapshot: MvccSnapshot[applied={T|T < 7316229016797106176}]
I20260808 11:32:04.811228 2226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "6745c77285434df49b46cc45469e4791" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: false } } }
I20260808 11:32:04.811528 2226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791 [sys.catalog]: This master's current role is: LEADER
I20260808 11:32:04.811623 2227 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "6745c77285434df49b46cc45469e4791" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6316a06b9ecf40daa1a69236580155c2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42549 } } peers { permanent_uuid: "ecf36c976ef54ee08b29fc4ddb7c9cc6" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 40689 } attrs { promote: false } } peers { permanent_uuid: "6745c77285434df49b46cc45469e4791" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 33241 } attrs { promote: false } } }
I20260808 11:32:04.811961 2227 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecf36c976ef54ee08b29fc4ddb7c9cc6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 11:32:04.826608 2228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.820253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:43687 (local address 127.0.0.1:59942)
0808 11:32:04.820407 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:04.820424 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:04.820507 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:04.821275 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:04.821280 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:04.821305 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:04.821510 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:04.821518 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:04.822954 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:04.822960 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:04.824430 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:04.824442 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:04.825848 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:04.825855 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:04.826045 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:04.826079 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 11:32:04.826178 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 11:32:04.826349 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 11:32:04.827335 2245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.820412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59942 (local address 127.26.66.131:43687)
0808 11:32:04.820920 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:04.820928 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:04.820947 (+ 19us) server_negotiation.cc:407] Connection header received
0808 11:32:04.821021 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:04.821027 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:04.821108 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:04.821254 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:04.821651 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:04.822776 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:04.824635 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:04.825437 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:04.825576 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:04.825674 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:04.827009 (+ 1335us) server_negotiation.cc:299] Negotiation successful
0808 11:32:04.827117 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":251,"threads_started":1}
I20260808 11:32:04.828068 2081 tablet_service.cc:1467] Processing CreateTablet for tablet f569bbf9fa3d460f91f029b2d4ad6dab (DEFAULT_TABLE table=test-table [id=ef94503c429542e7a2745a0ea5a336be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:32:04.828491 2081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f569bbf9fa3d460f91f029b2d4ad6dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:04.834124 2249 tablet_bootstrap.cc:492] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e: Bootstrap starting.
I20260808 11:32:04.836021 2249 tablet_bootstrap.cc:654] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:04.838279 2249 tablet_bootstrap.cc:492] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e: No bootstrap required, opened a new log
I20260808 11:32:04.838477 2249 ts_tablet_manager.cc:1397] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.004s
I20260808 11:32:04.839135 2249 raft_consensus.cc:348] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43687 } } peers { permanent_uuid: "1dadf97038de45fc80e51464a0555345" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39409 } } peers { permanent_uuid: "571ff9c747d54ad4b5082705b118489d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37937 } }
I20260808 11:32:04.839390 2249 raft_consensus.cc:374] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:04.839531 2249 raft_consensus.cc:729] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4fddccd7004be7ae7b9d5ec506a12e, State: Initialized, Role: FOLLOWER
I20260808 11:32:04.840086 2229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.820988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:37937 (local address 127.0.0.1:37962)
0808 11:32:04.821428 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:04.821457 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:04.821563 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:04.833284 (+ 11721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:04.833289 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:04.833319 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:04.833851 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:04.833867 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:04.835299 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:04.835305 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:04.837586 (+ 2281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:04.837601 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:04.839223 (+ 1622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:04.839229 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:04.839414 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:04.839463 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 11:32:04.839575 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 11:32:04.839729 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"mutex_wait_us":142}
I20260808 11:32:04.839920 2249 consensus_queue.cc:260] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43687 } } peers { permanent_uuid: "1dadf97038de45fc80e51464a0555345" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39409 } } peers { permanent_uuid: "571ff9c747d54ad4b5082705b118489d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37937 } }
I20260808 11:32:04.840102 2247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.821172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37962 (local address 127.26.66.129:37937)
0808 11:32:04.832855 (+ 11683us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:04.832861 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:04.832878 (+ 17us) server_negotiation.cc:407] Connection header received
0808 11:32:04.832946 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:04.832953 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:04.833034 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:04.833401 (+ 367us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:04.834041 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:04.835126 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:04.837748 (+ 2622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:04.839009 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:04.839138 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:04.839238 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:04.839602 (+ 364us) server_negotiation.cc:299] Negotiation successful
0808 11:32:04.839765 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11555,"thread_start_us":11930,"threads_started":1}
I20260808 11:32:04.840453 2248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.821507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58560 (local address 127.26.66.130:39409)
0808 11:32:04.832741 (+ 11234us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:04.832748 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:04.832769 (+ 21us) server_negotiation.cc:407] Connection header received
0808 11:32:04.832840 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:04.832847 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:04.832926 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:04.833036 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:04.833957 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:04.835246 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:04.837735 (+ 2489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:04.839009 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:04.839118 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:04.839234 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:04.839934 (+ 700us) server_negotiation.cc:299] Negotiation successful
0808 11:32:04.840107 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11105,"thread_start_us":11649,"threads_started":1}
I20260808 11:32:04.841415 2246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.821026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:39409 (local address 127.0.0.1:58560)
0808 11:32:04.822026 (+ 1000us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:04.822043 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:04.822147 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:04.833085 (+ 10938us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:04.833090 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:04.833117 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:04.833708 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:04.833732 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:04.835452 (+ 1720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:04.835458 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:04.837489 (+ 2031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:04.837507 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:04.839510 (+ 2003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:04.839517 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:04.839699 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:04.839735 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 11:32:04.840867 (+ 1132us) client_negotiation.cc:240] Negotiation successful
0808 11:32:04.841014 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":874,"mutex_wait_us":219,"thread_start_us":743,"threads_started":1}
I20260808 11:32:04.842070 1788 tablet_service.cc:1467] Processing CreateTablet for tablet f569bbf9fa3d460f91f029b2d4ad6dab (DEFAULT_TABLE table=test-table [id=ef94503c429542e7a2745a0ea5a336be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:32:04.842532 1788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f569bbf9fa3d460f91f029b2d4ad6dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:04.844645 1937 tablet_service.cc:1467] Processing CreateTablet for tablet f569bbf9fa3d460f91f029b2d4ad6dab (DEFAULT_TABLE table=test-table [id=ef94503c429542e7a2745a0ea5a336be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:32:04.845094 1937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f569bbf9fa3d460f91f029b2d4ad6dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:04.845342 2252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.844353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.26.66.131:52413)
0808 11:32:04.844920 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:04.845082 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":296,"threads_started":1}
I20260808 11:32:04.846149 2249 ts_tablet_manager.cc:1428] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260808 11:32:04.846382 2149 heartbeater.cc:503] Master 127.26.66.188:33241 was elected leader, sending a full tablet report...
I20260808 11:32:04.847390 2252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.847019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.26.66.131:58701)
0808 11:32:04.847163 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:04.847248 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 11:32:04.851362 2253 tablet_bootstrap.cc:492] T f569bbf9fa3d460f91f029b2d4ad6dab P 571ff9c747d54ad4b5082705b118489d: Bootstrap starting.
I20260808 11:32:04.851765 2255 tablet_bootstrap.cc:492] T f569bbf9fa3d460f91f029b2d4ad6dab P 1dadf97038de45fc80e51464a0555345: Bootstrap starting.
I20260808 11:32:04.852850 2253 tablet_bootstrap.cc:654] T f569bbf9fa3d460f91f029b2d4ad6dab P 571ff9c747d54ad4b5082705b118489d: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:04.853144 2255 tablet_bootstrap.cc:654] T f569bbf9fa3d460f91f029b2d4ad6dab P 1dadf97038de45fc80e51464a0555345: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:04.854786 2253 tablet_bootstrap.cc:492] T f569bbf9fa3d460f91f029b2d4ad6dab P 571ff9c747d54ad4b5082705b118489d: No bootstrap required, opened a new log
I20260808 11:32:04.854964 2253 ts_tablet_manager.cc:1397] T f569bbf9fa3d460f91f029b2d4ad6dab P 571ff9c747d54ad4b5082705b118489d: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260808 11:32:04.855018 2255 tablet_bootstrap.cc:492] T f569bbf9fa3d460f91f029b2d4ad6dab P 1dadf97038de45fc80e51464a0555345: No bootstrap required, opened a new log
I20260808 11:32:04.855191 2255 ts_tablet_manager.cc:1397] T f569bbf9fa3d460f91f029b2d4ad6dab P 1dadf97038de45fc80e51464a0555345: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260808 11:32:04.855655 2253 raft_consensus.cc:348] T f569bbf9fa3d460f91f029b2d4ad6dab P 571ff9c747d54ad4b5082705b118489d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43687 } } peers { permanent_uuid: "1dadf97038de45fc80e51464a0555345" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39409 } } peers { permanent_uuid: "571ff9c747d54ad4b5082705b118489d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37937 } }
I20260808 11:32:04.855856 2253 raft_consensus.cc:374] T f569bbf9fa3d460f91f029b2d4ad6dab P 571ff9c747d54ad4b5082705b118489d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:04.855772 2255 raft_consensus.cc:348] T f569bbf9fa3d460f91f029b2d4ad6dab P 1dadf97038de45fc80e51464a0555345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43687 } } peers { permanent_uuid: "1dadf97038de45fc80e51464a0555345" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39409 } } peers { permanent_uuid: "571ff9c747d54ad4b5082705b118489d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37937 } }
I20260808 11:32:04.855983 2253 raft_consensus.cc:729] T f569bbf9fa3d460f91f029b2d4ad6dab P 571ff9c747d54ad4b5082705b118489d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 571ff9c747d54ad4b5082705b118489d, State: Initialized, Role: FOLLOWER
I20260808 11:32:04.856042 2255 raft_consensus.cc:374] T f569bbf9fa3d460f91f029b2d4ad6dab P 1dadf97038de45fc80e51464a0555345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:04.856142 2255 raft_consensus.cc:729] T f569bbf9fa3d460f91f029b2d4ad6dab P 1dadf97038de45fc80e51464a0555345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dadf97038de45fc80e51464a0555345, State: Initialized, Role: FOLLOWER
I20260808 11:32:04.856228 2253 consensus_queue.cc:260] T f569bbf9fa3d460f91f029b2d4ad6dab P 571ff9c747d54ad4b5082705b118489d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43687 } } peers { permanent_uuid: "1dadf97038de45fc80e51464a0555345" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39409 } } peers { permanent_uuid: "571ff9c747d54ad4b5082705b118489d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37937 } }
I20260808 11:32:04.856405 2255 consensus_queue.cc:260] T f569bbf9fa3d460f91f029b2d4ad6dab P 1dadf97038de45fc80e51464a0555345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43687 } } peers { permanent_uuid: "1dadf97038de45fc80e51464a0555345" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39409 } } peers { permanent_uuid: "571ff9c747d54ad4b5082705b118489d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37937 } }
I20260808 11:32:04.857122 2253 ts_tablet_manager.cc:1428] T f569bbf9fa3d460f91f029b2d4ad6dab P 571ff9c747d54ad4b5082705b118489d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 11:32:04.858649 2255 ts_tablet_manager.cc:1428] T f569bbf9fa3d460f91f029b2d4ad6dab P 1dadf97038de45fc80e51464a0555345: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260808 11:32:04.859723 1853 heartbeater.cc:503] Master 127.26.66.188:33241 was elected leader, sending a full tablet report...
I20260808 11:32:04.860329 2261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.859302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.26.66.130:42779)
0808 11:32:04.859850 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:04.860059 (+ 209us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"threads_started":1}
I20260808 11:32:04.862643 2002 heartbeater.cc:503] Master 127.26.66.188:33241 was elected leader, sending a full tablet report...
I20260808 11:32:04.862767 2261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.862229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.26.66.130:36873)
0808 11:32:04.862450 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:04.862567 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260808 11:32:04.868614 2260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.857715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.26.66.129:37143)
0808 11:32:04.868200 (+ 10485us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:04.868329 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":10357,"thread_start_us":10237,"threads_started":1}
I20260808 11:32:04.869580 2260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.869283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.26.66.129:40761)
0808 11:32:04.869420 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:04.869487 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260808 11:32:04.995807 2251 raft_consensus.cc:482] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:32:04.996104 2251 raft_consensus.cc:504] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43687 } } peers { permanent_uuid: "1dadf97038de45fc80e51464a0555345" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39409 } } peers { permanent_uuid: "571ff9c747d54ad4b5082705b118489d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37937 } }
I20260808 11:32:04.997697 2251 leader_election.cc:288] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1dadf97038de45fc80e51464a0555345 (127.26.66.130:39409), 571ff9c747d54ad4b5082705b118489d (127.26.66.129:37937)
I20260808 11:32:05.004271 2248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.998016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:58187 (local address 127.26.66.130:39409)
0808 11:32:04.998244 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:04.998252 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:04.998375 (+ 123us) server_negotiation.cc:407] Connection header received
0808 11:32:04.998636 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:04.998641 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:04.998702 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:04.998797 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:04.999353 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:05.000350 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:05.002168 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:05.003227 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:05.003356 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:05.003442 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:05.003834 (+ 392us) server_negotiation.cc:299] Negotiation successful
0808 11:32:05.003997 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 11:32:05.004271 2252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.998024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:39409 (local address 127.26.66.131:58187)
0808 11:32:04.998230 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:04.998275 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:04.998453 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:04.998834 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:04.998842 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:04.998869 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:04.999202 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:04.999216 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:05.000489 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:05.000495 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:05.002007 (+ 1512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:05.002022 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:05.003408 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:05.003417 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:05.003601 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:05.003666 (+ 65us) client_negotiation.cc:769] Sending connection context
0808 11:32:05.003754 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 11:32:05.003942 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80,"mutex_wait_us":1}
I20260808 11:32:05.004331 2247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.998210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:58655 (local address 127.26.66.129:37937)
0808 11:32:04.998444 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:04.998450 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:04.999072 (+ 622us) server_negotiation.cc:407] Connection header received
0808 11:32:04.999206 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:04.999211 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:04.999315 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:04.999398 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:04.999965 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:05.000818 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:05.002538 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:05.003334 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:05.003495 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:05.003582 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:05.003936 (+ 354us) server_negotiation.cc:299] Negotiation successful
0808 11:32:05.004073 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 11:32:05.004837 2262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:04.998025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:37937 (local address 127.26.66.131:58655)
0808 11:32:04.998964 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:04.998980 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:04.999096 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:04.999443 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:04.999450 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:04.999475 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:04.999788 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:04.999800 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:05.000963 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:05.000966 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:05.002380 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:05.002396 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:05.003529 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:05.003534 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:05.003687 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:05.003752 (+ 65us) client_negotiation.cc:769] Sending connection context
0808 11:32:05.003866 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 11:32:05.004008 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":801,"mutex_wait_us":238,"thread_start_us":382,"threads_started":1}
I20260808 11:32:05.005095 1957 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f569bbf9fa3d460f91f029b2d4ad6dab" candidate_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dadf97038de45fc80e51464a0555345" is_pre_election: true
I20260808 11:32:05.005378 1957 raft_consensus.cc:2454] T f569bbf9fa3d460f91f029b2d4ad6dab P 1dadf97038de45fc80e51464a0555345 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4fddccd7004be7ae7b9d5ec506a12e in term 0.
I20260808 11:32:05.005774 1808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f569bbf9fa3d460f91f029b2d4ad6dab" candidate_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "571ff9c747d54ad4b5082705b118489d" is_pre_election: true
I20260808 11:32:05.005985 2034 leader_election.cc:302] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dadf97038de45fc80e51464a0555345, ed4fddccd7004be7ae7b9d5ec506a12e; no voters:
I20260808 11:32:05.006233 1808 raft_consensus.cc:2454] T f569bbf9fa3d460f91f029b2d4ad6dab P 571ff9c747d54ad4b5082705b118489d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4fddccd7004be7ae7b9d5ec506a12e in term 0.
I20260808 11:32:05.006474 2251 raft_consensus.cc:2781] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:32:05.006623 2251 raft_consensus.cc:482] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:32:05.006737 2251 raft_consensus.cc:3037] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:05.009070 2251 raft_consensus.cc:504] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43687 } } peers { permanent_uuid: "1dadf97038de45fc80e51464a0555345" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39409 } } peers { permanent_uuid: "571ff9c747d54ad4b5082705b118489d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37937 } }
I20260808 11:32:05.009701 2251 leader_election.cc:288] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e [CANDIDATE]: Term 1 election: Requested vote from peers 1dadf97038de45fc80e51464a0555345 (127.26.66.130:39409), 571ff9c747d54ad4b5082705b118489d (127.26.66.129:37937)
I20260808 11:32:05.010073 1957 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f569bbf9fa3d460f91f029b2d4ad6dab" candidate_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dadf97038de45fc80e51464a0555345"
I20260808 11:32:05.010087 1808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f569bbf9fa3d460f91f029b2d4ad6dab" candidate_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "571ff9c747d54ad4b5082705b118489d"
I20260808 11:32:05.010258 1808 raft_consensus.cc:3037] T f569bbf9fa3d460f91f029b2d4ad6dab P 571ff9c747d54ad4b5082705b118489d [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:05.010275 1957 raft_consensus.cc:3037] T f569bbf9fa3d460f91f029b2d4ad6dab P 1dadf97038de45fc80e51464a0555345 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:05.012748 1957 raft_consensus.cc:2454] T f569bbf9fa3d460f91f029b2d4ad6dab P 1dadf97038de45fc80e51464a0555345 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4fddccd7004be7ae7b9d5ec506a12e in term 1.
I20260808 11:32:05.012863 1808 raft_consensus.cc:2454] T f569bbf9fa3d460f91f029b2d4ad6dab P 571ff9c747d54ad4b5082705b118489d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4fddccd7004be7ae7b9d5ec506a12e in term 1.
I20260808 11:32:05.013260 2034 leader_election.cc:302] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dadf97038de45fc80e51464a0555345, ed4fddccd7004be7ae7b9d5ec506a12e; no voters:
I20260808 11:32:05.013549 2251 raft_consensus.cc:2781] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:32:05.014006 2251 raft_consensus.cc:686] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e [term 1 LEADER]: Becoming Leader. State: Replica: ed4fddccd7004be7ae7b9d5ec506a12e, State: Running, Role: LEADER
I20260808 11:32:05.014578 2251 consensus_queue.cc:237] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43687 } } peers { permanent_uuid: "1dadf97038de45fc80e51464a0555345" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39409 } } peers { permanent_uuid: "571ff9c747d54ad4b5082705b118489d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37937 } }
I20260808 11:32:05.014987 2262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:05.014562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.26.66.131:37073)
0808 11:32:05.014709 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:05.014835 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260808 11:32:05.018132 1669 catalog_manager.cc:5495] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e reported cstate change: term changed from 0 to 1, leader changed from <none> to ed4fddccd7004be7ae7b9d5ec506a12e (127.26.66.131). New cstate: current_term: 1 leader_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4fddccd7004be7ae7b9d5ec506a12e" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dadf97038de45fc80e51464a0555345" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "571ff9c747d54ad4b5082705b118489d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37937 } health_report { overall_health: UNKNOWN } } }
I20260808 11:32:05.066052 2245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:05.060711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59954 (local address 127.26.66.131:43687)
0808 11:32:05.060936 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:05.060944 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:05.060965 (+ 21us) server_negotiation.cc:407] Connection header received
0808 11:32:05.061217 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:05.061222 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:05.061312 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:05.061466 (+ 154us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:32:05.061834 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:05.062523 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:05.063829 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:05.064338 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:05.064478 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:05.064919 (+ 441us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:32:05.065442 (+ 523us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:32:05.065601 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:05.065702 (+ 101us) server_negotiation.cc:299] Negotiation successful
0808 11:32:05.065784 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 11:32:05.070196 1957 raft_consensus.cc:1261] T f569bbf9fa3d460f91f029b2d4ad6dab P 1dadf97038de45fc80e51464a0555345 [term 1 FOLLOWER]: Refusing update from remote peer ed4fddccd7004be7ae7b9d5ec506a12e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:32:05.070446 1808 raft_consensus.cc:1261] T f569bbf9fa3d460f91f029b2d4ad6dab P 571ff9c747d54ad4b5082705b118489d [term 1 FOLLOWER]: Refusing update from remote peer ed4fddccd7004be7ae7b9d5ec506a12e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:32:05.070945 2263 consensus_queue.cc:1035] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dadf97038de45fc80e51464a0555345" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 39409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:32:05.071285 2251 consensus_queue.cc:1035] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e [LEADER]: Connected to new peer: Peer: permanent_uuid: "571ff9c747d54ad4b5082705b118489d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:32:05.074198 2261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:05.073512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.26.66.130:59559)
0808 11:32:05.073774 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:05.073919 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260808 11:32:05.075383 2260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:05.074724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.26.66.129:40017)
0808 11:32:05.074974 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:05.075134 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260808 11:32:05.082525 2260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:05.082051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.26.66.129:52905)
0808 11:32:05.082284 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:05.082375 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134}
I20260808 11:32:05.084724 2262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:05.082569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.26.66.131:39131)
0808 11:32:05.084435 (+ 1866us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:05.084552 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1767}
I20260808 11:32:05.093405 1669 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48070:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:32:05.093672 1669 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48070:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:32:05.102420 1669 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6745c77285434df49b46cc45469e4791: Sending DeleteTablet for 3 replicas of tablet f569bbf9fa3d460f91f029b2d4ad6dab
I20260808 11:32:05.104130 2081 tablet_service.cc:1514] Processing DeleteTablet for tablet f569bbf9fa3d460f91f029b2d4ad6dab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:32:05 UTC) from {username='oryx', principal='oryx/127.26.66.188@KRBTEST.COM'} at 127.0.0.1:59942
I20260808 11:32:05.105376 1788 tablet_service.cc:1514] Processing DeleteTablet for tablet f569bbf9fa3d460f91f029b2d4ad6dab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:32:05 UTC) from {username='oryx', principal='oryx/127.26.66.188@KRBTEST.COM'} at 127.0.0.1:37962
I20260808 11:32:05.105867 1937 tablet_service.cc:1514] Processing DeleteTablet for tablet f569bbf9fa3d460f91f029b2d4ad6dab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:32:05 UTC) from {username='oryx', principal='oryx/127.26.66.188@KRBTEST.COM'} at 127.0.0.1:58560
I20260808 11:32:05.106950 2275 tablet_replica.cc:330] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e: stopping tablet replica
I20260808 11:32:05.107172 2275 raft_consensus.cc:2229] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e [term 1 LEADER]: Raft consensus shutting down.
I20260808 11:32:05.107734 2275 raft_consensus.cc:2258] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:32:05.108937 2275 ts_tablet_manager.cc:1905] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:32:05.109110 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 1647
I20260808 11:32:05.123566 2277 tablet_replica.cc:330] T f569bbf9fa3d460f91f029b2d4ad6dab P 1dadf97038de45fc80e51464a0555345: stopping tablet replica
I20260808 11:32:05.124150 2277 raft_consensus.cc:2229] T f569bbf9fa3d460f91f029b2d4ad6dab P 1dadf97038de45fc80e51464a0555345 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:32:05.124522 2276 tablet_replica.cc:330] T f569bbf9fa3d460f91f029b2d4ad6dab P 571ff9c747d54ad4b5082705b118489d: stopping tablet replica
I20260808 11:32:05.124593 2277 pending_rounds.cc:62] T f569bbf9fa3d460f91f029b2d4ad6dab P 1dadf97038de45fc80e51464a0555345: Trying to abort 2 pending ops.
I20260808 11:32:05.124718 2275 ts_tablet_manager.cc:1918] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:32:05.124878 2275 log.cc:1196] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-2/wal/wals/f569bbf9fa3d460f91f029b2d4ad6dab
I20260808 11:32:05.124891 2276 raft_consensus.cc:2229] T f569bbf9fa3d460f91f029b2d4ad6dab P 571ff9c747d54ad4b5082705b118489d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:32:05.124730 2277 pending_rounds.cc:68] T f569bbf9fa3d460f91f029b2d4ad6dab P 1dadf97038de45fc80e51464a0555345: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7316229017880805376 op_type: WRITE_OP write_request { tablet_id: "f569bbf9fa3d460f91f029b2d4ad6dab" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "val" type: INT32 is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\003\00090\000\0001\324\000\000" indirect_data: "<redacted>""" } external_consistency_mode: CLIENT_PROPAGATED authz_token { token_data: "\010\341\251\334\323\006\"8\n\ntest-admin\022*\n ef94503c429542e7a2745a0ea5a336be\020\001\030\001 \001(\001" signature: "<redacted>""\307\2658\270?\373^H\332\232\"\216r\363\303$o\201J\332\251\207\027:\272HO\001\343\027\355\030*\245\270-\023.\t\376\372y\n)\031\204\347,\026\031\207\032Q\237\"+\342o\254\374\264h1\252" signing_key_seq_num: 0 } } request_id { client_id: "f2403e3092b947a0b784d685c39fffd1" seq_no: 0 first_incomplete_seq_no: 0 attempt_no: 0 }
I20260808 11:32:05.125432 2275 ts_tablet_manager.cc:1939] T f569bbf9fa3d460f91f029b2d4ad6dab P ed4fddccd7004be7ae7b9d5ec506a12e: Deleting consensus metadata
I20260808 11:32:05.125710 2276 raft_consensus.cc:2258] T f569bbf9fa3d460f91f029b2d4ad6dab P 571ff9c747d54ad4b5082705b118489d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:32:05.125730 2277 pending_rounds.cc:68] T f569bbf9fa3d460f91f029b2d4ad6dab P 1dadf97038de45fc80e51464a0555345: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316229017663533056 op_type: NO_OP noop_request { }
I20260808 11:32:05.125869 2277 raft_consensus.cc:2866] T f569bbf9fa3d460f91f029b2d4ad6dab P 1dadf97038de45fc80e51464a0555345 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260808 11:32:05.126035 2277 raft_consensus.cc:2258] T f569bbf9fa3d460f91f029b2d4ad6dab P 1dadf97038de45fc80e51464a0555345 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:32:05.126988 1656 catalog_manager.cc:4841] TS ed4fddccd7004be7ae7b9d5ec506a12e (127.26.66.131:43687): tablet f569bbf9fa3d460f91f029b2d4ad6dab (table test-table [id=ef94503c429542e7a2745a0ea5a336be]) successfully deleted
I20260808 11:32:05.127539 2277 ts_tablet_manager.cc:1905] T f569bbf9fa3d460f91f029b2d4ad6dab P 1dadf97038de45fc80e51464a0555345: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:32:05.129468 2276 ts_tablet_manager.cc:1905] T f569bbf9fa3d460f91f029b2d4ad6dab P 571ff9c747d54ad4b5082705b118489d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:32:05.134207 2277 ts_tablet_manager.cc:1918] T f569bbf9fa3d460f91f029b2d4ad6dab P 1dadf97038de45fc80e51464a0555345: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:32:05.134356 2277 log.cc:1196] T f569bbf9fa3d460f91f029b2d4ad6dab P 1dadf97038de45fc80e51464a0555345: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-1/wal/wals/f569bbf9fa3d460f91f029b2d4ad6dab
I20260808 11:32:05.134871 2277 ts_tablet_manager.cc:1939] T f569bbf9fa3d460f91f029b2d4ad6dab P 1dadf97038de45fc80e51464a0555345: Deleting consensus metadata
I20260808 11:32:05.135226 2276 ts_tablet_manager.cc:1918] T f569bbf9fa3d460f91f029b2d4ad6dab P 571ff9c747d54ad4b5082705b118489d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:32:05.135370 2276 log.cc:1196] T f569bbf9fa3d460f91f029b2d4ad6dab P 571ff9c747d54ad4b5082705b118489d: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786188664137852-26890-0/minicluster-data/ts-0/wal/wals/f569bbf9fa3d460f91f029b2d4ad6dab
I20260808 11:32:05.135936 2276 ts_tablet_manager.cc:1939] T f569bbf9fa3d460f91f029b2d4ad6dab P 571ff9c747d54ad4b5082705b118489d: Deleting consensus metadata
I20260808 11:32:05.136143 1655 catalog_manager.cc:4841] TS 1dadf97038de45fc80e51464a0555345 (127.26.66.130:39409): tablet f569bbf9fa3d460f91f029b2d4ad6dab (table test-table [id=ef94503c429542e7a2745a0ea5a336be]) successfully deleted
I20260808 11:32:05.137112 1654 catalog_manager.cc:4841] TS 571ff9c747d54ad4b5082705b118489d (127.26.66.129:37937): tablet f569bbf9fa3d460f91f029b2d4ad6dab (table test-table [id=ef94503c429542e7a2745a0ea5a336be]) successfully deleted
I20260808 11:32:05.142455 2247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:05.110207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37972 (local address 127.26.66.129:37937)
0808 11:32:05.110405 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:05.110411 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:05.117044 (+ 6633us) server_negotiation.cc:407] Connection header received
0808 11:32:05.117243 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:05.117249 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:05.117346 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:05.117441 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:05.126152 (+ 8711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:05.127299 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:05.128888 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:05.129508 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:05.129631 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:05.135726 (+ 6095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:05.135748 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:05.135769 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:05.135815 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:05.139395 (+ 3580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:05.140201 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:05.140212 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:05.140220 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:05.140406 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:05.140812 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:05.140817 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:05.140821 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:05.141248 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:05.141555 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:05.141883 (+ 328us) server_negotiation.cc:299] Negotiation successful
0808 11:32:05.142101 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 11:32:05.143136 1848 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:05.301004 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 1647
I20260808 11:32:05.304826 2246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:05.304243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.0.0.1:58544)
0808 11:32:05.304521 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:05.304637 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153}
I20260808 11:32:05.306140 2246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:05.305672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42549 (local address 127.0.0.1:58548)
0808 11:32:05.305865 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:05.305986 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:42549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 11:32:05.331353 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 1866
I20260808 11:32:05.347523 2248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:05.332230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58572 (local address 127.26.66.130:39409)
0808 11:32:05.332473 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:05.332480 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:05.332503 (+ 23us) server_negotiation.cc:407] Connection header received
0808 11:32:05.332627 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:05.332635 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:05.332735 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:05.332853 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:05.334156 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:05.335342 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:05.336766 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:05.337362 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:05.337478 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:05.340379 (+ 2901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:05.340398 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:05.340417 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:05.340464 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:05.344538 (+ 4074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:05.345201 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:05.345212 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:05.345215 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:05.345387 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:05.345752 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:05.345757 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:05.345759 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:05.346243 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:05.346553 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:05.346879 (+ 326us) server_negotiation.cc:299] Negotiation successful
0808 11:32:05.347112 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260808 11:32:05.348292 1997 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:05.443663 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 1866
I20260808 11:32:05.468837 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 2017
I20260808 11:32:05.483405 2245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:05.469682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59962 (local address 127.26.66.131:43687)
0808 11:32:05.469887 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:05.469894 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:05.469914 (+ 20us) server_negotiation.cc:407] Connection header received
0808 11:32:05.470130 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:05.470136 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:05.470237 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:05.470344 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:05.471692 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:05.472529 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:05.473821 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:05.474292 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:05.474482 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:05.477140 (+ 2658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:05.477158 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:05.477174 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:05.477206 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:05.480459 (+ 3253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:05.481193 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:05.481204 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:05.481212 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:05.481381 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:05.481767 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:05.481772 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:05.481775 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:05.482141 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:05.482519 (+ 378us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:05.482794 (+ 275us) server_negotiation.cc:299] Negotiation successful
0808 11:32:05.483058 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 11:32:05.484216 2144 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:05.616612 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 2017
I20260808 11:32:05.641820 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 1325
I20260808 11:32:05.642925 1499 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:05.762951 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 1325
I20260808 11:32:05.790053 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 1431
I20260808 11:32:05.791133 1700 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:05.915757 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 1431
2026-08-08T11:32:05Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (10292 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:32:06 dist-test-slave-zkpd krb5kdc[2287](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:32:06 dist-test-slave-zkpd krb5kdc[2287](info): set up 2 sockets
Aug 08 11:32:06 dist-test-slave-zkpd krb5kdc[2287](info): commencing operation
krb5kdc: starting...
W20260808 11:32:07.066044 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.099s user 0.000s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:32:07 dist-test-slave-zkpd krb5kdc[2287](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:32:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:32:07Z Disabled control of system clock
WARNING: no policy specified for oryx/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.190.keytab.
Entry for principal oryx/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.190.keytab.
I20260808 11:32:07.330938 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:45993
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.190.keytab
--principal=oryx/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:44379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:45993
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:32:07.670903 2300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:07.671204 2300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:07.671401 2300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:07.678771 2300 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:32:07.678920 2300 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 11:32:07.678995 2300 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:07.679105 2300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:07.679194 2300 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:32:07.679308 2300 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:32:07.689499 2300 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:44379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:45993
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.190.keytab
--principal=oryx/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:45993
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:07.690841 2300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:07.692268 2300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:07.704356 2305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:07.704396 2308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:07.704437 2306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:07.705420 2300 server_base.cc:1034] running on GCE node
I20260808 11:32:07.706190 2300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:07.707633 2300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:07.708876 2300 hybrid_clock.cc:648] HybridClock initialized: now 1786188727708789 us; error 57 us; skew 500 ppm
I20260808 11:32:07.709179 2300 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:32:07 dist-test-slave-zkpd krb5kdc[2287](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188727, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:32:07.712584 2300 init.cc:377] Logged in from keytab as oryx/127.26.66.190@KRBTEST.COM (short username oryx)
I20260808 11:32:07.714072 2300 webserver.cc:460] Webserver started at http://127.26.66.190:41925/ using document root <none> and password file <none>
I20260808 11:32:07.714898 2300 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:07.715036 2300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:07.715384 2300 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:32:07.718459 2300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "a94fe8a075bd4a5fbd1b7873ef76bbde"
format_stamp: "Formatted at 2026-08-08 11:32:07 on dist-test-slave-zkpd"
server_key: "f51db03fc4a7c4e534056f938aa08884"
server_key_iv: "c85eb6ee8c9c8c10fab7f01872eea409"
server_key_version: "encryptionkey@0"
I20260808 11:32:07.719262 2300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "a94fe8a075bd4a5fbd1b7873ef76bbde"
format_stamp: "Formatted at 2026-08-08 11:32:07 on dist-test-slave-zkpd"
server_key: "f51db03fc4a7c4e534056f938aa08884"
server_key_iv: "c85eb6ee8c9c8c10fab7f01872eea409"
server_key_version: "encryptionkey@0"
I20260808 11:32:07.724550 2300 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.006s
I20260808 11:32:07.727865 2315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:07.729212 2300 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:32:07.729401 2300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "a94fe8a075bd4a5fbd1b7873ef76bbde"
format_stamp: "Formatted at 2026-08-08 11:32:07 on dist-test-slave-zkpd"
server_key: "f51db03fc4a7c4e534056f938aa08884"
server_key_iv: "c85eb6ee8c9c8c10fab7f01872eea409"
server_key_version: "encryptionkey@0"
I20260808 11:32:07.729619 2300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:07.746214 2300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:07.750224 2300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:07.750506 2300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:07.771872 2300 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:45993
I20260808 11:32:07.771879 2376 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:45993 every 8 connection(s)
I20260808 11:32:07.773248 2300 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:32:07.777542 2377 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:07.781847 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 2300
I20260808 11:32:07.782130 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:32:07.783064 26890 external_mini_cluster.cc:1428] Setting key df379a15ee8deecf1e2f45b9a08aa2ae
I20260808 11:32:07.792459 2377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a94fe8a075bd4a5fbd1b7873ef76bbde: Bootstrap starting.
I20260808 11:32:07.796623 2377 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a94fe8a075bd4a5fbd1b7873ef76bbde: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:07.798094 2377 log.cc:824] T 00000000000000000000000000000000 P a94fe8a075bd4a5fbd1b7873ef76bbde: Log is configured to *not* fsync() on all Append() calls
Aug 08 11:32:07 dist-test-slave-zkpd krb5kdc[2287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM
I20260808 11:32:07.801141 2377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a94fe8a075bd4a5fbd1b7873ef76bbde: No bootstrap required, opened a new log
I20260808 11:32:07.806922 2380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:07.785400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45610 (local address 127.26.66.190:45993)
0808 11:32:07.786264 (+ 864us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:07.786276 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:07.786322 (+ 46us) server_negotiation.cc:407] Connection header received
0808 11:32:07.788107 (+ 1785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:07.788133 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:07.788551 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:07.788906 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:07.790779 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:07.792131 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:07.793884 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:07.794547 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:07.794687 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:07.799552 (+ 4865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:07.799560 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:07.799574 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:07.799609 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:07.802745 (+ 3136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:07.803455 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:07.803461 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:07.803467 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:07.803664 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:07.804126 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:07.804138 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:07.804141 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:07.804692 (+ 551us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:07.805004 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:07.805506 (+ 502us) server_negotiation.cc:299] Negotiation successful
0808 11:32:07.805913 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":435,"threads_started":1}
I20260808 11:32:07.809419 2377 raft_consensus.cc:348] T 00000000000000000000000000000000 P a94fe8a075bd4a5fbd1b7873ef76bbde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a94fe8a075bd4a5fbd1b7873ef76bbde" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45993 } }
I20260808 11:32:07.809890 2377 raft_consensus.cc:374] T 00000000000000000000000000000000 P a94fe8a075bd4a5fbd1b7873ef76bbde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:07.810004 2377 raft_consensus.cc:729] T 00000000000000000000000000000000 P a94fe8a075bd4a5fbd1b7873ef76bbde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a94fe8a075bd4a5fbd1b7873ef76bbde, State: Initialized, Role: FOLLOWER
I20260808 11:32:07.810516 2377 consensus_queue.cc:260] T 00000000000000000000000000000000 P a94fe8a075bd4a5fbd1b7873ef76bbde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a94fe8a075bd4a5fbd1b7873ef76bbde" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45993 } }
I20260808 11:32:07.810719 2377 raft_consensus.cc:388] T 00000000000000000000000000000000 P a94fe8a075bd4a5fbd1b7873ef76bbde [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:32:07.810820 2377 raft_consensus.cc:482] T 00000000000000000000000000000000 P a94fe8a075bd4a5fbd1b7873ef76bbde [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:32:07.810949 2377 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a94fe8a075bd4a5fbd1b7873ef76bbde [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:07.813242 2377 raft_consensus.cc:504] T 00000000000000000000000000000000 P a94fe8a075bd4a5fbd1b7873ef76bbde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a94fe8a075bd4a5fbd1b7873ef76bbde" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45993 } }
I20260808 11:32:07.813809 2377 leader_election.cc:302] T 00000000000000000000000000000000 P a94fe8a075bd4a5fbd1b7873ef76bbde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a94fe8a075bd4a5fbd1b7873ef76bbde; no voters:
I20260808 11:32:07.814477 2377 leader_election.cc:288] T 00000000000000000000000000000000 P a94fe8a075bd4a5fbd1b7873ef76bbde [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:32:07.814574 2382 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a94fe8a075bd4a5fbd1b7873ef76bbde [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:32:07.815300 2382 raft_consensus.cc:686] T 00000000000000000000000000000000 P a94fe8a075bd4a5fbd1b7873ef76bbde [term 1 LEADER]: Becoming Leader. State: Replica: a94fe8a075bd4a5fbd1b7873ef76bbde, State: Running, Role: LEADER
I20260808 11:32:07.815858 2382 consensus_queue.cc:237] T 00000000000000000000000000000000 P a94fe8a075bd4a5fbd1b7873ef76bbde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a94fe8a075bd4a5fbd1b7873ef76bbde" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45993 } }
I20260808 11:32:07.816614 2377 sys_catalog.cc:564] T 00000000000000000000000000000000 P a94fe8a075bd4a5fbd1b7873ef76bbde [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:32:07.818544 2384 sys_catalog.cc:455] T 00000000000000000000000000000000 P a94fe8a075bd4a5fbd1b7873ef76bbde [sys.catalog]: SysCatalogTable state changed. Reason: New leader a94fe8a075bd4a5fbd1b7873ef76bbde. Latest consensus state: current_term: 1 leader_uuid: "a94fe8a075bd4a5fbd1b7873ef76bbde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a94fe8a075bd4a5fbd1b7873ef76bbde" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45993 } } }
I20260808 11:32:07.818933 2384 sys_catalog.cc:458] T 00000000000000000000000000000000 P a94fe8a075bd4a5fbd1b7873ef76bbde [sys.catalog]: This master's current role is: LEADER
I20260808 11:32:07.819257 2383 sys_catalog.cc:455] T 00000000000000000000000000000000 P a94fe8a075bd4a5fbd1b7873ef76bbde [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a94fe8a075bd4a5fbd1b7873ef76bbde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a94fe8a075bd4a5fbd1b7873ef76bbde" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45993 } } }
I20260808 11:32:07.819766 2383 sys_catalog.cc:458] T 00000000000000000000000000000000 P a94fe8a075bd4a5fbd1b7873ef76bbde [sys.catalog]: This master's current role is: LEADER
I20260808 11:32:07.821992 2387 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:32:07.828130 2387 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:32:07.837090 2387 catalog_manager.cc:1347] Generated new cluster ID: 41dca014ba8f459c8324a17a791b9d96
I20260808 11:32:07.837204 2387 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:32:07.849282 2387 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:32:07.851197 2387 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:32:07.864178 2387 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a94fe8a075bd4a5fbd1b7873ef76bbde: Generated new TSK 0
I20260808 11:32:07.865269 2387 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.26.66.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.66.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.66.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.129.keytab.
Entry for principal oryx/127.26.66.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.129.keytab.
I20260808 11:32:07.937652 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:0
--local_ip_for_outbound_sockets=127.26.66.129
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45993
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.129.keytab
--principal=oryx/127.26.66.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:44379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:32:08.289129 2406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:08.289392 2406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:08.289549 2406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:08.296634 2406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:08.296729 2406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:08.296906 2406 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 11:32:08.297040 2406 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:32:08.306766 2406 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:44379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.129.keytab
--principal=oryx/127.26.66.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.66.190:45993
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:08.308068 2406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:08.309412 2406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:08.322563 2414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:08.322893 2412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:08.322567 2411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:08.323838 2406 server_base.cc:1034] running on GCE node
I20260808 11:32:08.324576 2406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:08.325570 2406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:08.326848 2406 hybrid_clock.cc:648] HybridClock initialized: now 1786188728326749 us; error 52 us; skew 500 ppm
I20260808 11:32:08.327175 2406 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:32:08 dist-test-slave-zkpd krb5kdc[2287](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188728, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:32:08.331144 2406 init.cc:377] Logged in from keytab as oryx/127.26.66.129@KRBTEST.COM (short username oryx)
I20260808 11:32:08.332858 2406 webserver.cc:460] Webserver started at http://127.26.66.129:33471/ using document root <none> and password file <none>
I20260808 11:32:08.333707 2406 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:08.333858 2406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:08.334209 2406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:32:08.337476 2406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-0/data/instance:
uuid: "274e34ae5fe14afc937e847ef7fe5cae"
format_stamp: "Formatted at 2026-08-08 11:32:08 on dist-test-slave-zkpd"
server_key: "e5905eb1003b6e01dae55fb931afa703"
server_key_iv: "c2a2382edd9f2fc5f442d9d37172123e"
server_key_version: "encryptionkey@0"
I20260808 11:32:08.338313 2406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance:
uuid: "274e34ae5fe14afc937e847ef7fe5cae"
format_stamp: "Formatted at 2026-08-08 11:32:08 on dist-test-slave-zkpd"
server_key: "e5905eb1003b6e01dae55fb931afa703"
server_key_iv: "c2a2382edd9f2fc5f442d9d37172123e"
server_key_version: "encryptionkey@0"
I20260808 11:32:08.343564 2406 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 11:32:08.347045 2421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:08.348453 2406 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260808 11:32:08.348644 2406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "274e34ae5fe14afc937e847ef7fe5cae"
format_stamp: "Formatted at 2026-08-08 11:32:08 on dist-test-slave-zkpd"
server_key: "e5905eb1003b6e01dae55fb931afa703"
server_key_iv: "c2a2382edd9f2fc5f442d9d37172123e"
server_key_version: "encryptionkey@0"
I20260808 11:32:08.348877 2406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:08.368117 2406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:08.372390 2406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:08.372670 2406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:08.375361 2406 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:32:08.375488 2406 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:08.375622 2406 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:32:08.375726 2406 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 11:32:08 dist-test-slave-zkpd krb5kdc[2287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188728, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM
I20260808 11:32:08.398416 2429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:08.375722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:58141 (local address 127.26.66.190:45993)
0808 11:32:08.376245 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:08.376251 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:08.377468 (+ 1217us) server_negotiation.cc:407] Connection header received
0808 11:32:08.379537 (+ 2069us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:08.379544 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:08.379635 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:08.379756 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:08.381975 (+ 2219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:08.383031 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:08.385754 (+ 2723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:08.386345 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:08.386502 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:08.390551 (+ 4049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:08.390561 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:08.390568 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:08.390625 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:08.394651 (+ 4026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:08.395791 (+ 1140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:08.395798 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:08.395805 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:08.396017 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:08.396599 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:08.396607 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:08.396612 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:08.396964 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:08.397127 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:08.397810 (+ 683us) server_negotiation.cc:299] Negotiation successful
0808 11:32:08.398029 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":240,"threads_started":1}
I20260808 11:32:08.399370 2431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:08.376354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45993 (local address 127.26.66.129:58141)
0808 11:32:08.377285 (+ 931us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:08.377339 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:08.379250 (+ 1911us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:08.380048 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:08.380065 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:08.380831 (+ 766us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:08.381755 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:08.381787 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:08.383222 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:08.383230 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:08.385581 (+ 2351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:08.385597 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:08.386619 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:08.386627 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:08.386954 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:08.387733 (+ 779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:08.387754 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:08.390262 (+ 2508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:08.394855 (+ 4593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:08.394873 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:08.394892 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:08.395639 (+ 747us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:08.396171 (+ 532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:08.396175 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:08.396177 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:08.396395 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:08.397103 (+ 708us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:08.397111 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:08.397442 (+ 331us) client_negotiation.cc:769] Sending connection context
0808 11:32:08.397696 (+ 254us) client_negotiation.cc:240] Negotiation successful
0808 11:32:08.398194 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"thread_start_us":409,"threads_started":1}
I20260808 11:32:08.421770 2429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:08.405868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:35171 (local address 127.26.66.190:45993)
0808 11:32:08.406084 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:08.406093 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:08.406652 (+ 559us) server_negotiation.cc:407] Connection header received
0808 11:32:08.406791 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:08.406799 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:08.406895 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:08.407018 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:08.407865 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:08.409115 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:08.411098 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:08.411711 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:08.411858 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:08.414591 (+ 2733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:08.414601 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:08.414609 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:08.414658 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:08.418308 (+ 3650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:08.418982 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:08.418987 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:08.418990 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:08.419145 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:08.419662 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:08.419666 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:08.419668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:08.420115 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:08.420262 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:08.421135 (+ 873us) server_negotiation.cc:299] Negotiation successful
0808 11:32:08.421384 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 11:32:08.421890 2491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:08.405891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45993 (local address 127.26.66.129:35171)
0808 11:32:08.406558 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:08.406578 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:08.406677 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:08.407032 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:08.407035 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:08.407435 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:08.407702 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:08.407710 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:08.409298 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:08.409309 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:08.410902 (+ 1593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:08.410915 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:08.412089 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:08.412099 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:08.412402 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:08.413184 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:08.413204 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:08.414378 (+ 1174us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:08.418446 (+ 4068us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:08.418449 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:08.418452 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:08.418858 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:08.419301 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:08.419308 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:08.419328 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:08.419510 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:08.420321 (+ 811us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:08.420325 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:08.420568 (+ 243us) client_negotiation.cc:769] Sending connection context
0808 11:32:08.420761 (+ 193us) client_negotiation.cc:240] Negotiation successful
0808 11:32:08.421127 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":372,"threads_started":1}
I20260808 11:32:08.430460 2406 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:40035
I20260808 11:32:08.430492 2544 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:40035 every 8 connection(s)
I20260808 11:32:08.431655 2406 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:32:08.433883 2545 heartbeater.cc:347] Connected to a master server at 127.26.66.190:45993
I20260808 11:32:08.434132 2545 heartbeater.cc:464] Registering TS with master...
I20260808 11:32:08.434803 2545 heartbeater.cc:511] Master 127.26.66.190:45993 requested a full tablet report, sending...
I20260808 11:32:08.436828 2332 ts_manager.cc:194] Registered new tserver with Master: 274e34ae5fe14afc937e847ef7fe5cae (127.26.66.129:40035)
I20260808 11:32:08.438277 2332 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.66.129@KRBTEST.COM'} at 127.26.66.129:58141
I20260808 11:32:08.438679 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 2406
I20260808 11:32:08.438894 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance
I20260808 11:32:08.439699 26890 external_mini_cluster.cc:1428] Setting key cfba749b2a11442bf0cf75931b858d29
WARNING: no policy specified for oryx/127.26.66.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.66.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.66.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.130.keytab.
Entry for principal oryx/127.26.66.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.130.keytab.
I20260808 11:32:08.497112 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:0
--local_ip_for_outbound_sockets=127.26.66.130
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45993
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.130.keytab
--principal=oryx/127.26.66.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:44379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:32:08.831172 2549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:08.831490 2549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:08.831661 2549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:08.838955 2549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:08.839103 2549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:08.839243 2549 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 11:32:08.839380 2549 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:32:08.849589 2549 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:44379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.130.keytab
--principal=oryx/127.26.66.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.66.190:45993
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:08.850894 2549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:08.852378 2549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:08.865545 2555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:08.865521 2557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:08.865614 2554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:08.866381 2549 server_base.cc:1034] running on GCE node
I20260808 11:32:08.866958 2549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:08.868021 2549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:08.869249 2549 hybrid_clock.cc:648] HybridClock initialized: now 1786188728869180 us; error 46 us; skew 500 ppm
I20260808 11:32:08.869554 2549 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:32:08 dist-test-slave-zkpd krb5kdc[2287](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188728, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:32:08.872961 2549 init.cc:377] Logged in from keytab as oryx/127.26.66.130@KRBTEST.COM (short username oryx)
I20260808 11:32:08.874603 2549 webserver.cc:460] Webserver started at http://127.26.66.130:46729/ using document root <none> and password file <none>
I20260808 11:32:08.875321 2549 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:08.875448 2549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:08.875801 2549 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:32:08.878723 2549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-1/data/instance:
uuid: "43188733c8a34924b9dbe1d8990d8080"
format_stamp: "Formatted at 2026-08-08 11:32:08 on dist-test-slave-zkpd"
server_key: "a8db1db3c89e72db5fcb2151a8b22ede"
server_key_iv: "869e71c8295a32ecaf0dd4d4496b0fe8"
server_key_version: "encryptionkey@0"
I20260808 11:32:08.879554 2549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance:
uuid: "43188733c8a34924b9dbe1d8990d8080"
format_stamp: "Formatted at 2026-08-08 11:32:08 on dist-test-slave-zkpd"
server_key: "a8db1db3c89e72db5fcb2151a8b22ede"
server_key_iv: "869e71c8295a32ecaf0dd4d4496b0fe8"
server_key_version: "encryptionkey@0"
I20260808 11:32:08.884624 2549 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260808 11:32:08.888132 2564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:08.889355 2549 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 11:32:08.889528 2549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "43188733c8a34924b9dbe1d8990d8080"
format_stamp: "Formatted at 2026-08-08 11:32:08 on dist-test-slave-zkpd"
server_key: "a8db1db3c89e72db5fcb2151a8b22ede"
server_key_iv: "869e71c8295a32ecaf0dd4d4496b0fe8"
server_key_version: "encryptionkey@0"
I20260808 11:32:08.889757 2549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:08.919606 2549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:08.923972 2549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:08.924244 2549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:08.926762 2549 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:32:08.926895 2549 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:08.927030 2549 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:32:08.927093 2549 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 11:32:08 dist-test-slave-zkpd krb5kdc[2287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188728, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM
I20260808 11:32:08.952828 2574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:08.927536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:41073 (local address 127.26.66.190:45993)
0808 11:32:08.930107 (+ 2571us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:08.930116 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:08.930141 (+ 25us) server_negotiation.cc:407] Connection header received
0808 11:32:08.931856 (+ 1715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:08.931861 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:08.931978 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:08.932137 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:08.934775 (+ 2638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:08.936036 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:08.939100 (+ 3064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:08.939652 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:08.939795 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:08.944851 (+ 5056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:08.944861 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:08.944869 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:08.944926 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:08.949046 (+ 4120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:08.950023 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:08.950030 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:08.950036 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:08.950220 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:08.950667 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:08.950676 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:08.950682 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:08.951120 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:08.951332 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:08.951985 (+ 653us) server_negotiation.cc:299] Negotiation successful
0808 11:32:08.952308 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2438,"thread_start_us":2314,"threads_started":1}
I20260808 11:32:08.953483 2575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:08.928224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45993 (local address 127.26.66.130:41073)
0808 11:32:08.929414 (+ 1190us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:08.929478 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:08.931523 (+ 2045us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:08.932506 (+ 983us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:08.932517 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:08.933458 (+ 941us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:08.934520 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:08.934558 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:08.936259 (+ 1701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:08.936268 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:08.938936 (+ 2668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:08.938954 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:08.940003 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:08.940021 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:08.940384 (+ 363us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:08.941238 (+ 854us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:08.941282 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:08.944586 (+ 3304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:08.949231 (+ 4645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:08.949243 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:08.949260 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:08.949882 (+ 622us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:08.950365 (+ 483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:08.950368 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:08.950370 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:08.950553 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:08.951282 (+ 729us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:08.951287 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:08.951593 (+ 306us) client_negotiation.cc:769] Sending connection context
0808 11:32:08.951808 (+ 215us) client_negotiation.cc:240] Negotiation successful
0808 11:32:08.952291 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":773,"thread_start_us":478,"threads_started":1}
I20260808 11:32:08.975330 2574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:08.959363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:44083 (local address 127.26.66.190:45993)
0808 11:32:08.959606 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:08.959615 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:08.960173 (+ 558us) server_negotiation.cc:407] Connection header received
0808 11:32:08.960475 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:08.960481 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:08.960569 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:08.960672 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:08.962291 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:08.963278 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:08.965549 (+ 2271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:08.966178 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:08.966320 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:08.969100 (+ 2780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:08.969108 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:08.969115 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:08.969159 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:08.972641 (+ 3482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:08.973309 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:08.973322 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:08.973325 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:08.973452 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:08.973868 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:08.973873 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:08.973876 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:08.974185 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:08.974377 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:08.974760 (+ 383us) server_negotiation.cc:299] Negotiation successful
0808 11:32:08.974983 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 11:32:08.975428 2628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:08.959275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45993 (local address 127.26.66.130:44083)
0808 11:32:08.960043 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:08.960069 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:08.960241 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:08.960830 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:08.960833 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:08.961554 (+ 721us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:08.962123 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:08.962144 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:08.963478 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:08.963482 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:08.965324 (+ 1842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:08.965343 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:08.966618 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:08.966632 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:08.966931 (+ 299us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:08.967661 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:08.967691 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:08.968801 (+ 1110us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:08.972774 (+ 3973us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:08.972778 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:08.972781 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:08.973174 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:08.973578 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:08.973587 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:08.973589 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:08.973732 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:08.974315 (+ 583us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:08.974320 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:08.974509 (+ 189us) client_negotiation.cc:769] Sending connection context
0808 11:32:08.974650 (+ 141us) client_negotiation.cc:240] Negotiation successful
0808 11:32:08.974983 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":371,"threads_started":1}
I20260808 11:32:08.985634 2549 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:41641
I20260808 11:32:08.985674 2687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:41641 every 8 connection(s)
I20260808 11:32:08.987239 2549 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:32:08.992201 2688 heartbeater.cc:347] Connected to a master server at 127.26.66.190:45993
I20260808 11:32:08.992513 2688 heartbeater.cc:464] Registering TS with master...
I20260808 11:32:08.992715 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 2549
I20260808 11:32:08.992921 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance
I20260808 11:32:08.993434 2688 heartbeater.cc:511] Master 127.26.66.190:45993 requested a full tablet report, sending...
I20260808 11:32:08.993526 26890 external_mini_cluster.cc:1428] Setting key 82f13799e2b458f175e10b7b829804f4
I20260808 11:32:08.995183 2331 ts_manager.cc:194] Registered new tserver with Master: 43188733c8a34924b9dbe1d8990d8080 (127.26.66.130:41641)
I20260808 11:32:08.996480 2331 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.66.130@KRBTEST.COM'} at 127.26.66.130:41073
WARNING: no policy specified for oryx/127.26.66.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.66.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.66.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.131.keytab.
Entry for principal oryx/127.26.66.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.131.keytab.
I20260808 11:32:09.054471 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:0
--local_ip_for_outbound_sockets=127.26.66.131
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45993
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.131.keytab
--principal=oryx/127.26.66.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:44379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:32:09.393108 2692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:09.393380 2692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:09.393545 2692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:09.400707 2692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:09.400813 2692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:09.400976 2692 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 11:32:09.401103 2692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:32:09.410717 2692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:44379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.131.keytab
--principal=oryx/127.26.66.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.66.190:45993
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:09.411967 2692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:09.413316 2692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:09.426635 2697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:09.426674 2700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:09.426694 2698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:09.428037 2692 server_base.cc:1034] running on GCE node
I20260808 11:32:09.428620 2692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:09.429467 2692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:09.430758 2692 hybrid_clock.cc:648] HybridClock initialized: now 1786188729430683 us; error 47 us; skew 500 ppm
I20260808 11:32:09.431119 2692 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:32:09 dist-test-slave-zkpd krb5kdc[2287](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188729, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:32:09.435124 2692 init.cc:377] Logged in from keytab as oryx/127.26.66.131@KRBTEST.COM (short username oryx)
I20260808 11:32:09.436829 2692 webserver.cc:460] Webserver started at http://127.26.66.131:41751/ using document root <none> and password file <none>
I20260808 11:32:09.437472 2692 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:09.437558 2692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:09.437867 2692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:32:09.440806 2692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-2/data/instance:
uuid: "5324adacda33452397600f7da92ec963"
format_stamp: "Formatted at 2026-08-08 11:32:09 on dist-test-slave-zkpd"
server_key: "8ea9857f14c27a187c5de80ca5026d8a"
server_key_iv: "6f64941454eb6e8c5932e8932ed9e474"
server_key_version: "encryptionkey@0"
I20260808 11:32:09.441378 2545 heartbeater.cc:503] Master 127.26.66.190:45993 was elected leader, sending a full tablet report...
I20260808 11:32:09.441926 2692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance:
uuid: "5324adacda33452397600f7da92ec963"
format_stamp: "Formatted at 2026-08-08 11:32:09 on dist-test-slave-zkpd"
server_key: "8ea9857f14c27a187c5de80ca5026d8a"
server_key_iv: "6f64941454eb6e8c5932e8932ed9e474"
server_key_version: "encryptionkey@0"
I20260808 11:32:09.447165 2692 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 11:32:09.450604 2707 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:09.452004 2692 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:32:09.452169 2692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "5324adacda33452397600f7da92ec963"
format_stamp: "Formatted at 2026-08-08 11:32:09 on dist-test-slave-zkpd"
server_key: "8ea9857f14c27a187c5de80ca5026d8a"
server_key_iv: "6f64941454eb6e8c5932e8932ed9e474"
server_key_version: "encryptionkey@0"
I20260808 11:32:09.452383 2692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:09.473233 2692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:09.477437 2692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:09.477720 2692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:09.480412 2692 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:32:09.480525 2692 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:09.480682 2692 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:32:09.480818 2692 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 11:32:09 dist-test-slave-zkpd krb5kdc[2287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188729, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM
I20260808 11:32:09.504501 2716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:09.481213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:32927 (local address 127.26.66.190:45993)
0808 11:32:09.481811 (+ 598us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:09.481818 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:09.482806 (+ 988us) server_negotiation.cc:407] Connection header received
0808 11:32:09.484935 (+ 2129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:09.484944 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:09.485059 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:09.485231 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:09.487244 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:09.488644 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:09.491046 (+ 2402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:09.491730 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:09.491918 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:09.496833 (+ 4915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:09.496841 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:09.496847 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:09.496890 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:09.500450 (+ 3560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:09.501643 (+ 1193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:09.501649 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:09.501655 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:09.501831 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:09.502404 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:09.502411 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:09.502416 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:09.502826 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:09.502998 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:09.503834 (+ 836us) server_negotiation.cc:299] Negotiation successful
0808 11:32:09.504089 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":366,"threads_started":1}
I20260808 11:32:09.505465 2717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:09.481759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45993 (local address 127.26.66.131:32927)
0808 11:32:09.482628 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:09.482675 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:09.484654 (+ 1979us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:09.485499 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:09.485512 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:09.486230 (+ 718us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:09.487025 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:09.487048 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:09.488833 (+ 1785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:09.488845 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:09.490861 (+ 2016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:09.490874 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:09.492026 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:09.492038 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:09.492276 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:09.493087 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:09.493108 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:09.496490 (+ 3382us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:09.500673 (+ 4183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:09.500683 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:09.500703 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:09.501505 (+ 802us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:09.501995 (+ 490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:09.502004 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:09.502007 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:09.502284 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:09.502981 (+ 697us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:09.502991 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:09.503447 (+ 456us) client_negotiation.cc:769] Sending connection context
0808 11:32:09.503736 (+ 289us) client_negotiation.cc:240] Negotiation successful
0808 11:32:09.504300 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":373,"threads_started":1}
I20260808 11:32:09.527464 2716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:09.511212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:53669 (local address 127.26.66.190:45993)
0808 11:32:09.511438 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:09.511446 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:09.512054 (+ 608us) server_negotiation.cc:407] Connection header received
0808 11:32:09.512249 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:09.512254 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:09.512364 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:09.512470 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:09.513886 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:09.514556 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:09.517054 (+ 2498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:09.517665 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:09.517824 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:09.520374 (+ 2550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:09.520384 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:09.520391 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:09.520441 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:09.524443 (+ 4002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:09.525519 (+ 1076us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:09.525524 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:09.525527 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:09.525662 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:09.526044 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:09.526049 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:09.526052 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:09.526316 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:09.526494 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:09.526898 (+ 404us) server_negotiation.cc:299] Negotiation successful
0808 11:32:09.527116 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 11:32:09.527554 2774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:09.511224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45993 (local address 127.26.66.131:53669)
0808 11:32:09.511950 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:09.511972 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:09.512130 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:09.512527 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:09.512532 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:09.513249 (+ 717us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:09.513710 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:09.513722 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:09.514709 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:09.514714 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:09.516887 (+ 2173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:09.516908 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:09.517931 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:09.517942 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:09.518290 (+ 348us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:09.519051 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:09.519099 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:09.520157 (+ 1058us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:09.524589 (+ 4432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:09.524600 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:09.524605 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:09.525348 (+ 743us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:09.525780 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:09.525792 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:09.525796 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:09.525923 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:09.526453 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:09.526457 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:09.526631 (+ 174us) client_negotiation.cc:769] Sending connection context
0808 11:32:09.526774 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 11:32:09.527112 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":374,"threads_started":1}
I20260808 11:32:09.546099 2692 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:32797
I20260808 11:32:09.546123 2828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:32797 every 8 connection(s)
I20260808 11:32:09.547308 2692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:32:09.549471 2829 heartbeater.cc:347] Connected to a master server at 127.26.66.190:45993
I20260808 11:32:09.549655 2829 heartbeater.cc:464] Registering TS with master...
I20260808 11:32:09.550244 2829 heartbeater.cc:511] Master 127.26.66.190:45993 requested a full tablet report, sending...
I20260808 11:32:09.550715 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 2692
I20260808 11:32:09.550935 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance
I20260808 11:32:09.551483 26890 external_mini_cluster.cc:1428] Setting key a483af553ee850325677c2268f2847a0
I20260808 11:32:09.551697 2331 ts_manager.cc:194] Registered new tserver with Master: 5324adacda33452397600f7da92ec963 (127.26.66.131:32797)
I20260808 11:32:09.552752 2331 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.66.131@KRBTEST.COM'} at 127.26.66.131:32927
I20260808 11:32:09.554482 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 11:32:09 dist-test-slave-zkpd krb5kdc[2287](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188729, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 11:32:09 dist-test-slave-zkpd krb5kdc[2287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:09 dist-test-slave-zkpd krb5kdc[2287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:09.998937 2688 heartbeater.cc:503] Master 127.26.66.190:45993 was elected leader, sending a full tablet report...
I20260808 11:32:10.555361 2829 heartbeater.cc:503] Master 127.26.66.190:45993 was elected leader, sending a full tablet report...
W20260808 11:32:10.678306 2837 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.069s user 0.003s sys 0.017s
W20260808 11:32:10.679729 2716 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:09.603541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45622 (local address 127.26.66.190:45993)
0808 11:32:09.603825 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:09.603832 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:09.604113 (+ 281us) server_negotiation.cc:407] Connection header received
0808 11:32:09.604373 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:09.604378 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:09.604446 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:09.604563 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:09.605930 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:09.606661 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:09.608105 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:09.608545 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:09.608709 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:10.679379 (+1070670us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45622: BlockingRecv error: recv got EOF from 127.0.0.1:45622 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 08 11:32:10 dist-test-slave-zkpd krb5kdc[2287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188729, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM
I20260808 11:32:10.702483 2716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:10.683433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54910 (local address 127.26.66.190:45993)
0808 11:32:10.683657 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:10.683665 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:10.684013 (+ 348us) server_negotiation.cc:407] Connection header received
0808 11:32:10.684243 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:10.684248 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:10.684328 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:10.684443 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:10.685680 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:10.686410 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:10.687670 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:10.688140 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:10.688272 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:10.697245 (+ 8973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:10.697251 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:10.697254 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:10.697296 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:10.699764 (+ 2468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:10.700439 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:10.700446 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:10.700449 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:10.700581 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:10.700989 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:10.700994 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:10.700998 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:10.701268 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:10.701575 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:10.701921 (+ 346us) server_negotiation.cc:299] Negotiation successful
0808 11:32:10.702158 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 11:32:10.706614 2331 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54910:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 11:32:10.713584 2331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:32:10.748762 2849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:10.725883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:32797 (local address 127.0.0.1:58494)
0808 11:32:10.738875 (+ 12992us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:10.738898 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:10.739065 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:10.740223 (+ 1158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:10.740234 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:10.740276 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:10.740831 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:10.740848 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:10.742863 (+ 2015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:10.742868 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:10.745402 (+ 2534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:10.745417 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:10.747568 (+ 2151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:10.747576 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:10.747831 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:10.747970 (+ 139us) client_negotiation.cc:769] Sending connection context
0808 11:32:10.748097 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 11:32:10.748313 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12827,"mutex_wait_us":47,"thread_start_us":13366,"threads_started":1}
I20260808 11:32:10.748968 2852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:10.726284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58494 (local address 127.26.66.131:32797)
0808 11:32:10.738231 (+ 11947us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:10.738245 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:10.739229 (+ 984us) server_negotiation.cc:407] Connection header received
0808 11:32:10.739371 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:10.739383 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:10.739700 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:10.739921 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:10.741100 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:10.742694 (+ 1594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:10.745589 (+ 2895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:10.747043 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:10.747179 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:10.747428 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:10.748466 (+ 1038us) server_negotiation.cc:299] Negotiation successful
0808 11:32:10.748639 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11715,"thread_start_us":11524,"threads_started":1}
I20260808 11:32:10.752629 2848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:10.725648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:40035 (local address 127.0.0.1:53676)
0808 11:32:10.738692 (+ 13044us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:10.738741 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:10.738936 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:10.744015 (+ 5079us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:10.744020 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:10.744044 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:10.744511 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:10.744523 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:10.747366 (+ 2843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:10.747371 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:10.750265 (+ 2894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:10.750278 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:10.751712 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:10.751719 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:10.751920 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:10.751960 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 11:32:10.752051 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 11:32:10.752222 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12758,"thread_start_us":12614,"threads_started":1}
I20260808 11:32:10.753495 2851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:10.725925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53676 (local address 127.26.66.129:40035)
0808 11:32:10.741938 (+ 16013us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:10.741946 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:10.741974 (+ 28us) server_negotiation.cc:407] Connection header received
0808 11:32:10.743332 (+ 1358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:10.743341 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:10.743576 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:10.743774 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:10.744701 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:10.747212 (+ 2511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:10.750450 (+ 3238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:10.751484 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:10.751647 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:10.751959 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:10.752977 (+ 1018us) server_negotiation.cc:299] Negotiation successful
0808 11:32:10.753145 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15837,"thread_start_us":17160,"threads_started":1}
I20260808 11:32:10.756688 2759 tablet_service.cc:1467] Processing CreateTablet for tablet 163284f63b8f4ccd9dc89641c1d6f131 (DEFAULT_TABLE table=test-table [id=caf578b9d49a455e8ba1fe50087fcdc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:32:10.756985 2472 tablet_service.cc:1467] Processing CreateTablet for tablet 163284f63b8f4ccd9dc89641c1d6f131 (DEFAULT_TABLE table=test-table [id=caf578b9d49a455e8ba1fe50087fcdc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:32:10.758314 2472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 163284f63b8f4ccd9dc89641c1d6f131. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:10.758337 2759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 163284f63b8f4ccd9dc89641c1d6f131. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:10.759939 2849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:10.739984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:41641 (local address 127.0.0.1:35196)
0808 11:32:10.748999 (+ 9015us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:10.749020 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:10.749119 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:10.753445 (+ 4326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:10.753452 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:10.753480 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:10.753866 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:10.753879 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:10.756155 (+ 2276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:10.756163 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:10.757723 (+ 1560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:10.757735 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:10.759177 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:10.759183 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:10.759371 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:10.759412 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 11:32:10.759506 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 11:32:10.759639 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8916,"thread_start_us":12163,"threads_started":1}
I20260808 11:32:10.760030 2854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:10.739932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35196 (local address 127.26.66.130:41641)
0808 11:32:10.752770 (+ 12838us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:10.752780 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:10.752823 (+ 43us) server_negotiation.cc:407] Connection header received
0808 11:32:10.752994 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:10.753001 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:10.753238 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:10.753539 (+ 301us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:10.754485 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:10.755988 (+ 1503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:10.757876 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:10.759008 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:10.759164 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:10.759372 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:10.759551 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 11:32:10.759704 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12656,"thread_start_us":12517,"threads_started":1}
I20260808 11:32:10.766680 2616 tablet_service.cc:1467] Processing CreateTablet for tablet 163284f63b8f4ccd9dc89641c1d6f131 (DEFAULT_TABLE table=test-table [id=caf578b9d49a455e8ba1fe50087fcdc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:32:10.768071 2616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 163284f63b8f4ccd9dc89641c1d6f131. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:10.777288 2857 tablet_bootstrap.cc:492] T 163284f63b8f4ccd9dc89641c1d6f131 P 274e34ae5fe14afc937e847ef7fe5cae: Bootstrap starting.
I20260808 11:32:10.782917 2856 tablet_bootstrap.cc:492] T 163284f63b8f4ccd9dc89641c1d6f131 P 5324adacda33452397600f7da92ec963: Bootstrap starting.
I20260808 11:32:10.784399 2858 tablet_bootstrap.cc:492] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080: Bootstrap starting.
I20260808 11:32:10.786836 2857 tablet_bootstrap.cc:654] T 163284f63b8f4ccd9dc89641c1d6f131 P 274e34ae5fe14afc937e847ef7fe5cae: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:10.787792 2858 tablet_bootstrap.cc:654] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:10.786868 2856 tablet_bootstrap.cc:654] T 163284f63b8f4ccd9dc89641c1d6f131 P 5324adacda33452397600f7da92ec963: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:10.788172 2857 log.cc:824] T 163284f63b8f4ccd9dc89641c1d6f131 P 274e34ae5fe14afc937e847ef7fe5cae: Log is configured to *not* fsync() on all Append() calls
I20260808 11:32:10.789083 2856 log.cc:824] T 163284f63b8f4ccd9dc89641c1d6f131 P 5324adacda33452397600f7da92ec963: Log is configured to *not* fsync() on all Append() calls
I20260808 11:32:10.789089 2858 log.cc:824] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080: Log is configured to *not* fsync() on all Append() calls
I20260808 11:32:10.796255 2858 tablet_bootstrap.cc:492] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080: No bootstrap required, opened a new log
I20260808 11:32:10.796622 2858 ts_tablet_manager.cc:1397] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080: Time spent bootstrapping tablet: real 0.012s user 0.011s sys 0.000s
I20260808 11:32:10.806474 2856 tablet_bootstrap.cc:492] T 163284f63b8f4ccd9dc89641c1d6f131 P 5324adacda33452397600f7da92ec963: No bootstrap required, opened a new log
I20260808 11:32:10.806823 2856 ts_tablet_manager.cc:1397] T 163284f63b8f4ccd9dc89641c1d6f131 P 5324adacda33452397600f7da92ec963: Time spent bootstrapping tablet: real 0.024s user 0.016s sys 0.004s
I20260808 11:32:10.806823 2857 tablet_bootstrap.cc:492] T 163284f63b8f4ccd9dc89641c1d6f131 P 274e34ae5fe14afc937e847ef7fe5cae: No bootstrap required, opened a new log
I20260808 11:32:10.806587 2858 raft_consensus.cc:348] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } }
I20260808 11:32:10.807066 2858 raft_consensus.cc:374] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:10.807134 2857 ts_tablet_manager.cc:1397] T 163284f63b8f4ccd9dc89641c1d6f131 P 274e34ae5fe14afc937e847ef7fe5cae: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.018s
I20260808 11:32:10.807184 2858 raft_consensus.cc:729] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43188733c8a34924b9dbe1d8990d8080, State: Initialized, Role: FOLLOWER
I20260808 11:32:10.807857 2858 consensus_queue.cc:260] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } }
I20260808 11:32:10.809626 2858 ts_tablet_manager.cc:1428] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080: Time spent starting tablet: real 0.013s user 0.009s sys 0.003s
I20260808 11:32:10.815588 2856 raft_consensus.cc:348] T 163284f63b8f4ccd9dc89641c1d6f131 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } }
I20260808 11:32:10.816098 2856 raft_consensus.cc:374] T 163284f63b8f4ccd9dc89641c1d6f131 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:10.816223 2856 raft_consensus.cc:729] T 163284f63b8f4ccd9dc89641c1d6f131 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5324adacda33452397600f7da92ec963, State: Initialized, Role: FOLLOWER
I20260808 11:32:10.817019 2856 consensus_queue.cc:260] T 163284f63b8f4ccd9dc89641c1d6f131 P 5324adacda33452397600f7da92ec963 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } }
I20260808 11:32:10.817157 2857 raft_consensus.cc:348] T 163284f63b8f4ccd9dc89641c1d6f131 P 274e34ae5fe14afc937e847ef7fe5cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } }
I20260808 11:32:10.817561 2857 raft_consensus.cc:374] T 163284f63b8f4ccd9dc89641c1d6f131 P 274e34ae5fe14afc937e847ef7fe5cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:10.817682 2857 raft_consensus.cc:729] T 163284f63b8f4ccd9dc89641c1d6f131 P 274e34ae5fe14afc937e847ef7fe5cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 274e34ae5fe14afc937e847ef7fe5cae, State: Initialized, Role: FOLLOWER
I20260808 11:32:10.818637 2856 ts_tablet_manager.cc:1428] T 163284f63b8f4ccd9dc89641c1d6f131 P 5324adacda33452397600f7da92ec963: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260808 11:32:10.818449 2857 consensus_queue.cc:260] T 163284f63b8f4ccd9dc89641c1d6f131 P 274e34ae5fe14afc937e847ef7fe5cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } }
I20260808 11:32:10.820139 2857 ts_tablet_manager.cc:1428] T 163284f63b8f4ccd9dc89641c1d6f131 P 274e34ae5fe14afc937e847ef7fe5cae: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260808 11:32:10.860301 2862 raft_consensus.cc:482] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:32:10.860587 2862 raft_consensus.cc:504] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } }
I20260808 11:32:10.862262 2862 leader_election.cc:288] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 274e34ae5fe14afc937e847ef7fe5cae (127.26.66.129:40035), 5324adacda33452397600f7da92ec963 (127.26.66.131:32797)
I20260808 11:32:10.869665 2852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:10.862743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:55135 (local address 127.26.66.131:32797)
0808 11:32:10.863007 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:10.863015 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:10.864156 (+ 1141us) server_negotiation.cc:407] Connection header received
0808 11:32:10.864353 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:10.864356 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:10.864454 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:10.864547 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:10.865169 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:10.865973 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:10.867913 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:10.868684 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:10.868853 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:10.868944 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:10.869265 (+ 321us) server_negotiation.cc:299] Negotiation successful
0808 11:32:10.869402 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260808 11:32:10.869721 2851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:10.862611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:45259 (local address 127.26.66.129:40035)
0808 11:32:10.862951 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:10.862961 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:10.864071 (+ 1110us) server_negotiation.cc:407] Connection header received
0808 11:32:10.864278 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:10.864292 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:10.864382 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:10.864450 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:10.865234 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:10.865926 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:10.867969 (+ 2043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:10.868722 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:10.868908 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:10.868977 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:10.869351 (+ 374us) server_negotiation.cc:299] Negotiation successful
0808 11:32:10.869497 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160}
I20260808 11:32:10.869763 2865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:10.862613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:32797 (local address 127.26.66.130:55135)
0808 11:32:10.864005 (+ 1392us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:10.864041 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:10.864208 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:10.864589 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:10.864594 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:10.864621 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:10.865002 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:10.865013 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:10.866146 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:10.866150 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:10.867708 (+ 1558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:10.867723 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:10.868926 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:10.868933 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:10.869103 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:10.869126 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 11:32:10.869201 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 11:32:10.869328 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1225,"mutex_wait_us":8,"thread_start_us":637,"threads_started":1}
I20260808 11:32:10.870062 2866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:10.862595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:40035 (local address 127.26.66.130:45259)
0808 11:32:10.863956 (+ 1361us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:10.863973 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:10.864120 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:10.864503 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:10.864510 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:10.864539 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:10.865060 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:10.865071 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:10.866056 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:10.866064 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:10.867735 (+ 1671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:10.867748 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:10.868980 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:10.868987 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:10.869155 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:10.869198 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 11:32:10.869297 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 11:32:10.869424 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1200,"mutex_wait_us":150,"spinlock_wait_cycles":5888,"thread_start_us":607,"threads_started":1}
I20260808 11:32:10.870811 2784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "163284f63b8f4ccd9dc89641c1d6f131" candidate_uuid: "43188733c8a34924b9dbe1d8990d8080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5324adacda33452397600f7da92ec963" is_pre_election: true
I20260808 11:32:10.871202 2498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "163284f63b8f4ccd9dc89641c1d6f131" candidate_uuid: "43188733c8a34924b9dbe1d8990d8080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "274e34ae5fe14afc937e847ef7fe5cae" is_pre_election: true
I20260808 11:32:10.871455 2784 raft_consensus.cc:2454] T 163284f63b8f4ccd9dc89641c1d6f131 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43188733c8a34924b9dbe1d8990d8080 in term 0.
I20260808 11:32:10.871762 2498 raft_consensus.cc:2454] T 163284f63b8f4ccd9dc89641c1d6f131 P 274e34ae5fe14afc937e847ef7fe5cae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43188733c8a34924b9dbe1d8990d8080 in term 0.
I20260808 11:32:10.872196 2566 leader_election.cc:302] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43188733c8a34924b9dbe1d8990d8080, 5324adacda33452397600f7da92ec963; no voters:
I20260808 11:32:10.872663 2862 raft_consensus.cc:2781] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:32:10.872821 2862 raft_consensus.cc:482] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:32:10.872929 2862 raft_consensus.cc:3037] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:10.875526 2862 raft_consensus.cc:504] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } }
I20260808 11:32:10.876184 2862 leader_election.cc:288] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080 [CANDIDATE]: Term 1 election: Requested vote from peers 274e34ae5fe14afc937e847ef7fe5cae (127.26.66.129:40035), 5324adacda33452397600f7da92ec963 (127.26.66.131:32797)
I20260808 11:32:10.876709 2498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "163284f63b8f4ccd9dc89641c1d6f131" candidate_uuid: "43188733c8a34924b9dbe1d8990d8080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "274e34ae5fe14afc937e847ef7fe5cae"
I20260808 11:32:10.876709 2784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "163284f63b8f4ccd9dc89641c1d6f131" candidate_uuid: "43188733c8a34924b9dbe1d8990d8080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5324adacda33452397600f7da92ec963"
I20260808 11:32:10.876924 2784 raft_consensus.cc:3037] T 163284f63b8f4ccd9dc89641c1d6f131 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:10.876924 2498 raft_consensus.cc:3037] T 163284f63b8f4ccd9dc89641c1d6f131 P 274e34ae5fe14afc937e847ef7fe5cae [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:10.880229 2784 raft_consensus.cc:2454] T 163284f63b8f4ccd9dc89641c1d6f131 P 5324adacda33452397600f7da92ec963 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43188733c8a34924b9dbe1d8990d8080 in term 1.
I20260808 11:32:10.880229 2498 raft_consensus.cc:2454] T 163284f63b8f4ccd9dc89641c1d6f131 P 274e34ae5fe14afc937e847ef7fe5cae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43188733c8a34924b9dbe1d8990d8080 in term 1.
I20260808 11:32:10.880667 2565 leader_election.cc:302] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 274e34ae5fe14afc937e847ef7fe5cae, 43188733c8a34924b9dbe1d8990d8080, 5324adacda33452397600f7da92ec963; no voters:
I20260808 11:32:10.880991 2862 raft_consensus.cc:2781] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:32:10.881448 2862 raft_consensus.cc:686] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080 [term 1 LEADER]: Becoming Leader. State: Replica: 43188733c8a34924b9dbe1d8990d8080, State: Running, Role: LEADER
I20260808 11:32:10.881928 2862 consensus_queue.cc:237] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } }
I20260808 11:32:10.886616 2331 catalog_manager.cc:5495] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43188733c8a34924b9dbe1d8990d8080 (127.26.66.130). New cstate: current_term: 1 leader_uuid: "43188733c8a34924b9dbe1d8990d8080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } health_report { overall_health: HEALTHY } } }
I20260808 11:32:10.901965 2854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:10.896500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35200 (local address 127.26.66.130:41641)
0808 11:32:10.896714 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:10.896720 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:10.896842 (+ 122us) server_negotiation.cc:407] Connection header received
0808 11:32:10.897099 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:10.897103 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:10.897187 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:10.897347 (+ 160us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:32:10.897720 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:10.898418 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:10.899739 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:10.900201 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:10.900347 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:10.900796 (+ 449us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:32:10.901348 (+ 552us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:32:10.901503 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:10.901603 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 11:32:10.901684 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 11:32:10.910125 2784 raft_consensus.cc:1261] T 163284f63b8f4ccd9dc89641c1d6f131 P 5324adacda33452397600f7da92ec963 [term 1 FOLLOWER]: Refusing update from remote peer 43188733c8a34924b9dbe1d8990d8080: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:32:10.910125 2498 raft_consensus.cc:1261] T 163284f63b8f4ccd9dc89641c1d6f131 P 274e34ae5fe14afc937e847ef7fe5cae [term 1 FOLLOWER]: Refusing update from remote peer 43188733c8a34924b9dbe1d8990d8080: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:32:10.911151 2862 consensus_queue.cc:1035] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:32:10.911433 2867 consensus_queue.cc:1035] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:32:10.930943 2870 mvcc.cc:205] Tried to move back new op lower bound from 7316229041797472256 to 7316229041695764480. Current Snapshot: MvccSnapshot[applied={T|T < 7316229041797472256 or (T in {7316229041797472256})}]
I20260808 11:32:10.939167 2332 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:32:10.939417 2332 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:32:10.942917 2332 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a94fe8a075bd4a5fbd1b7873ef76bbde: Sending DeleteTablet for 3 replicas of tablet 163284f63b8f4ccd9dc89641c1d6f131
I20260808 11:32:10.944087 2472 tablet_service.cc:1514] Processing DeleteTablet for tablet 163284f63b8f4ccd9dc89641c1d6f131 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:32:10 UTC) from {username='oryx', principal='oryx/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:53676
I20260808 11:32:10.944403 2759 tablet_service.cc:1514] Processing DeleteTablet for tablet 163284f63b8f4ccd9dc89641c1d6f131 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:32:10 UTC) from {username='oryx', principal='oryx/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:58494
I20260808 11:32:10.944461 2616 tablet_service.cc:1514] Processing DeleteTablet for tablet 163284f63b8f4ccd9dc89641c1d6f131 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:32:10 UTC) from {username='oryx', principal='oryx/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:35196
I20260808 11:32:10.948637 2332 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54910:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 11:32:10.950462 2332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:32:10.963117 2615 tablet_service.cc:1467] Processing CreateTablet for tablet c2d62f4e1d3749bbb527742c8358b6e3 (DEFAULT_TABLE table=test-table [id=2f4b9f3d1b064d6aa9e67ca3e40666b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:32:10.963963 2615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2d62f4e1d3749bbb527742c8358b6e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:10.966122 2883 tablet_replica.cc:330] T 163284f63b8f4ccd9dc89641c1d6f131 P 5324adacda33452397600f7da92ec963: stopping tablet replica
I20260808 11:32:10.966717 2883 raft_consensus.cc:2229] T 163284f63b8f4ccd9dc89641c1d6f131 P 5324adacda33452397600f7da92ec963 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:32:10.967300 2883 raft_consensus.cc:2258] T 163284f63b8f4ccd9dc89641c1d6f131 P 5324adacda33452397600f7da92ec963 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:32:10.967868 2882 tablet_replica.cc:330] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080: stopping tablet replica
I20260808 11:32:10.968771 2759 tablet_service.cc:1467] Processing CreateTablet for tablet c2d62f4e1d3749bbb527742c8358b6e3 (DEFAULT_TABLE table=test-table [id=2f4b9f3d1b064d6aa9e67ca3e40666b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:32:10.969065 2471 tablet_service.cc:1467] Processing CreateTablet for tablet c2d62f4e1d3749bbb527742c8358b6e3 (DEFAULT_TABLE table=test-table [id=2f4b9f3d1b064d6aa9e67ca3e40666b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:32:10.969342 2759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2d62f4e1d3749bbb527742c8358b6e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:10.969636 2471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2d62f4e1d3749bbb527742c8358b6e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:10.975594 2881 tablet_replica.cc:330] T 163284f63b8f4ccd9dc89641c1d6f131 P 274e34ae5fe14afc937e847ef7fe5cae: stopping tablet replica
I20260808 11:32:10.976397 2857 tablet_bootstrap.cc:492] T c2d62f4e1d3749bbb527742c8358b6e3 P 274e34ae5fe14afc937e847ef7fe5cae: Bootstrap starting.
I20260808 11:32:10.974864 2858 tablet_bootstrap.cc:492] T c2d62f4e1d3749bbb527742c8358b6e3 P 43188733c8a34924b9dbe1d8990d8080: Bootstrap starting.
I20260808 11:32:10.977128 2881 raft_consensus.cc:2229] T 163284f63b8f4ccd9dc89641c1d6f131 P 274e34ae5fe14afc937e847ef7fe5cae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:32:10.977645 2881 raft_consensus.cc:2258] T 163284f63b8f4ccd9dc89641c1d6f131 P 274e34ae5fe14afc937e847ef7fe5cae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:32:10.978145 2857 tablet_bootstrap.cc:654] T c2d62f4e1d3749bbb527742c8358b6e3 P 274e34ae5fe14afc937e847ef7fe5cae: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:10.978168 2858 tablet_bootstrap.cc:654] T c2d62f4e1d3749bbb527742c8358b6e3 P 43188733c8a34924b9dbe1d8990d8080: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:10.979638 2882 raft_consensus.cc:2229] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080 [term 1 LEADER]: Raft consensus shutting down.
I20260808 11:32:10.981083 2883 ts_tablet_manager.cc:1905] T 163284f63b8f4ccd9dc89641c1d6f131 P 5324adacda33452397600f7da92ec963: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:32:10.981587 2881 ts_tablet_manager.cc:1905] T 163284f63b8f4ccd9dc89641c1d6f131 P 274e34ae5fe14afc937e847ef7fe5cae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:32:10.981906 2882 raft_consensus.cc:2258] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:32:10.986408 2858 tablet_bootstrap.cc:492] T c2d62f4e1d3749bbb527742c8358b6e3 P 43188733c8a34924b9dbe1d8990d8080: No bootstrap required, opened a new log
I20260808 11:32:10.986585 2858 ts_tablet_manager.cc:1397] T c2d62f4e1d3749bbb527742c8358b6e3 P 43188733c8a34924b9dbe1d8990d8080: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260808 11:32:10.987524 2858 raft_consensus.cc:348] T c2d62f4e1d3749bbb527742c8358b6e3 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:10.987771 2858 raft_consensus.cc:374] T c2d62f4e1d3749bbb527742c8358b6e3 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:10.988210 2856 tablet_bootstrap.cc:492] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963: Bootstrap starting.
I20260808 11:32:10.988534 2858 raft_consensus.cc:729] T c2d62f4e1d3749bbb527742c8358b6e3 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43188733c8a34924b9dbe1d8990d8080, State: Initialized, Role: FOLLOWER
I20260808 11:32:10.988834 2858 consensus_queue.cc:260] T c2d62f4e1d3749bbb527742c8358b6e3 P 43188733c8a34924b9dbe1d8990d8080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:10.989823 2856 tablet_bootstrap.cc:654] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:10.990527 2858 ts_tablet_manager.cc:1428] T c2d62f4e1d3749bbb527742c8358b6e3 P 43188733c8a34924b9dbe1d8990d8080: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260808 11:32:10.990794 2689 tablet.cc:2369] T c2d62f4e1d3749bbb527742c8358b6e3 P 43188733c8a34924b9dbe1d8990d8080: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:32:10.991755 2857 tablet_bootstrap.cc:492] T c2d62f4e1d3749bbb527742c8358b6e3 P 274e34ae5fe14afc937e847ef7fe5cae: No bootstrap required, opened a new log
I20260808 11:32:10.991991 2857 ts_tablet_manager.cc:1397] T c2d62f4e1d3749bbb527742c8358b6e3 P 274e34ae5fe14afc937e847ef7fe5cae: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.006s
I20260808 11:32:10.992983 2857 raft_consensus.cc:348] T c2d62f4e1d3749bbb527742c8358b6e3 P 274e34ae5fe14afc937e847ef7fe5cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:10.993309 2857 raft_consensus.cc:374] T c2d62f4e1d3749bbb527742c8358b6e3 P 274e34ae5fe14afc937e847ef7fe5cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:10.993525 2857 raft_consensus.cc:729] T c2d62f4e1d3749bbb527742c8358b6e3 P 274e34ae5fe14afc937e847ef7fe5cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 274e34ae5fe14afc937e847ef7fe5cae, State: Initialized, Role: FOLLOWER
I20260808 11:32:10.993543 2881 ts_tablet_manager.cc:1918] T 163284f63b8f4ccd9dc89641c1d6f131 P 274e34ae5fe14afc937e847ef7fe5cae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:32:10.993820 2881 log.cc:1196] T 163284f63b8f4ccd9dc89641c1d6f131 P 274e34ae5fe14afc937e847ef7fe5cae: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-0/wal/wals/163284f63b8f4ccd9dc89641c1d6f131
I20260808 11:32:10.994125 2857 consensus_queue.cc:260] T c2d62f4e1d3749bbb527742c8358b6e3 P 274e34ae5fe14afc937e847ef7fe5cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:10.994911 2857 ts_tablet_manager.cc:1428] T c2d62f4e1d3749bbb527742c8358b6e3 P 274e34ae5fe14afc937e847ef7fe5cae: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 11:32:10.996160 2882 ts_tablet_manager.cc:1905] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:32:10.995620 2881 ts_tablet_manager.cc:1939] T 163284f63b8f4ccd9dc89641c1d6f131 P 274e34ae5fe14afc937e847ef7fe5cae: Deleting consensus metadata
I20260808 11:32:10.999987 2316 catalog_manager.cc:4841] TS 274e34ae5fe14afc937e847ef7fe5cae (127.26.66.129:40035): tablet 163284f63b8f4ccd9dc89641c1d6f131 (table test-table [id=caf578b9d49a455e8ba1fe50087fcdc1]) successfully deleted
I20260808 11:32:11.000944 2856 tablet_bootstrap.cc:492] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963: No bootstrap required, opened a new log
I20260808 11:32:11.001096 2856 ts_tablet_manager.cc:1397] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.000s
I20260808 11:32:11.001914 2856 raft_consensus.cc:348] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:11.002125 2856 raft_consensus.cc:374] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:11.002206 2856 raft_consensus.cc:729] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5324adacda33452397600f7da92ec963, State: Initialized, Role: FOLLOWER
I20260808 11:32:11.002553 2856 consensus_queue.cc:260] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:11.003175 2856 ts_tablet_manager.cc:1428] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 11:32:11.005191 2882 ts_tablet_manager.cc:1918] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:32:11.005391 2882 log.cc:1196] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-1/wal/wals/163284f63b8f4ccd9dc89641c1d6f131
I20260808 11:32:11.005944 2882 ts_tablet_manager.cc:1939] T 163284f63b8f4ccd9dc89641c1d6f131 P 43188733c8a34924b9dbe1d8990d8080: Deleting consensus metadata
I20260808 11:32:11.007606 2317 catalog_manager.cc:4841] TS 43188733c8a34924b9dbe1d8990d8080 (127.26.66.130:41641): tablet 163284f63b8f4ccd9dc89641c1d6f131 (table test-table [id=caf578b9d49a455e8ba1fe50087fcdc1]) successfully deleted
I20260808 11:32:11.008440 2883 ts_tablet_manager.cc:1918] T 163284f63b8f4ccd9dc89641c1d6f131 P 5324adacda33452397600f7da92ec963: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:32:11.008677 2883 log.cc:1196] T 163284f63b8f4ccd9dc89641c1d6f131 P 5324adacda33452397600f7da92ec963: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-2/wal/wals/163284f63b8f4ccd9dc89641c1d6f131
I20260808 11:32:11.009284 2883 ts_tablet_manager.cc:1939] T 163284f63b8f4ccd9dc89641c1d6f131 P 5324adacda33452397600f7da92ec963: Deleting consensus metadata
I20260808 11:32:11.011586 2317 catalog_manager.cc:4841] TS 5324adacda33452397600f7da92ec963 (127.26.66.131:32797): tablet 163284f63b8f4ccd9dc89641c1d6f131 (table test-table [id=caf578b9d49a455e8ba1fe50087fcdc1]) successfully deleted
W20260808 11:32:11.049986 2830 tablet.cc:2369] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:32:11.180320 2863 raft_consensus.cc:482] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:32:11.180588 2863 raft_consensus.cc:504] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:11.182569 2863 leader_election.cc:288] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 274e34ae5fe14afc937e847ef7fe5cae (127.26.66.129:40035), 43188733c8a34924b9dbe1d8990d8080 (127.26.66.130:41641)
W20260808 11:32:11.186251 2546 tablet.cc:2369] T c2d62f4e1d3749bbb527742c8358b6e3 P 274e34ae5fe14afc937e847ef7fe5cae: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:32:11.190950 2854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:11.183336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:60181 (local address 127.26.66.130:41641)
0808 11:32:11.183581 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:11.183588 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:11.184284 (+ 696us) server_negotiation.cc:407] Connection header received
0808 11:32:11.184575 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:11.184584 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:11.184690 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:11.184761 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:11.185607 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.186848 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.188900 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.189857 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.190043 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:11.190121 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:11.190475 (+ 354us) server_negotiation.cc:299] Negotiation successful
0808 11:32:11.190613 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 11:32:11.190989 2887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:11.182874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:41641 (local address 127.26.66.131:60181)
0808 11:32:11.184162 (+ 1288us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:11.184179 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:11.184357 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:11.184997 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:11.185002 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:11.185036 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:11.185416 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:11.185427 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.187015 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.187022 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:11.188731 (+ 1709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:11.188744 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.190086 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.190095 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:11.190283 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:11.190321 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 11:32:11.190425 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 11:32:11.190565 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1159,"mutex_wait_us":49,"thread_start_us":1013,"threads_started":1}
I20260808 11:32:11.192324 2851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:11.183060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:60951 (local address 127.26.66.129:40035)
0808 11:32:11.183252 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:11.183258 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:11.184938 (+ 1680us) server_negotiation.cc:407] Connection header received
0808 11:32:11.185127 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:11.185133 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:11.185218 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:11.185327 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:11.185968 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.187015 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.189570 (+ 2555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.190727 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.190902 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:11.190989 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:11.191927 (+ 938us) server_negotiation.cc:299] Negotiation successful
0808 11:32:11.192058 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 11:32:11.192402 2888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:11.183444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:40035 (local address 127.26.66.131:60951)
0808 11:32:11.184807 (+ 1363us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:11.184836 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:11.184980 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:11.185377 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:11.185384 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:11.185413 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:11.185777 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:11.185786 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.187184 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.187191 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:11.189390 (+ 2199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:11.189407 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.191507 (+ 2100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.191514 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:11.191705 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:11.191741 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 11:32:11.191869 (+ 128us) client_negotiation.cc:240] Negotiation successful
0808 11:32:11.192018 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1244,"mutex_wait_us":34,"thread_start_us":1022,"threads_started":1}
I20260808 11:32:11.192173 2641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2d62f4e1d3749bbb527742c8358b6e3" candidate_uuid: "5324adacda33452397600f7da92ec963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43188733c8a34924b9dbe1d8990d8080" is_pre_election: true
I20260808 11:32:11.192687 2641 raft_consensus.cc:2454] T c2d62f4e1d3749bbb527742c8358b6e3 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5324adacda33452397600f7da92ec963 in term 0.
I20260808 11:32:11.193130 2864 raft_consensus.cc:482] T c2d62f4e1d3749bbb527742c8358b6e3 P 274e34ae5fe14afc937e847ef7fe5cae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:32:11.193264 2498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2d62f4e1d3749bbb527742c8358b6e3" candidate_uuid: "5324adacda33452397600f7da92ec963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "274e34ae5fe14afc937e847ef7fe5cae" is_pre_election: true
I20260808 11:32:11.193416 2709 leader_election.cc:302] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43188733c8a34924b9dbe1d8990d8080, 5324adacda33452397600f7da92ec963; no voters:
I20260808 11:32:11.193377 2864 raft_consensus.cc:504] T c2d62f4e1d3749bbb527742c8358b6e3 P 274e34ae5fe14afc937e847ef7fe5cae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:11.193867 2863 raft_consensus.cc:2781] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:32:11.193991 2863 raft_consensus.cc:482] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:32:11.194087 2863 raft_consensus.cc:3037] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:11.194087 2498 raft_consensus.cc:2454] T c2d62f4e1d3749bbb527742c8358b6e3 P 274e34ae5fe14afc937e847ef7fe5cae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5324adacda33452397600f7da92ec963 in term 0.
I20260808 11:32:11.195221 2864 leader_election.cc:288] T c2d62f4e1d3749bbb527742c8358b6e3 P 274e34ae5fe14afc937e847ef7fe5cae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43188733c8a34924b9dbe1d8990d8080 (127.26.66.130:41641), 5324adacda33452397600f7da92ec963 (127.26.66.131:32797)
I20260808 11:32:11.197466 2863 raft_consensus.cc:504] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:11.198609 2498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2d62f4e1d3749bbb527742c8358b6e3" candidate_uuid: "5324adacda33452397600f7da92ec963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "274e34ae5fe14afc937e847ef7fe5cae"
I20260808 11:32:11.198839 2498 raft_consensus.cc:3037] T c2d62f4e1d3749bbb527742c8358b6e3 P 274e34ae5fe14afc937e847ef7fe5cae [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:11.199028 2641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2d62f4e1d3749bbb527742c8358b6e3" candidate_uuid: "5324adacda33452397600f7da92ec963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43188733c8a34924b9dbe1d8990d8080"
I20260808 11:32:11.199254 2641 raft_consensus.cc:3037] T c2d62f4e1d3749bbb527742c8358b6e3 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:11.202075 2498 raft_consensus.cc:2454] T c2d62f4e1d3749bbb527742c8358b6e3 P 274e34ae5fe14afc937e847ef7fe5cae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5324adacda33452397600f7da92ec963 in term 1.
I20260808 11:32:11.202538 2708 leader_election.cc:302] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 274e34ae5fe14afc937e847ef7fe5cae, 5324adacda33452397600f7da92ec963; no voters:
I20260808 11:32:11.202698 2641 raft_consensus.cc:2454] T c2d62f4e1d3749bbb527742c8358b6e3 P 43188733c8a34924b9dbe1d8990d8080 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5324adacda33452397600f7da92ec963 in term 1.
I20260808 11:32:11.203140 2863 leader_election.cc:288] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963 [CANDIDATE]: Term 1 election: Requested vote from peers 274e34ae5fe14afc937e847ef7fe5cae (127.26.66.129:40035), 43188733c8a34924b9dbe1d8990d8080 (127.26.66.130:41641)
I20260808 11:32:11.203346 2863 raft_consensus.cc:2781] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:32:11.203482 2863 raft_consensus.cc:686] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963 [term 1 LEADER]: Becoming Leader. State: Replica: 5324adacda33452397600f7da92ec963, State: Running, Role: LEADER
I20260808 11:32:11.203882 2863 consensus_queue.cc:237] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:11.208988 2854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:11.197423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:41771 (local address 127.26.66.130:41641)
0808 11:32:11.197609 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:11.197617 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:11.197635 (+ 18us) server_negotiation.cc:407] Connection header received
0808 11:32:11.197694 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:11.197698 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:11.197766 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:11.197851 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:11.198884 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.200109 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.203013 (+ 2904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.204881 (+ 1868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.205112 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:11.205224 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:11.208363 (+ 3139us) server_negotiation.cc:299] Negotiation successful
0808 11:32:11.208576 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 11:32:11.209489 2889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:11.195392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:41641 (local address 127.26.66.129:41771)
0808 11:32:11.196042 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:11.196062 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:11.196182 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:11.198069 (+ 1887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:11.198073 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:11.198101 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:11.198580 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:11.198599 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.200364 (+ 1765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.200370 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:11.202674 (+ 2304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:11.202688 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.207413 (+ 4725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.207424 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:11.207706 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:11.207766 (+ 60us) client_negotiation.cc:769] Sending connection context
0808 11:32:11.207878 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 11:32:11.208085 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":356,"threads_started":1}
I20260808 11:32:11.210403 2641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2d62f4e1d3749bbb527742c8358b6e3" candidate_uuid: "274e34ae5fe14afc937e847ef7fe5cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43188733c8a34924b9dbe1d8990d8080" is_pre_election: true
I20260808 11:32:11.210732 2641 raft_consensus.cc:2379] T c2d62f4e1d3749bbb527742c8358b6e3 P 43188733c8a34924b9dbe1d8990d8080 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 274e34ae5fe14afc937e847ef7fe5cae in current term 1: Already voted for candidate 5324adacda33452397600f7da92ec963 in this term.
I20260808 11:32:11.218048 2852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:11.197223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:40231 (local address 127.26.66.131:32797)
0808 11:32:11.197388 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:11.197394 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:11.197410 (+ 16us) server_negotiation.cc:407] Connection header received
0808 11:32:11.197470 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:11.197474 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:11.197541 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:11.197638 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:11.209243 (+ 11605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.210510 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.213782 (+ 3272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.215663 (+ 1881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.215872 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:11.216011 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:11.217604 (+ 1593us) server_negotiation.cc:299] Negotiation successful
0808 11:32:11.217769 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 11:32:11.218070 2890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:11.196195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:32797 (local address 127.26.66.129:40231)
0808 11:32:11.196858 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:11.196872 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:11.196956 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:11.197809 (+ 853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:11.197826 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:11.197856 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:11.198247 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:11.198265 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.210707 (+ 12442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.210715 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:11.213510 (+ 2795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:11.213533 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.216308 (+ 2775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.216316 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:11.216553 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:11.217481 (+ 928us) client_negotiation.cc:769] Sending connection context
0808 11:32:11.217584 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 11:32:11.217736 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":352,"threads_started":1}
I20260808 11:32:11.218729 2331 catalog_manager.cc:5495] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5324adacda33452397600f7da92ec963 (127.26.66.131). New cstate: current_term: 1 leader_uuid: "5324adacda33452397600f7da92ec963" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } health_report { overall_health: HEALTHY } } }
I20260808 11:32:11.219172 2784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2d62f4e1d3749bbb527742c8358b6e3" candidate_uuid: "274e34ae5fe14afc937e847ef7fe5cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5324adacda33452397600f7da92ec963" is_pre_election: true
I20260808 11:32:11.219813 2423 leader_election.cc:302] T c2d62f4e1d3749bbb527742c8358b6e3 P 274e34ae5fe14afc937e847ef7fe5cae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 274e34ae5fe14afc937e847ef7fe5cae; no voters: 43188733c8a34924b9dbe1d8990d8080, 5324adacda33452397600f7da92ec963
I20260808 11:32:11.220293 2864 raft_consensus.cc:2726] T c2d62f4e1d3749bbb527742c8358b6e3 P 274e34ae5fe14afc937e847ef7fe5cae [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
Aug 08 11:32:11 dist-test-slave-zkpd krb5kdc[2287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188727, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.190@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM
I20260808 11:32:11.307272 2899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:11.290537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54914 (local address 127.26.66.190:45993)
0808 11:32:11.291566 (+ 1029us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:11.291570 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:11.291590 (+ 20us) server_negotiation.cc:407] Connection header received
0808 11:32:11.291635 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:11.291638 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:11.291700 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:11.291790 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:11.293464 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.294463 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.296449 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.296855 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.296951 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:11.301298 (+ 4347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:11.301303 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:11.301306 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:11.301345 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:11.304291 (+ 2946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:11.305235 (+ 944us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:11.305239 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:11.305241 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:11.305350 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:11.305777 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:11.305780 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:11.305781 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:11.306051 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:11.306160 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:11.306707 (+ 547us) server_negotiation.cc:299] Negotiation successful
0808 11:32:11.306926 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":941,"thread_start_us":771,"threads_started":1}
I20260808 11:32:11.307669 2898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:11.290416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45993 (local address 127.0.0.1:54914)
0808 11:32:11.291225 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:11.291250 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:11.291477 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:11.291902 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:11.291924 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:11.292997 (+ 1073us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:11.293288 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:11.293302 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.294612 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.294618 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:11.296294 (+ 1676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:11.296312 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.297050 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.297057 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:11.297269 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:11.298009 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:11.298035 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:11.301066 (+ 3031us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:11.304455 (+ 3389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:11.304468 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:11.304476 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:11.305098 (+ 622us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:11.305471 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:11.305476 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:11.305480 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:11.305663 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:11.306192 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:11.306201 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:11.306421 (+ 220us) client_negotiation.cc:769] Sending connection context
0808 11:32:11.306622 (+ 201us) client_negotiation.cc:240] Negotiation successful
0808 11:32:11.307123 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607,"mutex_wait_us":151,"thread_start_us":421,"threads_started":1}
I20260808 11:32:11.313628 2331 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:54914:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 11:32:11.314985 2331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:32:11.323029 2472 tablet_service.cc:1467] Processing CreateTablet for tablet 08631ab08532466687ab73133aeee9b5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5a8a7fc36e9e4958b0d566e3ff11db25]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 11:32:11.323067 2615 tablet_service.cc:1467] Processing CreateTablet for tablet 08631ab08532466687ab73133aeee9b5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5a8a7fc36e9e4958b0d566e3ff11db25]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 11:32:11.323642 2615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08631ab08532466687ab73133aeee9b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:11.323644 2472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08631ab08532466687ab73133aeee9b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:11.323539 2759 tablet_service.cc:1467] Processing CreateTablet for tablet 08631ab08532466687ab73133aeee9b5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5a8a7fc36e9e4958b0d566e3ff11db25]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 11:32:11.324139 2759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08631ab08532466687ab73133aeee9b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:11.331553 2858 tablet_bootstrap.cc:492] T 08631ab08532466687ab73133aeee9b5 P 43188733c8a34924b9dbe1d8990d8080: Bootstrap starting.
I20260808 11:32:11.332329 2857 tablet_bootstrap.cc:492] T 08631ab08532466687ab73133aeee9b5 P 274e34ae5fe14afc937e847ef7fe5cae: Bootstrap starting.
I20260808 11:32:11.333630 2858 tablet_bootstrap.cc:654] T 08631ab08532466687ab73133aeee9b5 P 43188733c8a34924b9dbe1d8990d8080: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:11.334302 2857 tablet_bootstrap.cc:654] T 08631ab08532466687ab73133aeee9b5 P 274e34ae5fe14afc937e847ef7fe5cae: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:11.334957 2856 tablet_bootstrap.cc:492] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963: Bootstrap starting.
I20260808 11:32:11.337383 2856 tablet_bootstrap.cc:654] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:11.342650 2856 tablet_bootstrap.cc:492] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963: No bootstrap required, opened a new log
I20260808 11:32:11.342904 2856 ts_tablet_manager.cc:1397] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260808 11:32:11.343803 2856 raft_consensus.cc:348] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:11.344252 2856 raft_consensus.cc:374] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:11.344412 2856 raft_consensus.cc:729] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5324adacda33452397600f7da92ec963, State: Initialized, Role: FOLLOWER
I20260808 11:32:11.344794 2856 consensus_queue.cc:260] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:11.346576 2856 ts_tablet_manager.cc:1428] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 11:32:11.346429 2863 tablet_replica.cc:439] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } } }
I20260808 11:32:11.346836 2863 tablet_replica.cc:442] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 11:32:11.349042 2858 tablet_bootstrap.cc:492] T 08631ab08532466687ab73133aeee9b5 P 43188733c8a34924b9dbe1d8990d8080: No bootstrap required, opened a new log
I20260808 11:32:11.349260 2858 ts_tablet_manager.cc:1397] T 08631ab08532466687ab73133aeee9b5 P 43188733c8a34924b9dbe1d8990d8080: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.004s
I20260808 11:32:11.350142 2858 raft_consensus.cc:348] T 08631ab08532466687ab73133aeee9b5 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:11.350414 2858 raft_consensus.cc:374] T 08631ab08532466687ab73133aeee9b5 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:11.350519 2858 raft_consensus.cc:729] T 08631ab08532466687ab73133aeee9b5 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43188733c8a34924b9dbe1d8990d8080, State: Initialized, Role: FOLLOWER
I20260808 11:32:11.350852 2858 consensus_queue.cc:260] T 08631ab08532466687ab73133aeee9b5 P 43188733c8a34924b9dbe1d8990d8080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:11.351348 2862 tablet_replica.cc:439] T 08631ab08532466687ab73133aeee9b5 P 43188733c8a34924b9dbe1d8990d8080: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } } }
I20260808 11:32:11.351646 2862 tablet_replica.cc:442] T 08631ab08532466687ab73133aeee9b5 P 43188733c8a34924b9dbe1d8990d8080: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 11:32:11.352711 2858 ts_tablet_manager.cc:1428] T 08631ab08532466687ab73133aeee9b5 P 43188733c8a34924b9dbe1d8990d8080: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260808 11:32:11.354467 2857 tablet_bootstrap.cc:492] T 08631ab08532466687ab73133aeee9b5 P 274e34ae5fe14afc937e847ef7fe5cae: No bootstrap required, opened a new log
I20260808 11:32:11.354636 2857 ts_tablet_manager.cc:1397] T 08631ab08532466687ab73133aeee9b5 P 274e34ae5fe14afc937e847ef7fe5cae: Time spent bootstrapping tablet: real 0.022s user 0.015s sys 0.003s
I20260808 11:32:11.355412 2857 raft_consensus.cc:348] T 08631ab08532466687ab73133aeee9b5 P 274e34ae5fe14afc937e847ef7fe5cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:11.355690 2857 raft_consensus.cc:374] T 08631ab08532466687ab73133aeee9b5 P 274e34ae5fe14afc937e847ef7fe5cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:11.355865 2857 raft_consensus.cc:729] T 08631ab08532466687ab73133aeee9b5 P 274e34ae5fe14afc937e847ef7fe5cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 274e34ae5fe14afc937e847ef7fe5cae, State: Initialized, Role: FOLLOWER
I20260808 11:32:11.356155 2857 consensus_queue.cc:260] T 08631ab08532466687ab73133aeee9b5 P 274e34ae5fe14afc937e847ef7fe5cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:11.356614 2864 tablet_replica.cc:439] T 08631ab08532466687ab73133aeee9b5 P 274e34ae5fe14afc937e847ef7fe5cae: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } } }
I20260808 11:32:11.356949 2864 tablet_replica.cc:442] T 08631ab08532466687ab73133aeee9b5 P 274e34ae5fe14afc937e847ef7fe5cae: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 11:32:11.357779 2857 ts_tablet_manager.cc:1428] T 08631ab08532466687ab73133aeee9b5 P 274e34ae5fe14afc937e847ef7fe5cae: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 11:32:11.436317 2863 raft_consensus.cc:482] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:32:11.436551 2863 raft_consensus.cc:504] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:11.437281 2863 leader_election.cc:288] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 274e34ae5fe14afc937e847ef7fe5cae (127.26.66.129:40035), 43188733c8a34924b9dbe1d8990d8080 (127.26.66.130:41641)
I20260808 11:32:11.437837 2498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08631ab08532466687ab73133aeee9b5" candidate_uuid: "5324adacda33452397600f7da92ec963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "274e34ae5fe14afc937e847ef7fe5cae" is_pre_election: true
I20260808 11:32:11.437898 2641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08631ab08532466687ab73133aeee9b5" candidate_uuid: "5324adacda33452397600f7da92ec963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43188733c8a34924b9dbe1d8990d8080" is_pre_election: true
I20260808 11:32:11.438130 2641 raft_consensus.cc:2454] T 08631ab08532466687ab73133aeee9b5 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5324adacda33452397600f7da92ec963 in term 0.
I20260808 11:32:11.438128 2498 raft_consensus.cc:2454] T 08631ab08532466687ab73133aeee9b5 P 274e34ae5fe14afc937e847ef7fe5cae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5324adacda33452397600f7da92ec963 in term 0.
I20260808 11:32:11.438566 2709 leader_election.cc:302] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43188733c8a34924b9dbe1d8990d8080, 5324adacda33452397600f7da92ec963; no voters:
I20260808 11:32:11.438850 2863 raft_consensus.cc:2781] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:32:11.438954 2863 raft_consensus.cc:482] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:32:11.439081 2863 raft_consensus.cc:3037] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:11.441196 2863 raft_consensus.cc:504] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:11.441773 2863 leader_election.cc:288] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963 [CANDIDATE]: Term 1 election: Requested vote from peers 274e34ae5fe14afc937e847ef7fe5cae (127.26.66.129:40035), 43188733c8a34924b9dbe1d8990d8080 (127.26.66.130:41641)
I20260808 11:32:11.442222 2498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08631ab08532466687ab73133aeee9b5" candidate_uuid: "5324adacda33452397600f7da92ec963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "274e34ae5fe14afc937e847ef7fe5cae"
I20260808 11:32:11.442270 2641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08631ab08532466687ab73133aeee9b5" candidate_uuid: "5324adacda33452397600f7da92ec963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43188733c8a34924b9dbe1d8990d8080"
I20260808 11:32:11.442472 2498 raft_consensus.cc:3037] T 08631ab08532466687ab73133aeee9b5 P 274e34ae5fe14afc937e847ef7fe5cae [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:11.442503 2641 raft_consensus.cc:3037] T 08631ab08532466687ab73133aeee9b5 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:11.444587 2498 raft_consensus.cc:2454] T 08631ab08532466687ab73133aeee9b5 P 274e34ae5fe14afc937e847ef7fe5cae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5324adacda33452397600f7da92ec963 in term 1.
I20260808 11:32:11.445000 2708 leader_election.cc:302] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 274e34ae5fe14afc937e847ef7fe5cae, 5324adacda33452397600f7da92ec963; no voters:
I20260808 11:32:11.445277 2863 raft_consensus.cc:2781] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:32:11.445312 2641 raft_consensus.cc:2454] T 08631ab08532466687ab73133aeee9b5 P 43188733c8a34924b9dbe1d8990d8080 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5324adacda33452397600f7da92ec963 in term 1.
I20260808 11:32:11.445490 2863 raft_consensus.cc:686] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963 [term 1 LEADER]: Becoming Leader. State: Replica: 5324adacda33452397600f7da92ec963, State: Running, Role: LEADER
I20260808 11:32:11.445741 2863 consensus_queue.cc:237] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:11.447549 2891 tablet_replica.cc:439] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963: TxnStatusTablet state changed. Reason: New leader 5324adacda33452397600f7da92ec963. Latest consensus state: current_term: 1 leader_uuid: "5324adacda33452397600f7da92ec963" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } } }
I20260808 11:32:11.447912 2891 tablet_replica.cc:442] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963: This TxnStatusTablet replica's current role is: LEADER
I20260808 11:32:11.448990 2331 catalog_manager.cc:5495] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5324adacda33452397600f7da92ec963 (127.26.66.131). New cstate: current_term: 1 leader_uuid: "5324adacda33452397600f7da92ec963" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } health_report { overall_health: HEALTHY } } }
I20260808 11:32:11.456269 2904 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 11:32:11.456511 2904 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 11:32:11.473031 2852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:11.467153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58496 (local address 127.26.66.131:32797)
0808 11:32:11.467568 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:11.467574 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:11.467591 (+ 17us) server_negotiation.cc:407] Connection header received
0808 11:32:11.467685 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:11.467693 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:11.467866 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:11.468031 (+ 165us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:32:11.468541 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.469336 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.470680 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.471135 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.471291 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:11.471779 (+ 488us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:32:11.472368 (+ 589us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:32:11.472533 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:11.472623 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 11:32:11.472703 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174}
I20260808 11:32:11.473070 2898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:11.466718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:32797 (local address 127.0.0.1:58496)
0808 11:32:11.466986 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:11.467007 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:11.467143 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:11.468116 (+ 973us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:11.468123 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:11.468135 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 11:32:11.468362 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:11.468394 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.469496 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.469502 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:11.470524 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:11.470534 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.471302 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.471308 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:11.471499 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:11.471551 (+ 52us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 11:32:11.472495 (+ 944us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 11:32:11.472518 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 11:32:11.472601 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 11:32:11.472749 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 11:32:11.477322 2498 raft_consensus.cc:1261] T 08631ab08532466687ab73133aeee9b5 P 274e34ae5fe14afc937e847ef7fe5cae [term 1 FOLLOWER]: Refusing update from remote peer 5324adacda33452397600f7da92ec963: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:32:11.477524 2641 raft_consensus.cc:1261] T 08631ab08532466687ab73133aeee9b5 P 43188733c8a34924b9dbe1d8990d8080 [term 1 FOLLOWER]: Refusing update from remote peer 5324adacda33452397600f7da92ec963: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:32:11.478181 2891 consensus_queue.cc:1035] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:32:11.478528 2863 consensus_queue.cc:1035] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:32:11.484750 2864 tablet_replica.cc:439] T 08631ab08532466687ab73133aeee9b5 P 274e34ae5fe14afc937e847ef7fe5cae: TxnStatusTablet state changed. Reason: New leader 5324adacda33452397600f7da92ec963. Latest consensus state: current_term: 1 leader_uuid: "5324adacda33452397600f7da92ec963" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } } }
I20260808 11:32:11.485080 2864 tablet_replica.cc:442] T 08631ab08532466687ab73133aeee9b5 P 274e34ae5fe14afc937e847ef7fe5cae: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 11:32:11.487449 2907 mvcc.cc:205] Tried to move back new op lower bound from 7316229044123910144 to 7316229044004126720. Current Snapshot: MvccSnapshot[applied={T|T < 7316229044123910144}]
I20260808 11:32:11.488605 2909 mvcc.cc:205] Tried to move back new op lower bound from 7316229044123910144 to 7316229044004126720. Current Snapshot: MvccSnapshot[applied={T|T < 7316229044123910144}]
I20260808 11:32:11.489580 2864 tablet_replica.cc:439] T 08631ab08532466687ab73133aeee9b5 P 274e34ae5fe14afc937e847ef7fe5cae: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5324adacda33452397600f7da92ec963" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } } }
I20260808 11:32:11.489879 2864 tablet_replica.cc:442] T 08631ab08532466687ab73133aeee9b5 P 274e34ae5fe14afc937e847ef7fe5cae: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 11:32:11.492487 2891 tablet_replica.cc:439] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5324adacda33452397600f7da92ec963" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } } }
I20260808 11:32:11.492761 2891 tablet_replica.cc:442] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963: This TxnStatusTablet replica's current role is: LEADER
I20260808 11:32:11.495416 2862 tablet_replica.cc:439] T 08631ab08532466687ab73133aeee9b5 P 43188733c8a34924b9dbe1d8990d8080: TxnStatusTablet state changed. Reason: New leader 5324adacda33452397600f7da92ec963. Latest consensus state: current_term: 1 leader_uuid: "5324adacda33452397600f7da92ec963" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } } }
I20260808 11:32:11.495675 2862 tablet_replica.cc:442] T 08631ab08532466687ab73133aeee9b5 P 43188733c8a34924b9dbe1d8990d8080: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 11:32:11.498338 2863 tablet_replica.cc:439] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5324adacda33452397600f7da92ec963" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } } }
I20260808 11:32:11.498653 2863 tablet_replica.cc:442] T 08631ab08532466687ab73133aeee9b5 P 5324adacda33452397600f7da92ec963: This TxnStatusTablet replica's current role is: LEADER
I20260808 11:32:11.503062 2862 tablet_replica.cc:439] T 08631ab08532466687ab73133aeee9b5 P 43188733c8a34924b9dbe1d8990d8080: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5324adacda33452397600f7da92ec963" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } } }
I20260808 11:32:11.503300 2862 tablet_replica.cc:442] T 08631ab08532466687ab73133aeee9b5 P 43188733c8a34924b9dbe1d8990d8080: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 11:32:11.512122 2852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:11.505906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58502 (local address 127.26.66.131:32797)
0808 11:32:11.506130 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:11.506139 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:11.506637 (+ 498us) server_negotiation.cc:407] Connection header received
0808 11:32:11.506781 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:11.506787 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:11.506868 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:11.506980 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:32:11.507419 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.508605 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.510023 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.510769 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.510894 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:11.511247 (+ 353us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:32:11.511385 (+ 138us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:32:11.511489 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:11.511706 (+ 217us) server_negotiation.cc:299] Negotiation successful
0808 11:32:11.511789 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 11:32:11.528496 2852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:11.521976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:46837 (local address 127.26.66.131:32797)
0808 11:32:11.522167 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:11.522173 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:11.522884 (+ 711us) server_negotiation.cc:407] Connection header received
0808 11:32:11.523086 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:11.523092 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:11.523171 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:11.523278 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:32:11.523936 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.525053 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.526492 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.527171 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.527295 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:11.527689 (+ 394us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:32:11.527814 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:32:11.527941 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:11.528112 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 11:32:11.528198 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 11:32:11.528541 2920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:11.522072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:32797 (local address 127.26.66.131:46837)
0808 11:32:11.522747 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:11.522766 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:11.522950 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:11.523324 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:11.523327 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:11.523337 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 11:32:11.523730 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:11.523739 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.525182 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.525186 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:11.526351 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:11.526364 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.527351 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.527356 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:11.527470 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:11.527521 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 11:32:11.527987 (+ 466us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 11:32:11.527996 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 11:32:11.528060 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 11:32:11.528168 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":343,"threads_started":1}
I20260808 11:32:11.538887 2641 raft_consensus.cc:1261] T c2d62f4e1d3749bbb527742c8358b6e3 P 43188733c8a34924b9dbe1d8990d8080 [term 1 FOLLOWER]: Refusing update from remote peer 5324adacda33452397600f7da92ec963: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:32:11.538908 2497 raft_consensus.cc:1261] T c2d62f4e1d3749bbb527742c8358b6e3 P 274e34ae5fe14afc937e847ef7fe5cae [term 1 FOLLOWER]: Refusing update from remote peer 5324adacda33452397600f7da92ec963: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:32:11.539389 2891 consensus_queue.cc:1035] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:32:11.539634 2863 consensus_queue.cc:1035] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:32:11.610314 2331 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:32:11.610572 2331 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:32:11.613528 2331 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a94fe8a075bd4a5fbd1b7873ef76bbde: Sending DeleteTablet for 3 replicas of tablet c2d62f4e1d3749bbb527742c8358b6e3
I20260808 11:32:11.614517 2615 tablet_service.cc:1514] Processing DeleteTablet for tablet c2d62f4e1d3749bbb527742c8358b6e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:32:11 UTC) from {username='oryx', principal='oryx/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:35196
I20260808 11:32:11.614533 2472 tablet_service.cc:1514] Processing DeleteTablet for tablet c2d62f4e1d3749bbb527742c8358b6e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:32:11 UTC) from {username='oryx', principal='oryx/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:53676
I20260808 11:32:11.615549 2759 tablet_service.cc:1514] Processing DeleteTablet for tablet c2d62f4e1d3749bbb527742c8358b6e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:32:11 UTC) from {username='oryx', principal='oryx/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:58494
I20260808 11:32:11.625213 2926 tablet_replica.cc:330] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963: stopping tablet replica
I20260808 11:32:11.625550 2926 raft_consensus.cc:2229] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963 [term 1 LEADER]: Raft consensus shutting down.
I20260808 11:32:11.626179 2926 raft_consensus.cc:2258] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:32:11.626811 2925 tablet_replica.cc:330] T c2d62f4e1d3749bbb527742c8358b6e3 P 43188733c8a34924b9dbe1d8990d8080: stopping tablet replica
I20260808 11:32:11.627051 2925 raft_consensus.cc:2229] T c2d62f4e1d3749bbb527742c8358b6e3 P 43188733c8a34924b9dbe1d8990d8080 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:32:11.627300 2925 raft_consensus.cc:2258] T c2d62f4e1d3749bbb527742c8358b6e3 P 43188733c8a34924b9dbe1d8990d8080 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:32:11.627952 2924 tablet_replica.cc:330] T c2d62f4e1d3749bbb527742c8358b6e3 P 274e34ae5fe14afc937e847ef7fe5cae: stopping tablet replica
I20260808 11:32:11.628151 2924 raft_consensus.cc:2229] T c2d62f4e1d3749bbb527742c8358b6e3 P 274e34ae5fe14afc937e847ef7fe5cae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:32:11.628430 2924 raft_consensus.cc:2258] T c2d62f4e1d3749bbb527742c8358b6e3 P 274e34ae5fe14afc937e847ef7fe5cae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:32:11.628589 2925 ts_tablet_manager.cc:1905] T c2d62f4e1d3749bbb527742c8358b6e3 P 43188733c8a34924b9dbe1d8990d8080: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:32:11.628983 2926 ts_tablet_manager.cc:1905] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:32:11.629696 2924 ts_tablet_manager.cc:1905] T c2d62f4e1d3749bbb527742c8358b6e3 P 274e34ae5fe14afc937e847ef7fe5cae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:32:11.635869 2925 ts_tablet_manager.cc:1918] T c2d62f4e1d3749bbb527742c8358b6e3 P 43188733c8a34924b9dbe1d8990d8080: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 11:32:11.636029 2925 log.cc:1196] T c2d62f4e1d3749bbb527742c8358b6e3 P 43188733c8a34924b9dbe1d8990d8080: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-1/wal/wals/c2d62f4e1d3749bbb527742c8358b6e3
I20260808 11:32:11.636502 2925 ts_tablet_manager.cc:1939] T c2d62f4e1d3749bbb527742c8358b6e3 P 43188733c8a34924b9dbe1d8990d8080: Deleting consensus metadata
I20260808 11:32:11.637619 2317 catalog_manager.cc:4841] TS 43188733c8a34924b9dbe1d8990d8080 (127.26.66.130:41641): tablet c2d62f4e1d3749bbb527742c8358b6e3 (table test-table [id=2f4b9f3d1b064d6aa9e67ca3e40666b2]) successfully deleted
I20260808 11:32:11.638026 2924 ts_tablet_manager.cc:1918] T c2d62f4e1d3749bbb527742c8358b6e3 P 274e34ae5fe14afc937e847ef7fe5cae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 11:32:11.638173 2924 log.cc:1196] T c2d62f4e1d3749bbb527742c8358b6e3 P 274e34ae5fe14afc937e847ef7fe5cae: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-0/wal/wals/c2d62f4e1d3749bbb527742c8358b6e3
I20260808 11:32:11.638584 2924 ts_tablet_manager.cc:1939] T c2d62f4e1d3749bbb527742c8358b6e3 P 274e34ae5fe14afc937e847ef7fe5cae: Deleting consensus metadata
I20260808 11:32:11.639117 2926 ts_tablet_manager.cc:1918] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 11:32:11.639257 2926 log.cc:1196] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-2/wal/wals/c2d62f4e1d3749bbb527742c8358b6e3
I20260808 11:32:11.639556 2316 catalog_manager.cc:4841] TS 274e34ae5fe14afc937e847ef7fe5cae (127.26.66.129:40035): tablet c2d62f4e1d3749bbb527742c8358b6e3 (table test-table [id=2f4b9f3d1b064d6aa9e67ca3e40666b2]) successfully deleted
I20260808 11:32:11.639768 2926 ts_tablet_manager.cc:1939] T c2d62f4e1d3749bbb527742c8358b6e3 P 5324adacda33452397600f7da92ec963: Deleting consensus metadata
I20260808 11:32:11.640857 2317 catalog_manager.cc:4841] TS 5324adacda33452397600f7da92ec963 (127.26.66.131:32797): tablet c2d62f4e1d3749bbb527742c8358b6e3 (table test-table [id=2f4b9f3d1b064d6aa9e67ca3e40666b2]) successfully deleted
Aug 08 11:32:11 dist-test-slave-zkpd krb5kdc[2287](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188731, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 11:32:11 dist-test-slave-zkpd krb5kdc[2287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:11 dist-test-slave-zkpd krb5kdc[2287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
W20260808 11:32:11.691876 2899 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:11.679382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54918 (local address 127.26.66.190:45993)
0808 11:32:11.679656 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:11.679663 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:11.680032 (+ 369us) server_negotiation.cc:407] Connection header received
0808 11:32:11.680228 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:11.680232 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:11.680299 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:11.680394 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:11.682039 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.682762 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.684654 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.685060 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.685152 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:11.691608 (+ 6456us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54918: BlockingRecv error: recv got EOF from 127.0.0.1:54918 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 08 11:32:11 dist-test-slave-zkpd krb5kdc[2287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188731, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM
I20260808 11:32:11.712647 2899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:11.697212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54930 (local address 127.26.66.190:45993)
0808 11:32:11.697394 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:11.697400 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:11.697708 (+ 308us) server_negotiation.cc:407] Connection header received
0808 11:32:11.697847 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:11.697853 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:11.697932 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:11.698039 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:11.699191 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.700358 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.701715 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:11.702364 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:11.702488 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:11.706326 (+ 3838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:11.706333 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:11.706338 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:11.706378 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:11.709990 (+ 3612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:11.710790 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:11.710794 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:11.710796 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:11.710931 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:11.711342 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:11.711345 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:11.711347 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:11.711608 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:11.711802 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:11.712166 (+ 364us) server_negotiation.cc:299] Negotiation successful
0808 11:32:11.712362 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 11:32:11.716410 2331 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54930:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 11:32:11.717137 2331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:32:11.724334 2472 tablet_service.cc:1467] Processing CreateTablet for tablet e0a3654a77804745a3503dc6fecdc488 (DEFAULT_TABLE table=test-table [id=efc6e152537b47a8881a737aca244006]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:32:11.724821 2472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0a3654a77804745a3503dc6fecdc488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:11.724969 2615 tablet_service.cc:1467] Processing CreateTablet for tablet e0a3654a77804745a3503dc6fecdc488 (DEFAULT_TABLE table=test-table [id=efc6e152537b47a8881a737aca244006]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:32:11.725255 2759 tablet_service.cc:1467] Processing CreateTablet for tablet e0a3654a77804745a3503dc6fecdc488 (DEFAULT_TABLE table=test-table [id=efc6e152537b47a8881a737aca244006]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:32:11.725425 2615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0a3654a77804745a3503dc6fecdc488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:11.725725 2759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0a3654a77804745a3503dc6fecdc488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:11.731478 2857 tablet_bootstrap.cc:492] T e0a3654a77804745a3503dc6fecdc488 P 274e34ae5fe14afc937e847ef7fe5cae: Bootstrap starting.
I20260808 11:32:11.732049 2858 tablet_bootstrap.cc:492] T e0a3654a77804745a3503dc6fecdc488 P 43188733c8a34924b9dbe1d8990d8080: Bootstrap starting.
I20260808 11:32:11.732475 2856 tablet_bootstrap.cc:492] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963: Bootstrap starting.
I20260808 11:32:11.733135 2857 tablet_bootstrap.cc:654] T e0a3654a77804745a3503dc6fecdc488 P 274e34ae5fe14afc937e847ef7fe5cae: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:11.733632 2858 tablet_bootstrap.cc:654] T e0a3654a77804745a3503dc6fecdc488 P 43188733c8a34924b9dbe1d8990d8080: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:11.734306 2856 tablet_bootstrap.cc:654] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:11.735512 2857 tablet_bootstrap.cc:492] T e0a3654a77804745a3503dc6fecdc488 P 274e34ae5fe14afc937e847ef7fe5cae: No bootstrap required, opened a new log
I20260808 11:32:11.735708 2857 ts_tablet_manager.cc:1397] T e0a3654a77804745a3503dc6fecdc488 P 274e34ae5fe14afc937e847ef7fe5cae: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260808 11:32:11.736382 2858 tablet_bootstrap.cc:492] T e0a3654a77804745a3503dc6fecdc488 P 43188733c8a34924b9dbe1d8990d8080: No bootstrap required, opened a new log
I20260808 11:32:11.736542 2858 ts_tablet_manager.cc:1397] T e0a3654a77804745a3503dc6fecdc488 P 43188733c8a34924b9dbe1d8990d8080: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 11:32:11.736745 2857 raft_consensus.cc:348] T e0a3654a77804745a3503dc6fecdc488 P 274e34ae5fe14afc937e847ef7fe5cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:11.737032 2857 raft_consensus.cc:374] T e0a3654a77804745a3503dc6fecdc488 P 274e34ae5fe14afc937e847ef7fe5cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:11.737150 2857 raft_consensus.cc:729] T e0a3654a77804745a3503dc6fecdc488 P 274e34ae5fe14afc937e847ef7fe5cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 274e34ae5fe14afc937e847ef7fe5cae, State: Initialized, Role: FOLLOWER
I20260808 11:32:11.737259 2858 raft_consensus.cc:348] T e0a3654a77804745a3503dc6fecdc488 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:11.737517 2858 raft_consensus.cc:374] T e0a3654a77804745a3503dc6fecdc488 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:11.737618 2858 raft_consensus.cc:729] T e0a3654a77804745a3503dc6fecdc488 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43188733c8a34924b9dbe1d8990d8080, State: Initialized, Role: FOLLOWER
I20260808 11:32:11.737463 2857 consensus_queue.cc:260] T e0a3654a77804745a3503dc6fecdc488 P 274e34ae5fe14afc937e847ef7fe5cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:11.738296 2857 ts_tablet_manager.cc:1428] T e0a3654a77804745a3503dc6fecdc488 P 274e34ae5fe14afc937e847ef7fe5cae: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 11:32:11.737883 2858 consensus_queue.cc:260] T e0a3654a77804745a3503dc6fecdc488 P 43188733c8a34924b9dbe1d8990d8080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:11.738890 2858 ts_tablet_manager.cc:1428] T e0a3654a77804745a3503dc6fecdc488 P 43188733c8a34924b9dbe1d8990d8080: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 11:32:11.745098 2856 tablet_bootstrap.cc:492] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963: No bootstrap required, opened a new log
I20260808 11:32:11.745271 2856 ts_tablet_manager.cc:1397] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.000s
I20260808 11:32:11.746066 2856 raft_consensus.cc:348] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:11.746337 2856 raft_consensus.cc:374] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:11.746436 2856 raft_consensus.cc:729] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5324adacda33452397600f7da92ec963, State: Initialized, Role: FOLLOWER
I20260808 11:32:11.746670 2856 consensus_queue.cc:260] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:11.747223 2856 ts_tablet_manager.cc:1428] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260808 11:32:11.961154 2863 raft_consensus.cc:482] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:32:11.961741 2863 raft_consensus.cc:504] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:11.962462 2863 leader_election.cc:288] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 274e34ae5fe14afc937e847ef7fe5cae (127.26.66.129:40035), 43188733c8a34924b9dbe1d8990d8080 (127.26.66.130:41641)
I20260808 11:32:11.963083 2641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0a3654a77804745a3503dc6fecdc488" candidate_uuid: "5324adacda33452397600f7da92ec963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43188733c8a34924b9dbe1d8990d8080" is_pre_election: true
I20260808 11:32:11.963073 2497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0a3654a77804745a3503dc6fecdc488" candidate_uuid: "5324adacda33452397600f7da92ec963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "274e34ae5fe14afc937e847ef7fe5cae" is_pre_election: true
I20260808 11:32:11.963337 2641 raft_consensus.cc:2454] T e0a3654a77804745a3503dc6fecdc488 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5324adacda33452397600f7da92ec963 in term 0.
I20260808 11:32:11.963357 2497 raft_consensus.cc:2454] T e0a3654a77804745a3503dc6fecdc488 P 274e34ae5fe14afc937e847ef7fe5cae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5324adacda33452397600f7da92ec963 in term 0.
I20260808 11:32:11.963860 2709 leader_election.cc:302] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43188733c8a34924b9dbe1d8990d8080, 5324adacda33452397600f7da92ec963; no voters:
I20260808 11:32:11.964201 2863 raft_consensus.cc:2781] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:32:11.964354 2863 raft_consensus.cc:482] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:32:11.964471 2863 raft_consensus.cc:3037] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:11.966938 2863 raft_consensus.cc:504] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:11.967716 2863 leader_election.cc:288] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963 [CANDIDATE]: Term 1 election: Requested vote from peers 274e34ae5fe14afc937e847ef7fe5cae (127.26.66.129:40035), 43188733c8a34924b9dbe1d8990d8080 (127.26.66.130:41641)
I20260808 11:32:11.968158 2497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0a3654a77804745a3503dc6fecdc488" candidate_uuid: "5324adacda33452397600f7da92ec963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "274e34ae5fe14afc937e847ef7fe5cae"
I20260808 11:32:11.968420 2497 raft_consensus.cc:3037] T e0a3654a77804745a3503dc6fecdc488 P 274e34ae5fe14afc937e847ef7fe5cae [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:11.968693 2641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0a3654a77804745a3503dc6fecdc488" candidate_uuid: "5324adacda33452397600f7da92ec963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43188733c8a34924b9dbe1d8990d8080"
I20260808 11:32:11.968923 2641 raft_consensus.cc:3037] T e0a3654a77804745a3503dc6fecdc488 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:11.970685 2497 raft_consensus.cc:2454] T e0a3654a77804745a3503dc6fecdc488 P 274e34ae5fe14afc937e847ef7fe5cae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5324adacda33452397600f7da92ec963 in term 1.
I20260808 11:32:11.971071 2708 leader_election.cc:302] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 274e34ae5fe14afc937e847ef7fe5cae, 5324adacda33452397600f7da92ec963; no voters:
I20260808 11:32:11.971345 2863 raft_consensus.cc:2781] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:32:11.971521 2863 raft_consensus.cc:686] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963 [term 1 LEADER]: Becoming Leader. State: Replica: 5324adacda33452397600f7da92ec963, State: Running, Role: LEADER
I20260808 11:32:11.971958 2641 raft_consensus.cc:2454] T e0a3654a77804745a3503dc6fecdc488 P 43188733c8a34924b9dbe1d8990d8080 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5324adacda33452397600f7da92ec963 in term 1.
I20260808 11:32:11.971797 2863 consensus_queue.cc:237] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:11.974931 2332 catalog_manager.cc:5495] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5324adacda33452397600f7da92ec963 (127.26.66.131). New cstate: current_term: 1 leader_uuid: "5324adacda33452397600f7da92ec963" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } health_report { overall_health: HEALTHY } } }
I20260808 11:32:12.042303 2944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:12.037124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58512 (local address 127.26.66.131:32797)
0808 11:32:12.037731 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:12.037736 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:12.037750 (+ 14us) server_negotiation.cc:407] Connection header received
0808 11:32:12.037810 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:12.037813 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:12.037886 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:12.037997 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:32:12.038381 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:12.039091 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:12.040535 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:12.040980 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:12.041120 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:12.041549 (+ 429us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:32:12.041665 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:32:12.041764 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:12.041922 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 11:32:12.042009 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":456,"thread_start_us":293,"threads_started":1}
I20260808 11:32:12.045477 2641 raft_consensus.cc:1261] T e0a3654a77804745a3503dc6fecdc488 P 43188733c8a34924b9dbe1d8990d8080 [term 1 FOLLOWER]: Refusing update from remote peer 5324adacda33452397600f7da92ec963: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:32:12.045527 2497 raft_consensus.cc:1261] T e0a3654a77804745a3503dc6fecdc488 P 274e34ae5fe14afc937e847ef7fe5cae [term 1 FOLLOWER]: Refusing update from remote peer 5324adacda33452397600f7da92ec963: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:32:12.046121 2863 consensus_queue.cc:1035] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:32:12.046550 2914 consensus_queue.cc:1035] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:32:12.063184 2330 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:32:12.063434 2330 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:32:12.066673 2330 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a94fe8a075bd4a5fbd1b7873ef76bbde: Sending DeleteTablet for 3 replicas of tablet e0a3654a77804745a3503dc6fecdc488
I20260808 11:32:12.067538 2472 tablet_service.cc:1514] Processing DeleteTablet for tablet e0a3654a77804745a3503dc6fecdc488 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:32:12 UTC) from {username='oryx', principal='oryx/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:53676
I20260808 11:32:12.067845 2924 tablet_replica.cc:330] T e0a3654a77804745a3503dc6fecdc488 P 274e34ae5fe14afc937e847ef7fe5cae: stopping tablet replica
I20260808 11:32:12.067790 2615 tablet_service.cc:1514] Processing DeleteTablet for tablet e0a3654a77804745a3503dc6fecdc488 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:32:12 UTC) from {username='oryx', principal='oryx/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:35196
I20260808 11:32:12.068100 2925 tablet_replica.cc:330] T e0a3654a77804745a3503dc6fecdc488 P 43188733c8a34924b9dbe1d8990d8080: stopping tablet replica
I20260808 11:32:12.068087 2924 raft_consensus.cc:2229] T e0a3654a77804745a3503dc6fecdc488 P 274e34ae5fe14afc937e847ef7fe5cae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:32:12.068279 2925 raft_consensus.cc:2229] T e0a3654a77804745a3503dc6fecdc488 P 43188733c8a34924b9dbe1d8990d8080 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:32:12.068336 2924 raft_consensus.cc:2258] T e0a3654a77804745a3503dc6fecdc488 P 274e34ae5fe14afc937e847ef7fe5cae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:32:12.068501 2925 raft_consensus.cc:2258] T e0a3654a77804745a3503dc6fecdc488 P 43188733c8a34924b9dbe1d8990d8080 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:32:12.068656 2330 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54930:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 11:32:12.069054 2759 tablet_service.cc:1514] Processing DeleteTablet for tablet e0a3654a77804745a3503dc6fecdc488 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:32:12 UTC) from {username='oryx', principal='oryx/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:58494
I20260808 11:32:12.069335 2926 tablet_replica.cc:330] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963: stopping tablet replica
W20260808 11:32:12.069468 2330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:32:12.069535 2926 raft_consensus.cc:2229] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963 [term 1 LEADER]: Raft consensus shutting down.
I20260808 11:32:12.069867 2926 raft_consensus.cc:2258] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:32:12.069963 2925 ts_tablet_manager.cc:1905] T e0a3654a77804745a3503dc6fecdc488 P 43188733c8a34924b9dbe1d8990d8080: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:32:12.071096 2926 ts_tablet_manager.cc:1905] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:32:12.074852 2925 ts_tablet_manager.cc:1918] T e0a3654a77804745a3503dc6fecdc488 P 43188733c8a34924b9dbe1d8990d8080: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:32:12.074972 2925 log.cc:1196] T e0a3654a77804745a3503dc6fecdc488 P 43188733c8a34924b9dbe1d8990d8080: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-1/wal/wals/e0a3654a77804745a3503dc6fecdc488
I20260808 11:32:12.075255 2925 ts_tablet_manager.cc:1939] T e0a3654a77804745a3503dc6fecdc488 P 43188733c8a34924b9dbe1d8990d8080: Deleting consensus metadata
I20260808 11:32:12.076200 2317 catalog_manager.cc:4841] TS 43188733c8a34924b9dbe1d8990d8080 (127.26.66.130:41641): tablet e0a3654a77804745a3503dc6fecdc488 (table test-table [id=efc6e152537b47a8881a737aca244006]) successfully deleted
I20260808 11:32:12.077286 2924 ts_tablet_manager.cc:1905] T e0a3654a77804745a3503dc6fecdc488 P 274e34ae5fe14afc937e847ef7fe5cae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:32:12.081154 2472 tablet_service.cc:1467] Processing CreateTablet for tablet 3ae162764f974a1d93f99f27b0cd7f06 (DEFAULT_TABLE table=test-table [id=59514b7c02504277ae6102d16036ddb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:32:12.081179 2615 tablet_service.cc:1467] Processing CreateTablet for tablet 3ae162764f974a1d93f99f27b0cd7f06 (DEFAULT_TABLE table=test-table [id=59514b7c02504277ae6102d16036ddb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:32:12.081569 2615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ae162764f974a1d93f99f27b0cd7f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:12.081596 2472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ae162764f974a1d93f99f27b0cd7f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:12.084120 2924 ts_tablet_manager.cc:1918] T e0a3654a77804745a3503dc6fecdc488 P 274e34ae5fe14afc937e847ef7fe5cae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:32:12.084254 2924 log.cc:1196] T e0a3654a77804745a3503dc6fecdc488 P 274e34ae5fe14afc937e847ef7fe5cae: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-0/wal/wals/e0a3654a77804745a3503dc6fecdc488
I20260808 11:32:12.084669 2924 ts_tablet_manager.cc:1939] T e0a3654a77804745a3503dc6fecdc488 P 274e34ae5fe14afc937e847ef7fe5cae: Deleting consensus metadata
I20260808 11:32:12.085752 2316 catalog_manager.cc:4841] TS 274e34ae5fe14afc937e847ef7fe5cae (127.26.66.129:40035): tablet e0a3654a77804745a3503dc6fecdc488 (table test-table [id=efc6e152537b47a8881a737aca244006]) successfully deleted
I20260808 11:32:12.086875 2759 tablet_service.cc:1467] Processing CreateTablet for tablet 3ae162764f974a1d93f99f27b0cd7f06 (DEFAULT_TABLE table=test-table [id=59514b7c02504277ae6102d16036ddb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:32:12.087308 2759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ae162764f974a1d93f99f27b0cd7f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:12.088037 2926 ts_tablet_manager.cc:1918] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:32:12.088212 2926 log.cc:1196] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-2/wal/wals/e0a3654a77804745a3503dc6fecdc488
I20260808 11:32:12.088752 2926 ts_tablet_manager.cc:1939] T e0a3654a77804745a3503dc6fecdc488 P 5324adacda33452397600f7da92ec963: Deleting consensus metadata
I20260808 11:32:12.089767 2317 catalog_manager.cc:4841] TS 5324adacda33452397600f7da92ec963 (127.26.66.131:32797): tablet e0a3654a77804745a3503dc6fecdc488 (table test-table [id=efc6e152537b47a8881a737aca244006]) successfully deleted
I20260808 11:32:12.089838 2857 tablet_bootstrap.cc:492] T 3ae162764f974a1d93f99f27b0cd7f06 P 274e34ae5fe14afc937e847ef7fe5cae: Bootstrap starting.
I20260808 11:32:12.091037 2857 tablet_bootstrap.cc:654] T 3ae162764f974a1d93f99f27b0cd7f06 P 274e34ae5fe14afc937e847ef7fe5cae: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:12.093689 2858 tablet_bootstrap.cc:492] T 3ae162764f974a1d93f99f27b0cd7f06 P 43188733c8a34924b9dbe1d8990d8080: Bootstrap starting.
I20260808 11:32:12.093948 2856 tablet_bootstrap.cc:492] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963: Bootstrap starting.
I20260808 11:32:12.095665 2856 tablet_bootstrap.cc:654] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:12.095862 2858 tablet_bootstrap.cc:654] T 3ae162764f974a1d93f99f27b0cd7f06 P 43188733c8a34924b9dbe1d8990d8080: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:12.100843 2858 tablet_bootstrap.cc:492] T 3ae162764f974a1d93f99f27b0cd7f06 P 43188733c8a34924b9dbe1d8990d8080: No bootstrap required, opened a new log
I20260808 11:32:12.100852 2856 tablet_bootstrap.cc:492] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963: No bootstrap required, opened a new log
I20260808 11:32:12.101028 2858 ts_tablet_manager.cc:1397] T 3ae162764f974a1d93f99f27b0cd7f06 P 43188733c8a34924b9dbe1d8990d8080: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260808 11:32:12.101039 2856 ts_tablet_manager.cc:1397] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260808 11:32:12.101871 2858 raft_consensus.cc:348] T 3ae162764f974a1d93f99f27b0cd7f06 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:12.101987 2856 raft_consensus.cc:348] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:12.102144 2858 raft_consensus.cc:374] T 3ae162764f974a1d93f99f27b0cd7f06 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:12.102233 2858 raft_consensus.cc:729] T 3ae162764f974a1d93f99f27b0cd7f06 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43188733c8a34924b9dbe1d8990d8080, State: Initialized, Role: FOLLOWER
I20260808 11:32:12.102415 2856 raft_consensus.cc:374] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:12.102452 2857 tablet_bootstrap.cc:492] T 3ae162764f974a1d93f99f27b0cd7f06 P 274e34ae5fe14afc937e847ef7fe5cae: No bootstrap required, opened a new log
I20260808 11:32:12.102501 2856 raft_consensus.cc:729] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5324adacda33452397600f7da92ec963, State: Initialized, Role: FOLLOWER
I20260808 11:32:12.102597 2857 ts_tablet_manager.cc:1397] T 3ae162764f974a1d93f99f27b0cd7f06 P 274e34ae5fe14afc937e847ef7fe5cae: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.005s
I20260808 11:32:12.102466 2858 consensus_queue.cc:260] T 3ae162764f974a1d93f99f27b0cd7f06 P 43188733c8a34924b9dbe1d8990d8080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:12.102727 2856 consensus_queue.cc:260] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:12.103003 2858 ts_tablet_manager.cc:1428] T 3ae162764f974a1d93f99f27b0cd7f06 P 43188733c8a34924b9dbe1d8990d8080: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260808 11:32:12.103250 2856 ts_tablet_manager.cc:1428] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260808 11:32:12.103379 2857 raft_consensus.cc:348] T 3ae162764f974a1d93f99f27b0cd7f06 P 274e34ae5fe14afc937e847ef7fe5cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:12.103622 2857 raft_consensus.cc:374] T 3ae162764f974a1d93f99f27b0cd7f06 P 274e34ae5fe14afc937e847ef7fe5cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:12.103701 2857 raft_consensus.cc:729] T 3ae162764f974a1d93f99f27b0cd7f06 P 274e34ae5fe14afc937e847ef7fe5cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 274e34ae5fe14afc937e847ef7fe5cae, State: Initialized, Role: FOLLOWER
I20260808 11:32:12.104549 2857 consensus_queue.cc:260] T 3ae162764f974a1d93f99f27b0cd7f06 P 274e34ae5fe14afc937e847ef7fe5cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:12.105101 2857 ts_tablet_manager.cc:1428] T 3ae162764f974a1d93f99f27b0cd7f06 P 274e34ae5fe14afc937e847ef7fe5cae: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 11:32:12.439911 2891 raft_consensus.cc:482] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:32:12.440131 2891 raft_consensus.cc:504] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:12.440873 2891 leader_election.cc:288] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 274e34ae5fe14afc937e847ef7fe5cae (127.26.66.129:40035), 43188733c8a34924b9dbe1d8990d8080 (127.26.66.130:41641)
I20260808 11:32:12.441510 2640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ae162764f974a1d93f99f27b0cd7f06" candidate_uuid: "5324adacda33452397600f7da92ec963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43188733c8a34924b9dbe1d8990d8080" is_pre_election: true
I20260808 11:32:12.441519 2497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ae162764f974a1d93f99f27b0cd7f06" candidate_uuid: "5324adacda33452397600f7da92ec963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "274e34ae5fe14afc937e847ef7fe5cae" is_pre_election: true
I20260808 11:32:12.441813 2497 raft_consensus.cc:2454] T 3ae162764f974a1d93f99f27b0cd7f06 P 274e34ae5fe14afc937e847ef7fe5cae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5324adacda33452397600f7da92ec963 in term 0.
I20260808 11:32:12.441787 2640 raft_consensus.cc:2454] T 3ae162764f974a1d93f99f27b0cd7f06 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5324adacda33452397600f7da92ec963 in term 0.
I20260808 11:32:12.442266 2708 leader_election.cc:302] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 274e34ae5fe14afc937e847ef7fe5cae, 5324adacda33452397600f7da92ec963; no voters:
I20260808 11:32:12.442517 2891 raft_consensus.cc:2781] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:32:12.442643 2891 raft_consensus.cc:482] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:32:12.442755 2891 raft_consensus.cc:3037] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:12.444984 2891 raft_consensus.cc:504] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:12.445562 2891 leader_election.cc:288] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963 [CANDIDATE]: Term 1 election: Requested vote from peers 274e34ae5fe14afc937e847ef7fe5cae (127.26.66.129:40035), 43188733c8a34924b9dbe1d8990d8080 (127.26.66.130:41641)
I20260808 11:32:12.446031 2497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ae162764f974a1d93f99f27b0cd7f06" candidate_uuid: "5324adacda33452397600f7da92ec963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "274e34ae5fe14afc937e847ef7fe5cae"
I20260808 11:32:12.446085 2640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ae162764f974a1d93f99f27b0cd7f06" candidate_uuid: "5324adacda33452397600f7da92ec963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43188733c8a34924b9dbe1d8990d8080"
I20260808 11:32:12.446276 2497 raft_consensus.cc:3037] T 3ae162764f974a1d93f99f27b0cd7f06 P 274e34ae5fe14afc937e847ef7fe5cae [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:12.446300 2640 raft_consensus.cc:3037] T 3ae162764f974a1d93f99f27b0cd7f06 P 43188733c8a34924b9dbe1d8990d8080 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:12.448496 2640 raft_consensus.cc:2454] T 3ae162764f974a1d93f99f27b0cd7f06 P 43188733c8a34924b9dbe1d8990d8080 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5324adacda33452397600f7da92ec963 in term 1.
I20260808 11:32:12.448911 2709 leader_election.cc:302] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43188733c8a34924b9dbe1d8990d8080, 5324adacda33452397600f7da92ec963; no voters:
I20260808 11:32:12.449194 2891 raft_consensus.cc:2781] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:32:12.449370 2891 raft_consensus.cc:686] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963 [term 1 LEADER]: Becoming Leader. State: Replica: 5324adacda33452397600f7da92ec963, State: Running, Role: LEADER
I20260808 11:32:12.449386 2497 raft_consensus.cc:2454] T 3ae162764f974a1d93f99f27b0cd7f06 P 274e34ae5fe14afc937e847ef7fe5cae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5324adacda33452397600f7da92ec963 in term 1.
I20260808 11:32:12.449661 2891 consensus_queue.cc:237] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } }
I20260808 11:32:12.452580 2330 catalog_manager.cc:5495] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5324adacda33452397600f7da92ec963 (127.26.66.131). New cstate: current_term: 1 leader_uuid: "5324adacda33452397600f7da92ec963" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5324adacda33452397600f7da92ec963" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 32797 } health_report { overall_health: HEALTHY } } }
I20260808 11:32:12.480628 2640 raft_consensus.cc:1261] T 3ae162764f974a1d93f99f27b0cd7f06 P 43188733c8a34924b9dbe1d8990d8080 [term 1 FOLLOWER]: Refusing update from remote peer 5324adacda33452397600f7da92ec963: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:32:12.480691 2497 raft_consensus.cc:1261] T 3ae162764f974a1d93f99f27b0cd7f06 P 274e34ae5fe14afc937e847ef7fe5cae [term 1 FOLLOWER]: Refusing update from remote peer 5324adacda33452397600f7da92ec963: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:32:12.481249 2863 consensus_queue.cc:1035] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43188733c8a34924b9dbe1d8990d8080" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:32:12.481515 2914 consensus_queue.cc:1035] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "274e34ae5fe14afc937e847ef7fe5cae" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:32:12.539701 2330 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:32:12.539973 2330 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:32:12.542732 2330 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a94fe8a075bd4a5fbd1b7873ef76bbde: Sending DeleteTablet for 3 replicas of tablet 3ae162764f974a1d93f99f27b0cd7f06
I20260808 11:32:12.543485 2472 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae162764f974a1d93f99f27b0cd7f06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:32:12 UTC) from {username='oryx', principal='oryx/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:53676
I20260808 11:32:12.543618 2615 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae162764f974a1d93f99f27b0cd7f06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:32:12 UTC) from {username='oryx', principal='oryx/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:35196
I20260808 11:32:12.543749 2759 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ae162764f974a1d93f99f27b0cd7f06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:32:12 UTC) from {username='oryx', principal='oryx/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:58494
I20260808 11:32:12.543993 2924 tablet_replica.cc:330] T 3ae162764f974a1d93f99f27b0cd7f06 P 274e34ae5fe14afc937e847ef7fe5cae: stopping tablet replica
I20260808 11:32:12.544112 2926 tablet_replica.cc:330] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963: stopping tablet replica
I20260808 11:32:12.544212 2924 raft_consensus.cc:2229] T 3ae162764f974a1d93f99f27b0cd7f06 P 274e34ae5fe14afc937e847ef7fe5cae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:32:12.544304 2926 raft_consensus.cc:2229] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963 [term 1 LEADER]: Raft consensus shutting down.
I20260808 11:32:12.544337 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 2406
I20260808 11:32:12.544438 2924 raft_consensus.cc:2258] T 3ae162764f974a1d93f99f27b0cd7f06 P 274e34ae5fe14afc937e847ef7fe5cae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:32:12.544651 2926 raft_consensus.cc:2258] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:32:12.544763 2925 tablet_replica.cc:330] T 3ae162764f974a1d93f99f27b0cd7f06 P 43188733c8a34924b9dbe1d8990d8080: stopping tablet replica
I20260808 11:32:12.544966 2925 raft_consensus.cc:2229] T 3ae162764f974a1d93f99f27b0cd7f06 P 43188733c8a34924b9dbe1d8990d8080 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:32:12.545185 2925 raft_consensus.cc:2258] T 3ae162764f974a1d93f99f27b0cd7f06 P 43188733c8a34924b9dbe1d8990d8080 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:32:12.546067 2926 ts_tablet_manager.cc:1905] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:32:12.546516 2925 ts_tablet_manager.cc:1905] T 3ae162764f974a1d93f99f27b0cd7f06 P 43188733c8a34924b9dbe1d8990d8080: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:32:12.546607 2924 ts_tablet_manager.cc:1905] T 3ae162764f974a1d93f99f27b0cd7f06 P 274e34ae5fe14afc937e847ef7fe5cae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:32:12.553062 2925 ts_tablet_manager.cc:1918] T 3ae162764f974a1d93f99f27b0cd7f06 P 43188733c8a34924b9dbe1d8990d8080: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 11:32:12.553207 2925 log.cc:1196] T 3ae162764f974a1d93f99f27b0cd7f06 P 43188733c8a34924b9dbe1d8990d8080: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-1/wal/wals/3ae162764f974a1d93f99f27b0cd7f06
I20260808 11:32:12.553586 2926 ts_tablet_manager.cc:1918] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 11:32:12.553658 2925 ts_tablet_manager.cc:1939] T 3ae162764f974a1d93f99f27b0cd7f06 P 43188733c8a34924b9dbe1d8990d8080: Deleting consensus metadata
I20260808 11:32:12.553844 2926 log.cc:1196] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-2/wal/wals/3ae162764f974a1d93f99f27b0cd7f06
I20260808 11:32:12.554361 2926 ts_tablet_manager.cc:1939] T 3ae162764f974a1d93f99f27b0cd7f06 P 5324adacda33452397600f7da92ec963: Deleting consensus metadata
I20260808 11:32:12.554905 2317 catalog_manager.cc:4841] TS 43188733c8a34924b9dbe1d8990d8080 (127.26.66.130:41641): tablet 3ae162764f974a1d93f99f27b0cd7f06 (table test-table [id=59514b7c02504277ae6102d16036ddb5]) successfully deleted
I20260808 11:32:12.555553 2317 catalog_manager.cc:4841] TS 5324adacda33452397600f7da92ec963 (127.26.66.131:32797): tablet 3ae162764f974a1d93f99f27b0cd7f06 (table test-table [id=59514b7c02504277ae6102d16036ddb5]) successfully deleted
I20260808 11:32:12.557488 2924 ts_tablet_manager.cc:1918] T 3ae162764f974a1d93f99f27b0cd7f06 P 274e34ae5fe14afc937e847ef7fe5cae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 11:32:12.557628 2924 log.cc:1196] T 3ae162764f974a1d93f99f27b0cd7f06 P 274e34ae5fe14afc937e847ef7fe5cae: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786188664137852-26890-0/minicluster-data/ts-0/wal/wals/3ae162764f974a1d93f99f27b0cd7f06
I20260808 11:32:12.558063 2924 ts_tablet_manager.cc:1939] T 3ae162764f974a1d93f99f27b0cd7f06 P 274e34ae5fe14afc937e847ef7fe5cae: Deleting consensus metadata
I20260808 11:32:12.559103 2316 catalog_manager.cc:4841] TS 274e34ae5fe14afc937e847ef7fe5cae (127.26.66.129:40035): tablet 3ae162764f974a1d93f99f27b0cd7f06 (table test-table [id=59514b7c02504277ae6102d16036ddb5]) successfully deleted
Aug 08 11:32:12 dist-test-slave-zkpd krb5kdc[2287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188731, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.66.129@KRBTEST.COM
I20260808 11:32:12.571280 2956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:12.545210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53684 (local address 127.26.66.129:40035)
0808 11:32:12.555421 (+ 10211us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:12.555428 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:12.556062 (+ 634us) server_negotiation.cc:407] Connection header received
0808 11:32:12.556307 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:12.556317 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:12.556438 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:12.556646 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:12.558037 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:12.558927 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:12.560392 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:12.560841 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:12.560981 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:12.565195 (+ 4214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:12.565211 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:12.565227 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:12.565260 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:12.568463 (+ 3203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:12.569146 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:12.569159 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:12.569162 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:12.569296 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:12.569698 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:12.569702 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:12.569704 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:12.570056 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:12.570387 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:12.570710 (+ 323us) server_negotiation.cc:299] Negotiation successful
0808 11:32:12.570950 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10070,"thread_start_us":10260,"threads_started":1}
I20260808 11:32:12.572060 2539 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:12.675776 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 2406
I20260808 11:32:12.699442 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 2549
Aug 08 11:32:12 dist-test-slave-zkpd krb5kdc[2287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188731, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.66.130@KRBTEST.COM
I20260808 11:32:12.715564 2959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:12.700287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35202 (local address 127.26.66.130:41641)
0808 11:32:12.700781 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:12.700785 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:12.700802 (+ 17us) server_negotiation.cc:407] Connection header received
0808 11:32:12.700868 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:12.700872 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:12.700934 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:12.701031 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:12.702399 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:12.703079 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:12.704652 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:12.705058 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:12.705152 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:12.709975 (+ 4823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:12.709993 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:12.710009 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:12.710044 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:12.713061 (+ 3017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:12.713728 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:12.713736 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:12.713738 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:12.713859 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:12.714191 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:12.714195 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:12.714197 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:12.714544 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:12.714763 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:12.715097 (+ 334us) server_negotiation.cc:299] Negotiation successful
0808 11:32:12.715273 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398,"thread_start_us":262,"threads_started":1}
I20260808 11:32:12.716295 2683 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:12.855346 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 2549
I20260808 11:32:12.884163 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 2692
Aug 08 11:32:12 dist-test-slave-zkpd krb5kdc[2287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188731, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.66.131@KRBTEST.COM
I20260808 11:32:12.900199 2961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:12.885114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58514 (local address 127.26.66.131:32797)
0808 11:32:12.885690 (+ 576us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:12.885695 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:12.885712 (+ 17us) server_negotiation.cc:407] Connection header received
0808 11:32:12.885768 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:12.885772 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:12.885835 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:12.885931 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:12.887253 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:12.888117 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:12.889374 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:12.889761 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:12.889865 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:12.894595 (+ 4730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:12.894611 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:12.894628 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:12.894669 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:12.897634 (+ 2965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:12.898257 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:12.898264 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:12.898266 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:12.898423 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:12.898755 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:12.898758 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:12.898760 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:12.899113 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:12.899352 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:12.899601 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 11:32:12.899775 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":346,"threads_started":1}
I20260808 11:32:12.900884 2824 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:13.051540 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 2692
I20260808 11:32:13.083015 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 2300
I20260808 11:32:13.084263 2372 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:13.204043 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 2300
2026-08-08T11:32:13Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (7287 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:32:13 dist-test-slave-zkpd krb5kdc[2968](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:32:13 dist-test-slave-zkpd krb5kdc[2968](info): set up 2 sockets
Aug 08 11:32:13 dist-test-slave-zkpd krb5kdc[2968](info): commencing operation
krb5kdc: starting...
W20260808 11:32:14.354458 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.000s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:32:14 dist-test-slave-zkpd krb5kdc[2968](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188734, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:32:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:32:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:32:14.620815 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:36291
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:36939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:36291
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:32:14.948192 2981 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:14.948442 2981 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:14.948614 2981 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:14.955588 2981 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:32:14.955709 2981 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:14.955807 2981 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:14.955925 2981 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:32:14.956012 2981 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:32:14.965389 2981 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:36939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:36291
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:36291
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:14.966964 2981 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:14.968931 2981 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:14.983788 2986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:14.983762 2987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:14.984264 2989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:14.985307 2981 server_base.cc:1034] running on GCE node
I20260808 11:32:14.986301 2981 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:14.988298 2981 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:14.989554 2981 hybrid_clock.cc:648] HybridClock initialized: now 1786188734989466 us; error 92 us; skew 500 ppm
I20260808 11:32:14.990016 2981 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T11:32:15Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1861 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:32:15 dist-test-slave-zkpd krb5kdc[2995](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:32:15 dist-test-slave-zkpd krb5kdc[2995](info): set up 2 sockets
Aug 08 11:32:15 dist-test-slave-zkpd krb5kdc[2995](info): commencing operation
krb5kdc: starting...
W20260808 11:32:16.214386 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.099s user 0.005s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:32:16 dist-test-slave-zkpd krb5kdc[2995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:32:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:32:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:32:16.489542 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:45603
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:45603
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:32:16.820830 3008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:16.821094 3008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:16.821285 3008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:16.828332 3008 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:32:16.828426 3008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:16.828557 3008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:16.828650 3008 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:32:16.828727 3008 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:32:16.838739 3008 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:45603
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:45603
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:16.839975 3008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:16.841240 3008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:16.852963 3015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:16.852994 3017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:16.853083 3014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:16.854035 3008 server_base.cc:1034] running on GCE node
I20260808 11:32:16.854714 3008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:16.856074 3008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:16.857275 3008 hybrid_clock.cc:648] HybridClock initialized: now 1786188736857238 us; error 30 us; skew 500 ppm
I20260808 11:32:16.857564 3008 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:32:16 dist-test-slave-zkpd krb5kdc[2995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188736, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:32:16.865854 3008 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:32:16.867221 3008 webserver.cc:460] Webserver started at http://127.26.66.190:40421/ using document root <none> and password file <none>
I20260808 11:32:16.867856 3008 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:16.868039 3008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:16.868319 3008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:32:16.871188 3008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "09cd39b498e941ce9e1095e3549c04c9"
format_stamp: "Formatted at 2026-08-08 11:32:16 on dist-test-slave-zkpd"
server_key: "813f4731baa8c319a8afeda530ff9c63"
server_key_iv: "4dda49d7abc81992c46ae38cdd896723"
server_key_version: "encryptionkey@0"
I20260808 11:32:16.871876 3008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "09cd39b498e941ce9e1095e3549c04c9"
format_stamp: "Formatted at 2026-08-08 11:32:16 on dist-test-slave-zkpd"
server_key: "813f4731baa8c319a8afeda530ff9c63"
server_key_iv: "4dda49d7abc81992c46ae38cdd896723"
server_key_version: "encryptionkey@0"
I20260808 11:32:16.877161 3008 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 11:32:16.880503 3024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:16.881724 3008 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260808 11:32:16.881863 3008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "09cd39b498e941ce9e1095e3549c04c9"
format_stamp: "Formatted at 2026-08-08 11:32:16 on dist-test-slave-zkpd"
server_key: "813f4731baa8c319a8afeda530ff9c63"
server_key_iv: "4dda49d7abc81992c46ae38cdd896723"
server_key_version: "encryptionkey@0"
I20260808 11:32:16.882015 3008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:16.893530 3008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:16.897207 3008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:16.897436 3008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:16.915606 3008 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:45603
I20260808 11:32:16.915638 3076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:45603 every 8 connection(s)
I20260808 11:32:16.916923 3008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:32:16.920603 3077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:16.924401 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 3008
I20260808 11:32:16.924641 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:32:16.925473 26890 external_mini_cluster.cc:1428] Setting key ab156d1b9082e9338285c78f1ad5b649
I20260808 11:32:16.934064 3077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9: Bootstrap starting.
I20260808 11:32:16.937853 3077 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:16.939210 3077 log.cc:824] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9: Log is configured to *not* fsync() on all Append() calls
Aug 08 11:32:16 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:32:16.942287 3077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9: No bootstrap required, opened a new log
I20260808 11:32:16.948503 3080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:16.927512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54184 (local address 127.26.66.190:45603)
0808 11:32:16.928291 (+ 779us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:16.928301 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:16.928341 (+ 40us) server_negotiation.cc:407] Connection header received
0808 11:32:16.929881 (+ 1540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:16.929902 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:16.930295 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:16.930611 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:16.932497 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:16.933752 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:16.935533 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:16.936280 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:16.936421 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:16.941361 (+ 4940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:16.941368 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:16.941382 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:16.941414 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:16.944558 (+ 3144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:16.945218 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:16.945230 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:16.945235 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:16.945411 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:16.945809 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:16.945817 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:16.945821 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:16.946316 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:16.946655 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:16.947056 (+ 401us) server_negotiation.cc:299] Negotiation successful
0808 11:32:16.947482 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":588,"thread_start_us":399,"threads_started":1}
I20260808 11:32:16.950227 3077 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd39b498e941ce9e1095e3549c04c9" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45603 } }
I20260808 11:32:16.950584 3077 raft_consensus.cc:374] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:16.950730 3077 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09cd39b498e941ce9e1095e3549c04c9, State: Initialized, Role: FOLLOWER
I20260808 11:32:16.951324 3077 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd39b498e941ce9e1095e3549c04c9" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45603 } }
I20260808 11:32:16.951596 3077 raft_consensus.cc:388] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:32:16.951736 3077 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:32:16.951965 3077 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:16.954025 3077 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd39b498e941ce9e1095e3549c04c9" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45603 } }
I20260808 11:32:16.954501 3077 leader_election.cc:302] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09cd39b498e941ce9e1095e3549c04c9; no voters:
I20260808 11:32:16.955106 3077 leader_election.cc:288] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:32:16.955233 3082 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:32:16.955950 3082 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [term 1 LEADER]: Becoming Leader. State: Replica: 09cd39b498e941ce9e1095e3549c04c9, State: Running, Role: LEADER
I20260808 11:32:16.956506 3082 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd39b498e941ce9e1095e3549c04c9" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45603 } }
I20260808 11:32:16.957278 3077 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:32:16.959506 3084 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09cd39b498e941ce9e1095e3549c04c9. Latest consensus state: current_term: 1 leader_uuid: "09cd39b498e941ce9e1095e3549c04c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd39b498e941ce9e1095e3549c04c9" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45603 } } }
I20260808 11:32:16.959479 3083 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "09cd39b498e941ce9e1095e3549c04c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd39b498e941ce9e1095e3549c04c9" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45603 } } }
I20260808 11:32:16.959971 3084 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [sys.catalog]: This master's current role is: LEADER
I20260808 11:32:16.960072 3083 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [sys.catalog]: This master's current role is: LEADER
I20260808 11:32:16.961555 3088 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:32:16.966832 3088 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:32:16.977756 3088 catalog_manager.cc:1347] Generated new cluster ID: 34c8d4c52a2b456d8de71487825ca548
I20260808 11:32:16.977869 3088 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:32:16.997252 3088 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:32:16.999086 3088 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:32:17.013195 3088 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9: Generated new TSK 0
I20260808 11:32:17.014245 3088 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.66.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
I20260808 11:32:17.080003 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:0
--local_ip_for_outbound_sockets=127.26.66.129
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45603
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:32:17.419341 3103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:17.419651 3103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:17.419821 3103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:17.426795 3103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:17.426939 3103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:17.427145 3103 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:32:17.436384 3103 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45603
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:17.437569 3103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:17.438875 3103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:17.451625 3111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:17.451678 3109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:17.451721 3108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:17.452508 3103 server_base.cc:1034] running on GCE node
I20260808 11:32:17.453042 3103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:17.454005 3103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:17.455324 3103 hybrid_clock.cc:648] HybridClock initialized: now 1786188737455282 us; error 53 us; skew 500 ppm
I20260808 11:32:17.455686 3103 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:32:17 dist-test-slave-zkpd krb5kdc[2995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188737, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:32:17.460012 3103 init.cc:377] Logged in from keytab as kudu/127.26.66.129@KRBTEST.COM (short username kudu)
I20260808 11:32:17.464490 3103 webserver.cc:460] Webserver started at http://127.26.66.129:34003/ using document root <none> and password file <none>
I20260808 11:32:17.465380 3103 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:17.465556 3103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:17.465981 3103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:32:17.469053 3103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/data/instance:
uuid: "9a603aae24c547ada49fd2d3e9ff5ced"
format_stamp: "Formatted at 2026-08-08 11:32:17 on dist-test-slave-zkpd"
server_key: "5a75c8a35445d47c0493afa803cd7c10"
server_key_iv: "bdc33e5ae0cdf82bd68c5d834841b9c1"
server_key_version: "encryptionkey@0"
I20260808 11:32:17.469831 3103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance:
uuid: "9a603aae24c547ada49fd2d3e9ff5ced"
format_stamp: "Formatted at 2026-08-08 11:32:17 on dist-test-slave-zkpd"
server_key: "5a75c8a35445d47c0493afa803cd7c10"
server_key_iv: "bdc33e5ae0cdf82bd68c5d834841b9c1"
server_key_version: "encryptionkey@0"
I20260808 11:32:17.475440 3103 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 11:32:17.478961 3118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:17.480408 3103 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:32:17.480574 3103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "9a603aae24c547ada49fd2d3e9ff5ced"
format_stamp: "Formatted at 2026-08-08 11:32:17 on dist-test-slave-zkpd"
server_key: "5a75c8a35445d47c0493afa803cd7c10"
server_key_iv: "bdc33e5ae0cdf82bd68c5d834841b9c1"
server_key_version: "encryptionkey@0"
I20260808 11:32:17.480794 3103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:17.502807 3103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:17.506476 3103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:17.506753 3103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:17.507666 3103 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:32:17.509034 3103 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:32:17.509130 3103 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:17.509301 3103 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:32:17.509393 3103 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:17.542987 3103 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:33315
I20260808 11:32:17.543072 3231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:33315 every 8 connection(s)
I20260808 11:32:17.544358 3103 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:32:17.546840 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 3103
I20260808 11:32:17.547065 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance
I20260808 11:32:17.548117 26890 external_mini_cluster.cc:1428] Setting key 705fe2897e6ffe562eb9858229e7563a
Aug 08 11:32:17 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188737, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:32:17.565250 3234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:17.547024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:53461 (local address 127.26.66.190:45603)
0808 11:32:17.547692 (+ 668us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:17.547696 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:17.548750 (+ 1054us) server_negotiation.cc:407] Connection header received
0808 11:32:17.550847 (+ 2097us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:17.550851 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:17.550936 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:17.551064 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:17.552640 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:17.553368 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:17.554896 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:17.555307 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:17.555445 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:17.558978 (+ 3533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:17.558988 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:17.558991 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:17.559021 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:17.561861 (+ 2840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:17.562595 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:17.562601 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:17.562607 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:17.562776 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:17.563192 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:17.563199 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:17.563205 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:17.563581 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:17.563742 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:17.564499 (+ 757us) server_negotiation.cc:299] Negotiation successful
0808 11:32:17.564757 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":417,"threads_started":1}
I20260808 11:32:17.565840 3235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:17.547709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.129:53461)
0808 11:32:17.548588 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:17.548625 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:17.550574 (+ 1949us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:17.551297 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:17.551305 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:17.551865 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:17.552462 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:17.552484 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:17.553537 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:17.553541 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:17.554740 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:17.554751 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:17.555544 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:17.555553 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:17.555791 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:17.556555 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:17.556577 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:17.558758 (+ 2181us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:17.562010 (+ 3252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:17.562017 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:17.562028 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:17.562446 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:17.562887 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:17.562890 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:17.562892 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:17.563072 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:17.563719 (+ 647us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:17.563724 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:17.564111 (+ 387us) client_negotiation.cc:769] Sending connection context
0808 11:32:17.564344 (+ 233us) client_negotiation.cc:240] Negotiation successful
0808 11:32:17.564720 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":360,"threads_started":1}
I20260808 11:32:17.567420 3232 heartbeater.cc:347] Connected to a master server at 127.26.66.190:45603
I20260808 11:32:17.567741 3232 heartbeater.cc:464] Registering TS with master...
I20260808 11:32:17.568504 3232 heartbeater.cc:511] Master 127.26.66.190:45603 requested a full tablet report, sending...
I20260808 11:32:17.570561 3042 ts_manager.cc:194] Registered new tserver with Master: 9a603aae24c547ada49fd2d3e9ff5ced (127.26.66.129:33315)
I20260808 11:32:17.572217 3042 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.129@KRBTEST.COM'} at 127.26.66.129:53461
WARNING: no policy specified for kudu/127.26.66.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
I20260808 11:32:17.610567 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:0
--local_ip_for_outbound_sockets=127.26.66.130
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45603
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:32:17.947078 3238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:17.947353 3238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:17.947530 3238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:17.954939 3238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:17.955050 3238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:17.955210 3238 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:32:17.965056 3238 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45603
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:17.966307 3238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:17.967581 3238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:17.980506 3246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:17.980574 3243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:17.980597 3244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:17.981333 3238 server_base.cc:1034] running on GCE node
I20260808 11:32:17.981914 3238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:17.982817 3238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:17.984032 3238 hybrid_clock.cc:648] HybridClock initialized: now 1786188737983989 us; error 56 us; skew 500 ppm
I20260808 11:32:17.984391 3238 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:32:17 dist-test-slave-zkpd krb5kdc[2995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188737, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:32:17.987715 3238 init.cc:377] Logged in from keytab as kudu/127.26.66.130@KRBTEST.COM (short username kudu)
I20260808 11:32:17.989181 3238 webserver.cc:460] Webserver started at http://127.26.66.130:34977/ using document root <none> and password file <none>
I20260808 11:32:17.989861 3238 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:17.990003 3238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:17.990317 3238 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:32:17.993152 3238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/data/instance:
uuid: "f1860db697284620bd76d38a3ad4bc7b"
format_stamp: "Formatted at 2026-08-08 11:32:17 on dist-test-slave-zkpd"
server_key: "2e7f18dd24d274c1141e21563fcc9ca7"
server_key_iv: "a54680a4ffef66a0a2bc24f80d20bf05"
server_key_version: "encryptionkey@0"
I20260808 11:32:17.993963 3238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance:
uuid: "f1860db697284620bd76d38a3ad4bc7b"
format_stamp: "Formatted at 2026-08-08 11:32:17 on dist-test-slave-zkpd"
server_key: "2e7f18dd24d274c1141e21563fcc9ca7"
server_key_iv: "a54680a4ffef66a0a2bc24f80d20bf05"
server_key_version: "encryptionkey@0"
I20260808 11:32:17.998901 3238 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260808 11:32:18.002245 3253 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:18.003468 3238 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 11:32:18.003644 3238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "f1860db697284620bd76d38a3ad4bc7b"
format_stamp: "Formatted at 2026-08-08 11:32:17 on dist-test-slave-zkpd"
server_key: "2e7f18dd24d274c1141e21563fcc9ca7"
server_key_iv: "a54680a4ffef66a0a2bc24f80d20bf05"
server_key_version: "encryptionkey@0"
I20260808 11:32:18.003837 3238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:18.015654 3238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:18.019852 3238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:18.020184 3238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:18.021081 3238 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:32:18.022338 3238 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:32:18.022441 3238 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:18.022585 3238 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:32:18.022657 3238 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:18.056238 3238 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:35755
I20260808 11:32:18.056295 3367 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:35755 every 8 connection(s)
I20260808 11:32:18.057524 3238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:32:18.065603 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 3238
I20260808 11:32:18.065804 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance
I20260808 11:32:18.066349 26890 external_mini_cluster.cc:1428] Setting key 045532f70ef85eeb3e340b7c15e6b68d
Aug 08 11:32:18 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188737, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:32:18.079468 3234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:18.060255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:52413 (local address 127.26.66.190:45603)
0808 11:32:18.060452 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:18.060456 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:18.061743 (+ 1287us) server_negotiation.cc:407] Connection header received
0808 11:32:18.063548 (+ 1805us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:18.063552 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:18.063623 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:18.063719 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:18.065235 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:18.066353 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:18.068400 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:18.068907 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:18.069013 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:18.073361 (+ 4348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:18.073366 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:18.073369 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:18.073399 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:18.076421 (+ 3022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:18.077180 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:18.077185 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:18.077187 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:18.077317 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:18.077755 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:18.077762 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:18.077770 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:18.078041 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:18.078200 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:18.078884 (+ 684us) server_negotiation.cc:299] Negotiation successful
0808 11:32:18.079122 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 11:32:18.080467 3370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:18.060738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.130:52413)
0808 11:32:18.061566 (+ 828us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:18.061620 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:18.063300 (+ 1680us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:18.063965 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:18.063972 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:18.064503 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:18.065052 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:18.065069 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:18.066563 (+ 1494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:18.066568 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:18.068200 (+ 1632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:18.068225 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:18.069141 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:18.069148 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:18.069478 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:18.070221 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:18.070254 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:18.073136 (+ 2882us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:18.076571 (+ 3435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:18.076580 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:18.076594 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:18.077043 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:18.077431 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:18.077436 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:18.077439 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:18.077627 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:18.078175 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:18.078183 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:18.078495 (+ 312us) client_negotiation.cc:769] Sending connection context
0808 11:32:18.078775 (+ 280us) client_negotiation.cc:240] Negotiation successful
0808 11:32:18.079266 (+ 491us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":337,"threads_started":1}
I20260808 11:32:18.081892 3368 heartbeater.cc:347] Connected to a master server at 127.26.66.190:45603
I20260808 11:32:18.082212 3368 heartbeater.cc:464] Registering TS with master...
I20260808 11:32:18.083056 3368 heartbeater.cc:511] Master 127.26.66.190:45603 requested a full tablet report, sending...
I20260808 11:32:18.084664 3042 ts_manager.cc:194] Registered new tserver with Master: f1860db697284620bd76d38a3ad4bc7b (127.26.66.130:35755)
I20260808 11:32:18.085598 3042 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.130@KRBTEST.COM'} at 127.26.66.130:52413
WARNING: no policy specified for kudu/127.26.66.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
I20260808 11:32:18.131132 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:0
--local_ip_for_outbound_sockets=127.26.66.131
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45603
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:32:18.475837 3373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:18.476190 3373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:18.476392 3373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:18.483467 3373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:18.483610 3373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:18.483809 3373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:32:18.493574 3373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45603
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:18.494860 3373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:18.496446 3373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:18.509640 3378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:18.509560 3381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:18.509673 3379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:18.510325 3373 server_base.cc:1034] running on GCE node
I20260808 11:32:18.510986 3373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:18.511955 3373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:18.513195 3373 hybrid_clock.cc:648] HybridClock initialized: now 1786188738513156 us; error 51 us; skew 500 ppm
I20260808 11:32:18.513525 3373 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:32:18 dist-test-slave-zkpd krb5kdc[2995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188738, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:32:18.516661 3373 init.cc:377] Logged in from keytab as kudu/127.26.66.131@KRBTEST.COM (short username kudu)
I20260808 11:32:18.518091 3373 webserver.cc:460] Webserver started at http://127.26.66.131:36163/ using document root <none> and password file <none>
I20260808 11:32:18.518772 3373 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:18.518923 3373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:18.519248 3373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:32:18.522364 3373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/data/instance:
uuid: "9d55655a95d449cdb98246c2eafcf534"
format_stamp: "Formatted at 2026-08-08 11:32:18 on dist-test-slave-zkpd"
server_key: "d02624bcd15d84d0e49d2779879f7fac"
server_key_iv: "28e188c19640f2f331bea27e3484f9ba"
server_key_version: "encryptionkey@0"
I20260808 11:32:18.523222 3373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance:
uuid: "9d55655a95d449cdb98246c2eafcf534"
format_stamp: "Formatted at 2026-08-08 11:32:18 on dist-test-slave-zkpd"
server_key: "d02624bcd15d84d0e49d2779879f7fac"
server_key_iv: "28e188c19640f2f331bea27e3484f9ba"
server_key_version: "encryptionkey@0"
I20260808 11:32:18.528653 3373 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 11:32:18.532173 3388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:18.533496 3373 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 11:32:18.533670 3373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "9d55655a95d449cdb98246c2eafcf534"
format_stamp: "Formatted at 2026-08-08 11:32:18 on dist-test-slave-zkpd"
server_key: "d02624bcd15d84d0e49d2779879f7fac"
server_key_iv: "28e188c19640f2f331bea27e3484f9ba"
server_key_version: "encryptionkey@0"
I20260808 11:32:18.533901 3373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:18.560985 3373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:18.565255 3373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:18.565583 3373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:18.566596 3373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:32:18.568056 3373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:32:18.568161 3373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:18.568320 3373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:32:18.568395 3373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:18.575277 3232 heartbeater.cc:503] Master 127.26.66.190:45603 was elected leader, sending a full tablet report...
I20260808 11:32:18.603731 3373 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:33057
I20260808 11:32:18.603782 3501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:33057 every 8 connection(s)
I20260808 11:32:18.605057 3373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:32:18.608793 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 3373
I20260808 11:32:18.609025 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance
I20260808 11:32:18.609616 26890 external_mini_cluster.cc:1428] Setting key fa0c0e96fb77aefaceb70d53adb55586
Aug 08 11:32:18 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188738, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:32:18.626216 3504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:18.607740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:35007 (local address 127.26.66.190:45603)
0808 11:32:18.608313 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:18.608320 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:18.609407 (+ 1087us) server_negotiation.cc:407] Connection header received
0808 11:32:18.612034 (+ 2627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:18.612042 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:18.612140 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:18.612254 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:18.613968 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:18.614782 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:18.616362 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:18.616751 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:18.616853 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:18.620167 (+ 3314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:18.620171 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:18.620175 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:18.620207 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:18.622865 (+ 2658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:18.623650 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:18.623657 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:18.623660 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:18.623828 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:18.624414 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:18.624419 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:18.624422 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:18.624796 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:18.624927 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:18.625783 (+ 856us) server_negotiation.cc:299] Negotiation successful
0808 11:32:18.625948 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":309,"threads_started":1}
I20260808 11:32:18.627156 3505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:18.608353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.131:35007)
0808 11:32:18.609207 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:18.609267 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:18.611636 (+ 2369us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:18.612468 (+ 832us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:18.612475 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:18.613225 (+ 750us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:18.613811 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:18.613831 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:18.614923 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:18.614928 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:18.616234 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:18.616252 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:18.616946 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:18.616950 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:18.617138 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:18.617765 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:18.617786 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:18.619966 (+ 2180us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:18.623010 (+ 3044us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:18.623019 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:18.623034 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:18.623486 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:18.623990 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:18.623996 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:18.624001 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:18.624280 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:18.624943 (+ 663us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:18.624951 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:18.625438 (+ 487us) client_negotiation.cc:769] Sending connection context
0808 11:32:18.625668 (+ 230us) client_negotiation.cc:240] Negotiation successful
0808 11:32:18.626034 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":304,"threads_started":1}
I20260808 11:32:18.628630 3502 heartbeater.cc:347] Connected to a master server at 127.26.66.190:45603
I20260808 11:32:18.628962 3502 heartbeater.cc:464] Registering TS with master...
I20260808 11:32:18.629645 3502 heartbeater.cc:511] Master 127.26.66.190:45603 requested a full tablet report, sending...
I20260808 11:32:18.631008 3042 ts_manager.cc:194] Registered new tserver with Master: 9d55655a95d449cdb98246c2eafcf534 (127.26.66.131:33057)
I20260808 11:32:18.631757 3042 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.131@KRBTEST.COM'} at 127.26.66.131:35007
I20260808 11:32:18.637364 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.26.66.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.66.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.66.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.129.keytab.
Entry for principal oryx/127.26.66.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.129.keytab.
WARNING: no policy specified for oryx/127.26.66.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.66.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.66.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.130.keytab.
Entry for principal oryx/127.26.66.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.130.keytab.
WARNING: no policy specified for oryx/127.26.66.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.66.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.66.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.131.keytab.
Entry for principal oryx/127.26.66.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.131.keytab.
I20260808 11:32:18.806576 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 3103
Aug 08 11:32:18 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.129@KRBTEST.COM
I20260808 11:32:18.823325 3513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:18.807949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59416 (local address 127.26.66.129:33315)
0808 11:32:18.808647 (+ 698us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:18.808654 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:18.808683 (+ 29us) server_negotiation.cc:407] Connection header received
0808 11:32:18.808753 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:18.808759 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:18.808968 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:18.809125 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:18.810497 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:18.811527 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:18.812803 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:18.813364 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:18.813460 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:18.817550 (+ 4090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:18.817563 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:18.817577 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:18.817607 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:18.820369 (+ 2762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:18.821011 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:18.821017 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:18.821019 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:18.821229 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:18.821727 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:18.821731 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:18.821733 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:18.822073 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:18.822392 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:18.822705 (+ 313us) server_negotiation.cc:299] Negotiation successful
0808 11:32:18.822969 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":527,"thread_start_us":351,"threads_started":1}
I20260808 11:32:18.824697 3227 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:18.908981 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 3103
I20260808 11:32:18.934517 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 3238
Aug 08 11:32:18 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.130@KRBTEST.COM
I20260808 11:32:18.950445 3515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:18.935462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49094 (local address 127.26.66.130:35755)
0808 11:32:18.936358 (+ 896us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:18.936365 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:18.936390 (+ 25us) server_negotiation.cc:407] Connection header received
0808 11:32:18.936449 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:18.936456 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:18.936683 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:18.936856 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:18.938223 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:18.939219 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:18.940671 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:18.941247 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:18.941357 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:18.945370 (+ 4013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:18.945382 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:18.945395 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:18.945433 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:18.948028 (+ 2595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:18.948625 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:18.948632 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:18.948634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:18.948759 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:18.949078 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:18.949081 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:18.949083 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:18.949402 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:18.949623 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:18.949853 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 11:32:18.950043 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":731,"thread_start_us":610,"threads_started":1}
I20260808 11:32:18.951700 3363 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:19.038158 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 3238
I20260808 11:32:19.060603 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 3373
Aug 08 11:32:19 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.131@KRBTEST.COM
I20260808 11:32:19.077311 3517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:19.061671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49552 (local address 127.26.66.131:33057)
0808 11:32:19.062185 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:19.062192 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:19.062234 (+ 42us) server_negotiation.cc:407] Connection header received
0808 11:32:19.062293 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:19.062299 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:19.062505 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:19.062638 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:19.064060 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:19.065208 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:19.066559 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:19.067203 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:19.067328 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:19.071821 (+ 4493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:19.071833 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:19.071848 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:19.071881 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:19.074735 (+ 2854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:19.075325 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:19.075332 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:19.075334 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:19.075458 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:19.075767 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:19.075770 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:19.075772 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:19.076380 (+ 608us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:19.076600 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:19.076840 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 11:32:19.077039 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":223,"threads_started":1}
I20260808 11:32:19.078686 3497 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:19.162919 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 3373
I20260808 11:32:19.184257 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 3008
I20260808 11:32:19.185478 3072 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:19.292908 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 3008
I20260808 11:32:19.317956 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:45603
--webserver_interface=127.26.66.190
--webserver_port=40421
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:45603
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:32:19.659039 3520 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:19.659305 3520 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:19.659471 3520 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:19.666641 3520 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:32:19.666740 3520 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:19.666860 3520 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:19.666951 3520 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:32:19.667038 3520 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:32:19.676826 3520 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:45603
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:45603
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=40421
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:19.678158 3520 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:19.679461 3520 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:19.691239 3526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:19.691269 3528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:19.691303 3525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:19.692101 3520 server_base.cc:1034] running on GCE node
I20260808 11:32:19.692904 3520 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:19.694327 3520 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:19.695560 3520 hybrid_clock.cc:648] HybridClock initialized: now 1786188739695512 us; error 63 us; skew 500 ppm
I20260808 11:32:19.695966 3520 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:32:19 dist-test-slave-zkpd krb5kdc[2995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188739, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:32:19.698973 3520 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:32:19.700443 3520 webserver.cc:460] Webserver started at http://127.26.66.190:40421/ using document root <none> and password file <none>
I20260808 11:32:19.701076 3520 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:19.701190 3520 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:19.706485 3520 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 11:32:19.709179 3535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:19.710462 3520 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:32:19.710635 3520 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "09cd39b498e941ce9e1095e3549c04c9"
format_stamp: "Formatted at 2026-08-08 11:32:16 on dist-test-slave-zkpd"
server_key: "813f4731baa8c319a8afeda530ff9c63"
server_key_iv: "4dda49d7abc81992c46ae38cdd896723"
server_key_version: "encryptionkey@0"
I20260808 11:32:19.711591 3520 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:19.733651 3520 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:19.737535 3520 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:19.737816 3520 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:19.756543 3520 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:45603
I20260808 11:32:19.756570 3587 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:45603 every 8 connection(s)
I20260808 11:32:19.758000 3520 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:32:19.764693 3588 sys_catalog.cc:263] Verifying existing consensus state
I20260808 11:32:19.765452 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 3520
I20260808 11:32:19.766441 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:33315
--local_ip_for_outbound_sockets=127.26.66.129
--tserver_master_addrs=127.26.66.190:45603
--webserver_port=34003
--webserver_interface=127.26.66.129
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.66.129
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 11:32:19.769622 3588 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9: Bootstrap starting.
I20260808 11:32:19.791471 3588 log.cc:824] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9: Log is configured to *not* fsync() on all Append() calls
I20260808 11:32:19.800652 3588 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 11:32:19.801223 3588 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9: Bootstrap complete.
I20260808 11:32:19.810698 3588 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd39b498e941ce9e1095e3549c04c9" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45603 } }
I20260808 11:32:19.811638 3588 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09cd39b498e941ce9e1095e3549c04c9, State: Initialized, Role: FOLLOWER
I20260808 11:32:19.812366 3588 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd39b498e941ce9e1095e3549c04c9" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45603 } }
I20260808 11:32:19.812613 3588 raft_consensus.cc:388] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:32:19.812736 3588 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:32:19.812928 3588 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [term 1 FOLLOWER]: Advancing to term 2
I20260808 11:32:19.817131 3588 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd39b498e941ce9e1095e3549c04c9" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45603 } }
I20260808 11:32:19.817623 3588 leader_election.cc:302] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09cd39b498e941ce9e1095e3549c04c9; no voters:
I20260808 11:32:19.818249 3588 leader_election.cc:288] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 11:32:19.818401 3592 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 11:32:19.820701 3588 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:32:19.825542 3592 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [term 2 LEADER]: Becoming Leader. State: Replica: 09cd39b498e941ce9e1095e3549c04c9, State: Running, Role: LEADER
I20260808 11:32:19.826222 3592 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd39b498e941ce9e1095e3549c04c9" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45603 } }
I20260808 11:32:19.829136 3593 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "09cd39b498e941ce9e1095e3549c04c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd39b498e941ce9e1095e3549c04c9" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45603 } } }
I20260808 11:32:19.829571 3593 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [sys.catalog]: This master's current role is: LEADER
I20260808 11:32:19.830164 3594 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09cd39b498e941ce9e1095e3549c04c9. Latest consensus state: current_term: 2 leader_uuid: "09cd39b498e941ce9e1095e3549c04c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd39b498e941ce9e1095e3549c04c9" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45603 } } }
I20260808 11:32:19.830550 3594 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9 [sys.catalog]: This master's current role is: LEADER
I20260808 11:32:19.851917 3603 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:32:19.864468 3603 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:32:19.866707 3603 catalog_manager.cc:1259] Loaded cluster ID: 34c8d4c52a2b456d8de71487825ca548
I20260808 11:32:19.866995 3603 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:32:19.873471 3603 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:32:19.875754 3603 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 09cd39b498e941ce9e1095e3549c04c9: Loaded TSK: 0
I20260808 11:32:19.877756 3603 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 11:32:20.151487 3590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:20.151818 3590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:20.152014 3590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:20.159333 3590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:20.159487 3590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:20.159675 3590 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:32:20.169677 3590 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.129.keytab
--principal=oryx/127.26.66.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:33315
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=34003
--tserver_master_addrs=127.26.66.190:45603
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:20.171082 3590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:20.172523 3590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:20.190176 3617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:20.190599 3619 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:20.191004 3616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:20.191265 3590 server_base.cc:1034] running on GCE node
I20260808 11:32:20.192006 3590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:20.193032 3590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:20.194260 3590 hybrid_clock.cc:648] HybridClock initialized: now 1786188740194204 us; error 49 us; skew 500 ppm
I20260808 11:32:20.194603 3590 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:32:20 dist-test-slave-zkpd krb5kdc[2995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188740, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:32:20.198182 3590 init.cc:377] Logged in from keytab as oryx/127.26.66.129@KRBTEST.COM (short username oryx)
I20260808 11:32:20.200065 3590 webserver.cc:460] Webserver started at http://127.26.66.129:34003/ using document root <none> and password file <none>
I20260808 11:32:20.200961 3590 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:20.201133 3590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:20.208335 3590 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 11:32:20.211751 3626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:20.213429 3590 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:32:20.213596 3590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "9a603aae24c547ada49fd2d3e9ff5ced"
format_stamp: "Formatted at 2026-08-08 11:32:17 on dist-test-slave-zkpd"
server_key: "5a75c8a35445d47c0493afa803cd7c10"
server_key_iv: "bdc33e5ae0cdf82bd68c5d834841b9c1"
server_key_version: "encryptionkey@0"
I20260808 11:32:20.214987 3590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:20.240437 3590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:20.244745 3590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:20.244972 3590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:20.245924 3590 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:32:20.247251 3590 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:32:20.247357 3590 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:20.247442 3590 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:32:20.247498 3590 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:20.283456 3590 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:33315
I20260808 11:32:20.283548 3744 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:33315 every 8 connection(s)
I20260808 11:32:20.285048 3590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:32:20.287621 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 3590
I20260808 11:32:20.288333 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:35755
--local_ip_for_outbound_sockets=127.26.66.130
--tserver_master_addrs=127.26.66.190:45603
--webserver_port=34977
--webserver_interface=127.26.66.130
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.66.130
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 11:32:20 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:20 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
W20260808 11:32:20.640281 3749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:20.640558 3749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:20.640705 3749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:20.647837 3749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:20.648028 3749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:20.648200 3749 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:32:20.657626 3749 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.130.keytab
--principal=oryx/127.26.66.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:35755
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=34977
--tserver_master_addrs=127.26.66.190:45603
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:20.658893 3749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:20.660211 3749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:20.678206 3758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:20.678426 3755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:20.678201 3756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:20.680160 3749 server_base.cc:1034] running on GCE node
I20260808 11:32:20.680830 3749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:20.681850 3749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:20.683176 3749 hybrid_clock.cc:648] HybridClock initialized: now 1786188740683094 us; error 78 us; skew 500 ppm
I20260808 11:32:20.683506 3749 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:32:20 dist-test-slave-zkpd krb5kdc[2995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188740, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:32:20.686794 3749 init.cc:377] Logged in from keytab as oryx/127.26.66.130@KRBTEST.COM (short username oryx)
I20260808 11:32:20.689114 3749 webserver.cc:460] Webserver started at http://127.26.66.130:34977/ using document root <none> and password file <none>
I20260808 11:32:20.689832 3749 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:20.689983 3749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:20.695503 3749 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 11:32:20.698333 3765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:20.699765 3749 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 11:32:20.699985 3749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "f1860db697284620bd76d38a3ad4bc7b"
format_stamp: "Formatted at 2026-08-08 11:32:17 on dist-test-slave-zkpd"
server_key: "2e7f18dd24d274c1141e21563fcc9ca7"
server_key_iv: "a54680a4ffef66a0a2bc24f80d20bf05"
server_key_version: "encryptionkey@0"
I20260808 11:32:20.700943 3749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:20.752871 3749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:20.757493 3749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:20.757790 3749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:20.758941 3749 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:32:20.760520 3749 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:32:20.760643 3749 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:20.760783 3749 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:32:20.760887 3749 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:20.806581 3749 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:35755
I20260808 11:32:20.806782 3880 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:35755 every 8 connection(s)
I20260808 11:32:20.808079 3749 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:32:20.810184 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 3749
I20260808 11:32:20.810789 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:33057
--local_ip_for_outbound_sockets=127.26.66.131
--tserver_master_addrs=127.26.66.190:45603
--webserver_port=36163
--webserver_interface=127.26.66.131
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.66.131
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 11:32:20 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:20 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
W20260808 11:32:21.491258 3885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:21.491632 3885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:21.491861 3885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:21.503631 3885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:21.503779 3885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:21.504032 3885 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:32:21.520651 3885 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/krb5kdc/oryx_127.26.66.131.keytab
--principal=oryx/127.26.66.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:33057
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=36163
--tserver_master_addrs=127.26.66.190:45603
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:21.522341 3885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:21.524312 3885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:21.546629 3892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:21.546706 3891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:21.553064 3885 server_base.cc:1034] running on GCE node
W20260808 11:32:21.553597 3894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:21.554768 3885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:21.556500 3885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:21.557962 3885 hybrid_clock.cc:648] HybridClock initialized: now 1786188741557879 us; error 51 us; skew 500 ppm
I20260808 11:32:21.558537 3885 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:32:21 dist-test-slave-zkpd krb5kdc[2995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188741, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.66.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:32:21.564456 3885 init.cc:377] Logged in from keytab as oryx/127.26.66.131@KRBTEST.COM (short username oryx)
I20260808 11:32:21.567108 3885 webserver.cc:460] Webserver started at http://127.26.66.131:36163/ using document root <none> and password file <none>
W20260808 11:32:21.567479 3748 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.265s user 0.005s sys 0.010s
I20260808 11:32:21.568560 3885 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:21.568826 3885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:21.569435 3748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:20.288651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.129:50953)
0808 11:32:20.290057 (+ 1406us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:20.290113 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:20.292863 (+ 2750us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:20.294504 (+ 1641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:20.294517 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:20.295331 (+ 814us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:20.296172 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:20.296201 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:20.297710 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:20.297718 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:20.299895 (+ 2177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:20.299935 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:20.301231 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:20.301236 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:20.301439 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:20.302123 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:20.302145 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:21.568323 (+1266178us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1048,"thread_start_us":814,"threads_started":1}
W20260808 11:32:21.569581 3747 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:20.288493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:50953 (local address 127.26.66.190:45603)
0808 11:32:20.289377 (+ 884us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:20.289395 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:20.290294 (+ 899us) server_negotiation.cc:407] Connection header received
0808 11:32:20.293562 (+ 3268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:20.293582 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:20.293971 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:20.294275 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:20.296377 (+ 2102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:20.297544 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:20.300073 (+ 2529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:20.300985 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:20.301199 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:21.568754 (+1267555us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.129:50953: BlockingRecv error: recv got EOF from 127.26.66.129:50953 (error 108)
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":324,"threads_started":1}
W20260808 11:32:21.570753 3745 heartbeater.cc:644] Failed to heartbeat to 127.26.66.190:45603 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.66.190:45603: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Aug 08 11:32:21 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:21.578683 3885 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.005s sys 0.000s
Aug 08 11:32:21 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:21.581928 3748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:21.571492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.129:41147)
0808 11:32:21.571760 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:21.571779 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:21.571926 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:21.572289 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:21.572293 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:21.572670 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:21.572838 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:21.572846 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:21.573887 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:21.573893 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:21.574827 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:21.574839 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:21.575556 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:21.575562 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:21.575732 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:21.576392 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:21.576410 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:21.581491 (+ 5081us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149}
W20260808 11:32:21.582099 3747 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:21.571585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:41147 (local address 127.26.66.190:45603)
0808 11:32:21.571761 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:21.571768 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:21.571855 (+ 87us) server_negotiation.cc:407] Connection header received
0808 11:32:21.572071 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:21.572076 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:21.572148 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:21.572260 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:21.572985 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:21.573740 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:21.574979 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:21.575373 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:21.575510 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:21.581767 (+ 6257us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.129:41147: BlockingRecv error: recv got EOF from 127.26.66.129:41147 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 11:32:21.583583 3901 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:21.586666 3885 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.004s sys 0.000s
I20260808 11:32:21.586906 3885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "9d55655a95d449cdb98246c2eafcf534"
format_stamp: "Formatted at 2026-08-08 11:32:18 on dist-test-slave-zkpd"
server_key: "d02624bcd15d84d0e49d2779879f7fac"
server_key_iv: "28e188c19640f2f331bea27e3484f9ba"
server_key_version: "encryptionkey@0"
Aug 08 11:32:21 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:21.589749 3885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 08 11:32:21 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
W20260808 11:32:21.592519 3747 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:21.583159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:48943 (local address 127.26.66.190:45603)
0808 11:32:21.583366 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:21.583374 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:21.583393 (+ 19us) server_negotiation.cc:407] Connection header received
0808 11:32:21.583439 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:21.583444 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:21.583526 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:21.583629 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:21.584367 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:21.585245 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:21.586542 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:21.587033 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:21.587165 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:21.592273 (+ 5108us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.129:48943: BlockingRecv error: recv got EOF from 127.26.66.129:48943 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 11:32:21.593118 3748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:21.583036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.129:48943)
0808 11:32:21.583196 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:21.583222 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:21.583318 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:21.583663 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:21.583669 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:21.584063 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:21.584227 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:21.584236 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:21.585392 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:21.585397 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:21.586393 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:21.586404 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:21.587186 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:21.587192 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:21.587377 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:21.588018 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:21.588034 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:21.592866 (+ 4832us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 11:32:21.593513 3745 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 11:32:21.632354 3885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:21.636999 3885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:21.637324 3885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:21.638454 3885 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:32:21.639997 3885 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:32:21.640116 3885 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:21.640251 3885 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:32:21.640349 3885 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:21.680356 3885 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:33057
I20260808 11:32:21.680423 4015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:33057 every 8 connection(s)
I20260808 11:32:21.681815 3885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:32:21.682616 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 3885
I20260808 11:32:21.708406 3747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:21.684337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50544 (local address 127.26.66.190:45603)
0808 11:32:21.684575 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:21.684584 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:21.692934 (+ 8350us) server_negotiation.cc:407] Connection header received
0808 11:32:21.693146 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:21.693152 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:21.693235 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:21.693348 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:21.695045 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:21.695999 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:21.697512 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:21.698176 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:21.698307 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:21.701096 (+ 2789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:21.701105 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:21.701118 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:21.701155 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:21.704585 (+ 3430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:21.705302 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:21.705311 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:21.705326 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:21.705489 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:21.705956 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:21.705960 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:21.705962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:21.706684 (+ 722us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:21.707030 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:21.707651 (+ 621us) server_negotiation.cc:299] Negotiation successful
0808 11:32:21.708034 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":81}
Aug 08 11:32:21 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:21 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
W20260808 11:32:22.004905 3884 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.168s user 0.004s sys 0.012s
W20260808 11:32:22.006584 3883 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:20.811809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:54281 (local address 127.26.66.190:45603)
0808 11:32:20.830207 (+ 18398us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:20.830212 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:20.830230 (+ 18us) server_negotiation.cc:407] Connection header received
0808 11:32:20.830285 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:20.830288 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:20.830347 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:20.830514 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:20.832316 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:20.833111 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:20.834731 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:20.835156 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:20.835297 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:22.006310 (+1171013us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.130:54281: BlockingRecv error: recv got EOF from 127.26.66.130:54281 (error 108)
Metrics: {"server-negotiator.queue_time_us":18265,"thread_start_us":18801,"threads_started":1}
I20260808 11:32:22.007967 3884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:20.812265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.130:54281)
0808 11:32:20.824888 (+ 12623us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:20.824969 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:20.828778 (+ 3809us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:20.830822 (+ 2044us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:20.830833 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:20.831410 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:20.832104 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:20.832125 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:20.833287 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:20.833298 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:20.834568 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:20.834581 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:20.835417 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:20.835425 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:20.835660 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:20.836443 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:20.836466 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:22.006212 (+1169746us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":12124,"thread_start_us":11785,"threads_started":1}
W20260808 11:32:22.008952 3881 heartbeater.cc:644] Failed to heartbeat to 127.26.66.190:45603 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.66.190:45603: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Aug 08 11:32:22 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:22 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
W20260808 11:32:22.027182 3883 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:22.009716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:56285 (local address 127.26.66.190:45603)
0808 11:32:22.009868 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:22.009872 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:22.009996 (+ 124us) server_negotiation.cc:407] Connection header received
0808 11:32:22.010214 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:22.010218 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:22.010279 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:22.010356 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:22.011615 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:22.012418 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:22.015129 (+ 2711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:22.015700 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:22.015861 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:22.026992 (+ 11131us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.130:56285: BlockingRecv error: recv got EOF from 127.26.66.130:56285 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 11:32:22.027281 3884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:22.009587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.130:56285)
0808 11:32:22.009884 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:22.009912 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:22.010089 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:22.010435 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:22.010443 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:22.011131 (+ 688us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:22.011456 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:22.011471 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:22.012574 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:22.012583 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:22.014919 (+ 2336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:22.014939 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:22.015940 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:22.015947 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:22.016186 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:22.021159 (+ 4973us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:22.021197 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:22.026799 (+ 5602us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":76}
Aug 08 11:32:22 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:22 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:22.037864 3884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:22.028264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.130:40929)
0808 11:32:22.028693 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:22.028713 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:22.028825 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:22.029163 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:22.029168 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:22.029596 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:22.029781 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:22.029790 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:22.030821 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:22.030826 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:22.031786 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:22.031799 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:22.032507 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:22.032513 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:22.032692 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:22.033431 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:22.033451 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:22.037528 (+ 4077us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":302}
W20260808 11:32:22.038209 3883 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:22.028642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:40929 (local address 127.26.66.190:45603)
0808 11:32:22.028815 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:22.028820 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:22.028837 (+ 17us) server_negotiation.cc:407] Connection header received
0808 11:32:22.028926 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:22.028934 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:22.029025 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:22.029129 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:22.029927 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:22.030665 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:22.031943 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:22.032355 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:22.032490 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:22.037742 (+ 5252us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.130:40929: BlockingRecv error: recv got EOF from 127.26.66.130:40929 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260808 11:32:22.038383 3881 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 11:32:22 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:22 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:22.607627 4023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:22.594228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.129:37903)
0808 11:32:22.595024 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:22.595054 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:22.595242 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:22.595662 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:22.595669 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:22.596547 (+ 878us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:22.596830 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:22.596847 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:22.597922 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:22.597930 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:22.600258 (+ 2328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:22.600282 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:22.601081 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:22.601092 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:22.601382 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:22.602138 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:22.602171 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:22.607269 (+ 5098us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":416,"threads_started":1}
W20260808 11:32:22.607753 4024 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:22.594317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:37903 (local address 127.26.66.190:45603)
0808 11:32:22.595306 (+ 989us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:22.595310 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:22.595326 (+ 16us) server_negotiation.cc:407] Connection header received
0808 11:32:22.595376 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:22.595379 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:22.595445 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:22.595573 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:22.597025 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:22.597763 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:22.600444 (+ 2681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:22.600845 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:22.600938 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:22.607473 (+ 6535us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.129:37903: BlockingRecv error: recv got EOF from 127.26.66.129:37903 (error 108)
Metrics: {"server-negotiator.queue_time_us":864,"thread_start_us":749,"threads_started":1}
W20260808 11:32:22.867403 4021 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.154s user 0.006s sys 0.011s
W20260808 11:32:22.869024 4020 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:21.685301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:54187 (local address 127.26.66.190:45603)
0808 11:32:21.692345 (+ 7044us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:21.692354 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:21.698256 (+ 5902us) server_negotiation.cc:407] Connection header received
0808 11:32:21.702797 (+ 4541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:21.702805 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:21.702887 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:21.702971 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:21.706168 (+ 3197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:21.707346 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:21.709808 (+ 2462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:21.710896 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:21.711073 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:22.868595 (+1157522us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.131:54187: BlockingRecv error: recv got EOF from 127.26.66.131:54187 (error 108)
Metrics: {"mutex_wait_us":62,"server-negotiator.queue_time_us":6902,"thread_start_us":6760,"threads_started":1}
I20260808 11:32:22.869536 4021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:21.686414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.131:54187)
0808 11:32:21.698105 (+ 11691us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:21.698155 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:21.702391 (+ 4236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:21.703417 (+ 1026us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:21.703434 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:21.704617 (+ 1183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:21.705840 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:21.705961 (+ 121us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:21.707552 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:21.707557 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:21.709604 (+ 2047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:21.709632 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:21.711562 (+ 1930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:21.711574 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:21.712032 (+ 458us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:21.713008 (+ 976us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:21.713059 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:22.868274 (+1155215us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":11345,"thread_start_us":11057,"threads_started":1}
W20260808 11:32:22.870535 4016 heartbeater.cc:644] Failed to heartbeat to 127.26.66.190:45603 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.66.190:45603: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Aug 08 11:32:22 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:22 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:22.880431 4021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:22.871177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.131:41351)
0808 11:32:22.871393 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:22.871411 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:22.871557 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:22.871985 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:22.871992 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:22.872377 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:22.872548 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:22.872556 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:22.873586 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:22.873591 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:22.874580 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:22.874592 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:22.875524 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:22.875530 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:22.875695 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:22.876355 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:22.876372 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:22.880170 (+ 3798us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":83}
W20260808 11:32:22.880822 4020 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:22.871357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:41351 (local address 127.26.66.190:45603)
0808 11:32:22.871655 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:22.871663 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:22.871680 (+ 17us) server_negotiation.cc:407] Connection header received
0808 11:32:22.871728 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:22.871740 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:22.871799 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:22.871943 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:22.872694 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:22.873440 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:22.874725 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:22.875337 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:22.875478 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:22.880422 (+ 4944us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.131:41351: BlockingRecv error: recv got EOF from 127.26.66.131:41351 (error 108)
Metrics: {"server-negotiator.queue_time_us":153}
Aug 08 11:32:22 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:22 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:22.889691 4021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:22.881300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.131:54737)
0808 11:32:22.881484 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:22.881504 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:22.881598 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:22.882035 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:22.882041 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:22.882380 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:22.882560 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:22.882569 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:22.883516 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:22.883519 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:22.884662 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:22.884674 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:22.885377 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:22.885381 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:22.885534 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:22.886164 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:22.886182 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:22.889495 (+ 3313us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":67}
W20260808 11:32:22.889976 4020 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:22.881363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:54737 (local address 127.26.66.190:45603)
0808 11:32:22.881528 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:22.881534 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:22.881555 (+ 21us) server_negotiation.cc:407] Connection header received
0808 11:32:22.881717 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:22.881722 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:22.881846 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:22.881946 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:22.882687 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:22.883389 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:22.884800 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:22.885233 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:22.885324 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:22.889685 (+ 4361us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.131:54737: BlockingRecv error: recv got EOF from 127.26.66.131:54737 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260808 11:32:22.890017 4016 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 11:32:23 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:23 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:23.048555 4025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:23.039034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.130:39799)
0808 11:32:23.039608 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:23.039624 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:23.039786 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:23.040192 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:23.040198 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:23.040668 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:23.040828 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:23.040837 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:23.041864 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:23.041871 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:23.042869 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:23.042880 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:23.043662 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:23.043668 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:23.043802 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:23.044490 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:23.044508 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:23.048320 (+ 3812us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":330,"threads_started":1}
W20260808 11:32:23.048714 4020 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:23.039119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:39799 (local address 127.26.66.190:45603)
0808 11:32:23.039390 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:23.039398 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:23.039710 (+ 312us) server_negotiation.cc:407] Connection header received
0808 11:32:23.039969 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:23.039973 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:23.040050 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:23.040157 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:23.040985 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:23.041710 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:23.043020 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:23.043471 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:23.043597 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:23.048505 (+ 4908us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.130:39799: BlockingRecv error: recv got EOF from 127.26.66.130:39799 (error 108)
Metrics: {"server-negotiator.queue_time_us":108}
Aug 08 11:32:23 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:23 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:23.617966 4026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:23.608700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.129:50189)
0808 11:32:23.609232 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:23.609250 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:23.609370 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:23.609676 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:23.609679 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:23.610089 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:23.610271 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:23.610280 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:23.611314 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:23.611318 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:23.612423 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:23.612437 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:23.613243 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:23.613248 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:23.613376 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:23.614009 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:23.614026 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:23.617709 (+ 3683us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":281,"threads_started":1}
W20260808 11:32:23.618134 4027 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:23.608751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:50189 (local address 127.26.66.190:45603)
0808 11:32:23.609280 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:23.609285 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:23.609302 (+ 17us) server_negotiation.cc:407] Connection header received
0808 11:32:23.609480 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:23.609483 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:23.609546 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:23.609632 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:23.610407 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:23.611144 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:23.612534 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:23.613099 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:23.613201 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:23.617907 (+ 4706us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.129:50189: BlockingRecv error: recv got EOF from 127.26.66.129:50189 (error 108)
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":298,"threads_started":1}
Aug 08 11:32:23 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:23 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:23.900312 4028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:23.890602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.131:36741)
0808 11:32:23.891124 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:23.891142 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:23.891269 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:23.891555 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:23.891559 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:23.892094 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:23.892254 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:23.892264 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:23.893357 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:23.893361 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:23.894609 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:23.894628 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:23.895367 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:23.895372 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:23.895492 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:23.896255 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:23.896274 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:23.900070 (+ 3796us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":295,"threads_started":1}
W20260808 11:32:23.900511 4027 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:23.890748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:36741 (local address 127.26.66.190:45603)
0808 11:32:23.890993 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:23.890999 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:23.891223 (+ 224us) server_negotiation.cc:407] Connection header received
0808 11:32:23.891364 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:23.891367 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:23.891430 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:23.891507 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:23.892386 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:23.893215 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:23.894791 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:23.895185 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:23.895347 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:23.900248 (+ 4901us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.131:36741: BlockingRecv error: recv got EOF from 127.26.66.131:36741 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 08 11:32:24 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:24 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:24.058645 4029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:24.049486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.130:41081)
0808 11:32:24.049997 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:24.050014 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:24.050159 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:24.050493 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:24.050497 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:24.050907 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:24.051099 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:24.051107 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:24.052174 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:24.052180 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:24.053523 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:24.053535 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:24.054191 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:24.054195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:24.054323 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:24.054957 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:24.054974 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:24.058405 (+ 3431us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":292,"threads_started":1}
W20260808 11:32:24.058830 4027 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:24.049555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:41081 (local address 127.26.66.190:45603)
0808 11:32:24.049724 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:24.049729 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:24.050103 (+ 374us) server_negotiation.cc:407] Connection header received
0808 11:32:24.050283 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:24.050286 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:24.050348 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:24.050448 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:24.051225 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:24.052045 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:24.053644 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:24.054063 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:24.054161 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:24.058565 (+ 4404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.130:41081: BlockingRecv error: recv got EOF from 127.26.66.130:41081 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 08 11:32:24 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:24 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:24.628477 4030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:24.619177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.129:49067)
0808 11:32:24.619834 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:24.619851 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:24.620030 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:24.620452 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:24.620459 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:24.620943 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:24.621121 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:24.621131 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:24.622214 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:24.622220 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:24.623131 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:24.623143 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:24.623881 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:24.623912 (+ 31us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:24.624100 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:24.624676 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:24.624694 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:24.628220 (+ 3526us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":345,"threads_started":1}
W20260808 11:32:24.628645 4031 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:24.619315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:49067 (local address 127.26.66.190:45603)
0808 11:32:24.619791 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:24.619796 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:24.619976 (+ 180us) server_negotiation.cc:407] Connection header received
0808 11:32:24.620167 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:24.620171 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:24.620266 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:24.620407 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:24.621288 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:24.622060 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:24.623285 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:24.623726 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:24.623861 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:24.628402 (+ 4541us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.129:49067: BlockingRecv error: recv got EOF from 127.26.66.129:49067 (error 108)
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":262,"threads_started":1}
Aug 08 11:32:24 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:24 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:24.910188 4032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:24.901279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.131:58017)
0808 11:32:24.901892 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:24.901913 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:24.902063 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:24.902486 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:24.902493 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:24.903062 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:24.903246 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:24.903255 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:24.904285 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:24.904289 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:24.905295 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:24.905308 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:24.906002 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:24.906006 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:24.906131 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:24.906735 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:24.906753 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:24.909946 (+ 3193us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":315,"threads_started":1}
W20260808 11:32:24.910333 4031 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:24.901361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:58017 (local address 127.26.66.190:45603)
0808 11:32:24.901613 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:24.901623 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:24.902003 (+ 380us) server_negotiation.cc:407] Connection header received
0808 11:32:24.902228 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:24.902233 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:24.902323 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:24.902418 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:24.903379 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:24.904166 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:24.905418 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:24.905810 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:24.905956 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:24.910109 (+ 4153us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.131:58017: BlockingRecv error: recv got EOF from 127.26.66.131:58017 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 08 11:32:25 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:25 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:25.070469 4033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:25.059600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.130:45981)
0808 11:32:25.060294 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:25.060355 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:25.060522 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:25.060947 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:25.060955 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:25.061522 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:25.061807 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:25.061823 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:25.063155 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:25.063180 (+ 25us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:25.064179 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:25.064193 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:25.064944 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:25.064950 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:25.065132 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:25.065782 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:25.065807 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:25.070187 (+ 4380us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":312,"threads_started":1}
W20260808 11:32:25.070611 4031 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:25.059669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:45981 (local address 127.26.66.190:45603)
0808 11:32:25.059927 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:25.059937 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:25.060463 (+ 526us) server_negotiation.cc:407] Connection header received
0808 11:32:25.060649 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:25.060654 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:25.060780 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:25.060880 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:25.061968 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:25.063009 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:25.064338 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:25.064775 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:25.064917 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:25.070377 (+ 5460us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.130:45981: BlockingRecv error: recv got EOF from 127.26.66.130:45981 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 08 11:32:25 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:25 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:25.638720 4034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:25.629527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.129:53343)
0808 11:32:25.630149 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:25.630166 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:25.630284 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:25.630595 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:25.630598 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:25.631019 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:25.631198 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:25.631209 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:25.632172 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:25.632177 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:25.633212 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:25.633223 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:25.633887 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:25.633891 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:25.634024 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:25.634603 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:25.634619 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:25.638472 (+ 3853us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":365,"threads_started":1}
W20260808 11:32:25.638880 4035 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:25.629598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:53343 (local address 127.26.66.190:45603)
0808 11:32:25.630152 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:25.630156 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:25.630245 (+ 89us) server_negotiation.cc:407] Connection header received
0808 11:32:25.630394 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:25.630397 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:25.630458 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:25.630545 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:25.631338 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:25.632038 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:25.633336 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:25.633747 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:25.633837 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:25.638663 (+ 4826us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.129:53343: BlockingRecv error: recv got EOF from 127.26.66.129:53343 (error 108)
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":316,"threads_started":1}
Aug 08 11:32:25 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:25 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:25.919970 4036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:25.911081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.131:52111)
0808 11:32:25.911670 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:25.911686 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:25.911841 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:25.912214 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:25.912219 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:25.912601 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:25.912776 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:25.912785 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:25.913839 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:25.913845 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:25.914742 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:25.914786 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:25.915466 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:25.915471 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:25.915666 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:25.916294 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:25.916313 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:25.919576 (+ 3263us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":325,"threads_started":1}
W20260808 11:32:25.920147 4035 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:25.911176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:52111 (local address 127.26.66.190:45603)
0808 11:32:25.911472 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:25.911480 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:25.911774 (+ 294us) server_negotiation.cc:407] Connection header received
0808 11:32:25.912015 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:25.912019 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:25.912080 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:25.912182 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:25.912919 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:25.913658 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:25.914937 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:25.915327 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:25.915455 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:25.919851 (+ 4396us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.131:52111: BlockingRecv error: recv got EOF from 127.26.66.131:52111 (error 108)
Metrics: {"server-negotiator.queue_time_us":142}
Aug 08 11:32:26 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:26 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:26.080739 4037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:26.071475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.130:36669)
0808 11:32:26.072042 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:26.072059 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:26.072173 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:26.072478 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:26.072481 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:26.072862 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:26.073027 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:26.073035 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:26.074233 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:26.074240 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:26.075634 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:26.075647 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:26.076367 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:26.076371 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:26.076507 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:26.077094 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:26.077111 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:26.080487 (+ 3376us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":302,"threads_started":1}
W20260808 11:32:26.080885 4035 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:26.071539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:36669 (local address 127.26.66.190:45603)
0808 11:32:26.071745 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:26.071749 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:26.072133 (+ 384us) server_negotiation.cc:407] Connection header received
0808 11:32:26.072268 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:26.072271 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:26.072339 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:26.072423 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:26.073147 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:26.074082 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:26.075758 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:26.076232 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:26.076343 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:26.080659 (+ 4316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.130:36669: BlockingRecv error: recv got EOF from 127.26.66.130:36669 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 08 11:32:26 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:26 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:26.649219 4038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:26.639841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.129:43223)
0808 11:32:26.640511 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:26.640533 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:26.640695 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:26.641173 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:26.641178 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:26.641737 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:26.641958 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:26.641974 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:26.643140 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:26.643144 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:26.644118 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:26.644130 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:26.644860 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:26.644864 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:26.644986 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:26.645556 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:26.645572 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:26.648990 (+ 3418us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":362,"threads_started":1}
W20260808 11:32:26.649453 4039 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:26.639936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:43223 (local address 127.26.66.190:45603)
0808 11:32:26.640500 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:26.640505 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:26.640617 (+ 112us) server_negotiation.cc:407] Connection header received
0808 11:32:26.640871 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:26.640875 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:26.640964 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:26.641095 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:26.642134 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:26.643014 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:26.644250 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:26.644711 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:26.644828 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:26.649179 (+ 4351us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.129:43223: BlockingRecv error: recv got EOF from 127.26.66.129:43223 (error 108)
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":295,"threads_started":1}
Aug 08 11:32:26 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:26 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:26.929951 4040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:26.921015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.131:60065)
0808 11:32:26.921534 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:26.921552 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:26.921672 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:26.922025 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:26.922029 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:26.922452 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:26.922622 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:26.922631 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:26.923612 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:26.923616 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:26.924652 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:26.924668 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:26.925370 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:26.925377 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:26.925581 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:26.926234 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:26.926253 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:26.929689 (+ 3436us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":287,"threads_started":1}
W20260808 11:32:26.930274 4039 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:26.921024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:60065 (local address 127.26.66.190:45603)
0808 11:32:26.921264 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:26.921274 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:26.921639 (+ 365us) server_negotiation.cc:407] Connection header received
0808 11:32:26.921775 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:26.921779 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:26.921855 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:26.921951 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:26.922741 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:26.923479 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:26.924785 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:26.925203 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:26.925340 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:26.929896 (+ 4556us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.131:60065: BlockingRecv error: recv got EOF from 127.26.66.131:60065 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 08 11:32:27 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:27 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:27.095541 4041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:27.081691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.130:49597)
0808 11:32:27.082273 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:27.082304 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:27.082455 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:27.082831 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:27.082836 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:27.083350 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:27.083503 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:27.083512 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:27.084575 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:27.084581 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:27.085560 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:27.085571 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:27.086330 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:27.086337 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:27.086522 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:27.091484 (+ 4962us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:27.091503 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:27.095192 (+ 3689us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":321,"threads_started":1}
W20260808 11:32:27.095690 4039 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:27.081907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:49597 (local address 127.26.66.190:45603)
0808 11:32:27.082133 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:27.082140 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:27.082391 (+ 251us) server_negotiation.cc:407] Connection header received
0808 11:32:27.082589 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:27.082594 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:27.082681 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:27.082804 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:27.083647 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:27.084441 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:27.085704 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:27.086166 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:27.086298 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:27.095414 (+ 9116us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.130:49597: BlockingRecv error: recv got EOF from 127.26.66.130:49597 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 08 11:32:27 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:27 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:27.659551 4042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:27.650288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.129:47245)
0808 11:32:27.650809 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:27.650827 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:27.650942 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:27.651248 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:27.651251 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:27.651682 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:27.651859 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:27.651868 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:27.652858 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:27.652863 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:27.653897 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:27.653910 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:27.654706 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:27.654711 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:27.654906 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:27.655639 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:27.655670 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:27.659313 (+ 3643us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":285,"threads_started":1}
W20260808 11:32:27.659744 4043 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:27.650386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:47245 (local address 127.26.66.190:45603)
0808 11:32:27.650839 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:27.650843 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:27.650883 (+ 40us) server_negotiation.cc:407] Connection header received
0808 11:32:27.651040 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:27.651044 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:27.651113 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:27.651200 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:27.652019 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:27.652733 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:27.654021 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:27.654425 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:27.654518 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:27.659518 (+ 5000us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.129:47245: BlockingRecv error: recv got EOF from 127.26.66.129:47245 (error 108)
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":249,"threads_started":1}
Aug 08 11:32:27 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:27 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:27.940235 4044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:27.930999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.131:45345)
0808 11:32:27.931511 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:27.931526 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:27.931640 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:27.931963 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:27.931966 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:27.932378 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:27.932530 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:27.932538 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:27.933569 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:27.933573 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:27.935009 (+ 1436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:27.935022 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:27.935725 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:27.935732 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:27.935913 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:27.936468 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:27.936485 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:27.940005 (+ 3520us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":270,"threads_started":1}
W20260808 11:32:27.940408 4043 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:27.931074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:45345 (local address 127.26.66.190:45603)
0808 11:32:27.931252 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:27.931256 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:27.931596 (+ 340us) server_negotiation.cc:407] Connection header received
0808 11:32:27.931753 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:27.931757 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:27.931820 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:27.931943 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:27.932646 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:27.933443 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:27.935151 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:27.935577 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:27.935662 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:27.940185 (+ 4523us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.131:45345: BlockingRecv error: recv got EOF from 127.26.66.131:45345 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 08 11:32:28 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:28 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:28.105587 4045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:28.096588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.130:34305)
0808 11:32:28.097120 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:28.097136 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:28.097251 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:28.097566 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:28.097569 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:28.097979 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:28.098156 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:28.098165 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:28.099115 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:28.099118 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:28.100095 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:28.100108 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:28.100738 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:28.100742 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:28.100879 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:28.101563 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:28.101580 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:28.105318 (+ 3738us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":308,"threads_started":1}
W20260808 11:32:28.105847 4043 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:28.096622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:34305 (local address 127.26.66.190:45603)
0808 11:32:28.096786 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:28.096791 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:28.097204 (+ 413us) server_negotiation.cc:407] Connection header received
0808 11:32:28.097353 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:28.097356 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:28.097437 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:28.097519 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:28.098280 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:28.098989 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:28.100209 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:28.100606 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:28.100704 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:28.105570 (+ 4866us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.130:34305: BlockingRecv error: recv got EOF from 127.26.66.130:34305 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 08 11:32:28 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:28 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:28.669893 4047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:28.660579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.129:37395)
0808 11:32:28.661410 (+ 831us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:28.661426 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:28.661542 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:28.661870 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:28.661873 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:28.662286 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:28.662460 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:28.662468 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:28.663463 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:28.663467 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:28.664519 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:28.664533 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:28.665206 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:28.665210 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:28.665340 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:28.665917 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:28.665934 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:28.669637 (+ 3703us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":716,"thread_start_us":489,"threads_started":1}
W20260808 11:32:28.670068 4046 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:28.660620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:37395 (local address 127.26.66.190:45603)
0808 11:32:28.661114 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:28.661119 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:28.661500 (+ 381us) server_negotiation.cc:407] Connection header received
0808 11:32:28.661636 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:28.661639 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:28.661710 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:28.661816 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:28.662577 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:28.663327 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:28.664645 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:28.665081 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:28.665173 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:28.669833 (+ 4660us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.129:37395: BlockingRecv error: recv got EOF from 127.26.66.129:37395 (error 108)
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":281,"threads_started":1}
Aug 08 11:32:28 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:28 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:28.949911 4048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:28.941203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.131:55427)
0808 11:32:28.941718 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:28.941735 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:28.941851 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:28.942144 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:28.942147 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:28.942565 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:28.942739 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:28.942747 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:28.943794 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:28.943797 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:28.944793 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:28.944806 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:28.945494 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:28.945498 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:28.945642 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:28.946208 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:28.946225 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:28.949669 (+ 3444us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":287,"threads_started":1}
W20260808 11:32:28.950284 4046 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:28.941436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:55427 (local address 127.26.66.190:45603)
0808 11:32:28.941611 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:28.941616 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:28.941812 (+ 196us) server_negotiation.cc:407] Connection header received
0808 11:32:28.941947 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:28.941951 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:28.942017 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:28.942104 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:28.942863 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:28.943666 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:28.944922 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:28.945355 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:28.945448 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:28.950018 (+ 4570us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.131:55427: BlockingRecv error: recv got EOF from 127.26.66.131:55427 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 08 11:32:29 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:29 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:29.115640 4049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:29.106697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.130:41029)
0808 11:32:29.107264 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:29.107281 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:29.107453 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:29.107768 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:29.107772 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:29.108212 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:29.108406 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:29.108415 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:29.109410 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:29.109413 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:29.110359 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:29.110370 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:29.110997 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:29.111001 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:29.111110 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:29.111678 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:29.111695 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:29.115322 (+ 3627us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":237,"threads_started":1}
W20260808 11:32:29.115883 4046 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:29.106747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:41029 (local address 127.26.66.190:45603)
0808 11:32:29.106989 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:29.106998 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:29.107380 (+ 382us) server_negotiation.cc:407] Connection header received
0808 11:32:29.107579 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:29.107583 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:29.107648 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:29.107727 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:29.108529 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:29.109295 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:29.110476 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:29.110872 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:29.110960 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:29.115568 (+ 4608us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.130:41029: BlockingRecv error: recv got EOF from 127.26.66.130:41029 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 08 11:32:29 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:29 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:29.679908 4050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:29.670857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.129:35731)
0808 11:32:29.671749 (+ 892us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:29.671766 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:29.671878 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:29.672169 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:29.672172 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:29.672577 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:29.672739 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:29.672748 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:29.673767 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:29.673771 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:29.674717 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:29.674728 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:29.675480 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:29.675485 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:29.675600 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:29.676182 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:29.676199 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:29.679638 (+ 3439us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":710,"thread_start_us":559,"threads_started":1}
W20260808 11:32:29.680132 4051 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:29.670875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:35731 (local address 127.26.66.190:45603)
0808 11:32:29.671831 (+ 956us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:29.671836 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:29.671852 (+ 16us) server_negotiation.cc:407] Connection header received
0808 11:32:29.672001 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:29.672005 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:29.672067 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:29.672155 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:29.672862 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:29.673636 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:29.674839 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:29.675316 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:29.675408 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:29.679848 (+ 4440us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.129:35731: BlockingRecv error: recv got EOF from 127.26.66.129:35731 (error 108)
Metrics: {"server-negotiator.queue_time_us":858,"thread_start_us":743,"threads_started":1}
Aug 08 11:32:29 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:29 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:29.960451 4052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:29.951029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.131:56345)
0808 11:32:29.951749 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:29.951766 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:29.951942 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:29.952327 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:29.952331 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:29.952732 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:29.952915 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:29.952924 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:29.954350 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:29.954355 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:29.955448 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:29.955461 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:29.956115 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:29.956121 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:29.956232 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:29.956810 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:29.956827 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:29.960200 (+ 3373us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":368,"threads_started":1}
W20260808 11:32:29.960613 4051 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:29.951357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:56345 (local address 127.26.66.190:45603)
0808 11:32:29.951580 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:29.951585 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:29.951864 (+ 279us) server_negotiation.cc:407] Connection header received
0808 11:32:29.952080 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:29.952088 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:29.952173 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:29.952259 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:29.953059 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:29.954193 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:29.955582 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:29.955992 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:29.956086 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:29.960380 (+ 4294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.131:56345: BlockingRecv error: recv got EOF from 127.26.66.131:56345 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 08 11:32:30 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:30 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:30.126682 4053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:30.116750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.130:49321)
0808 11:32:30.117582 (+ 832us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:30.117599 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:30.117772 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:30.118163 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:30.118169 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:30.118608 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:30.118786 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:30.118796 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:30.120049 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:30.120059 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:30.121161 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:30.121176 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:30.121979 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:30.121986 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:30.122165 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:30.122819 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:30.122838 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:30.126439 (+ 3601us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":681,"thread_start_us":552,"threads_started":1}
W20260808 11:32:30.126924 4051 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:30.116856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:49321 (local address 127.26.66.190:45603)
0808 11:32:30.117121 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:30.117131 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:30.117700 (+ 569us) server_negotiation.cc:407] Connection header received
0808 11:32:30.117930 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:30.117934 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:30.118017 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:30.118124 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:30.118949 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:30.119858 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:30.121298 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:30.121786 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:30.121928 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:30.126676 (+ 4748us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.130:49321: BlockingRecv error: recv got EOF from 127.26.66.130:49321 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 08 11:32:30 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:30 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:30.691083 4054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:30.681008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.129:47297)
0808 11:32:30.681826 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:30.681843 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:30.681964 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:30.682341 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:30.682345 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:30.682785 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:30.682939 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:30.682947 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:30.684283 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:30.684289 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:30.685682 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:30.685697 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:30.686358 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:30.686362 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:30.686499 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:30.687085 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:30.687103 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:30.690796 (+ 3693us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":683,"thread_start_us":553,"threads_started":1}
W20260808 11:32:30.691349 4055 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:30.681063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:47297 (local address 127.26.66.190:45603)
0808 11:32:30.681584 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:30.681590 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:30.681935 (+ 345us) server_negotiation.cc:407] Connection header received
0808 11:32:30.682081 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:30.682087 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:30.682168 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:30.682310 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:30.683089 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:30.684148 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:30.685817 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:30.686220 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:30.686330 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:30.691047 (+ 4717us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.129:47297: BlockingRecv error: recv got EOF from 127.26.66.129:47297 (error 108)
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":253,"threads_started":1}
Aug 08 11:32:30 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:30 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:30.970605 4056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:30.961356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.131:35027)
0808 11:32:30.961884 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:30.961903 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:30.962054 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:30.962378 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:30.962383 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:30.962828 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:30.963016 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:30.963030 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:30.964131 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:30.964137 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:30.965090 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:30.965101 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:30.965825 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:30.965831 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:30.966005 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:30.966579 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:30.966596 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:30.970364 (+ 3768us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":262,"threads_started":1}
W20260808 11:32:30.970767 4055 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:30.961446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:35027 (local address 127.26.66.190:45603)
0808 11:32:30.961670 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:30.961678 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:30.961992 (+ 314us) server_negotiation.cc:407] Connection header received
0808 11:32:30.962186 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:30.962190 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:30.962251 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:30.962350 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:30.963170 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:30.964000 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:30.965232 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:30.965648 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:30.965796 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:30.970552 (+ 4756us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.131:35027: BlockingRecv error: recv got EOF from 127.26.66.131:35027 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 08 11:32:31 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:31 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:31.137030 4057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:31.127947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.130:36305)
0808 11:32:31.128494 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:31.128511 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:31.128621 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:31.128948 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:31.128952 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:31.129407 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:31.129555 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:31.129564 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:31.130572 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:31.130576 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:31.131751 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:31.131768 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:31.132524 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:31.132528 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:31.132651 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:31.133218 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:31.133235 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:31.136749 (+ 3514us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":303,"threads_started":1}
W20260808 11:32:31.137266 4055 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:31.128009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:36305 (local address 127.26.66.190:45603)
0808 11:32:31.128168 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:31.128172 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:31.128586 (+ 414us) server_negotiation.cc:407] Connection header received
0808 11:32:31.128715 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:31.128719 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:31.128815 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:31.128899 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:31.129669 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:31.130425 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:31.131939 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:31.132381 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:31.132480 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:31.136964 (+ 4484us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.130:36305: BlockingRecv error: recv got EOF from 127.26.66.130:36305 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 08 11:32:31 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:31 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:31.701453 4058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:31.692210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.129:58587)
0808 11:32:31.693024 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:31.693041 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:31.693162 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:31.693497 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:31.693500 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:31.693913 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:31.694074 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:31.694083 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:31.695054 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:31.695058 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:31.696227 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:31.696240 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:31.697174 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:31.697181 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:31.697355 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:31.697908 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:31.697930 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:31.701222 (+ 3292us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":691,"thread_start_us":811,"threads_started":1}
W20260808 11:32:31.701721 4059 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:31.692314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:58587 (local address 127.26.66.190:45603)
0808 11:32:31.692882 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:31.692888 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:31.693132 (+ 244us) server_negotiation.cc:407] Connection header received
0808 11:32:31.693273 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:31.693278 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:31.693364 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:31.693454 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:31.694199 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:31.694944 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:31.696374 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:31.697021 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:31.697158 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:31.701433 (+ 4275us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.129:58587: BlockingRecv error: recv got EOF from 127.26.66.129:58587 (error 108)
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":267,"threads_started":1}
Aug 08 11:32:31 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:31 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:31.981083 4060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:31.971523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.131:54019)
0808 11:32:31.972067 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:31.972089 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:31.972238 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:31.972581 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:31.972586 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:31.973047 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:31.973197 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:31.973206 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:31.974261 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:31.974266 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:31.975223 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:31.975236 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:31.975980 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:31.975986 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:31.976163 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:31.976723 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:31.976740 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:31.980853 (+ 4113us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":243,"threads_started":1}
W20260808 11:32:31.981243 4059 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:31.971616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:54019 (local address 127.26.66.190:45603)
0808 11:32:31.971855 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:31.971862 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:31.972167 (+ 305us) server_negotiation.cc:407] Connection header received
0808 11:32:31.972368 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:31.972377 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:31.972440 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:31.972542 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:31.973358 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:31.974113 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:31.975383 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:31.975790 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:31.975940 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:31.981015 (+ 5075us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.131:54019: BlockingRecv error: recv got EOF from 127.26.66.131:54019 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 08 11:32:32 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:32 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:32.150416 4061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:32.137908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.130:45335)
0808 11:32:32.138425 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:32.138442 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:32.138557 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:32.138873 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:32.138877 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:32.139259 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:32.139419 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:32.139427 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:32.140423 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:32.140427 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:32.141393 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:32.141404 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:32.142019 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:32.142023 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:32.142130 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:32.146790 (+ 4660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:32.146809 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:32.150156 (+ 3347us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":262,"threads_started":1}
W20260808 11:32:32.150566 4059 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:32.138056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:45335 (local address 127.26.66.190:45603)
0808 11:32:32.138275 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:32.138282 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:32.138516 (+ 234us) server_negotiation.cc:407] Connection header received
0808 11:32:32.138652 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:32.138656 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:32.138733 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:32.138839 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:32.139540 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:32.140294 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:32.141511 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:32.141896 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:32.141984 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:32.150331 (+ 8347us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.130:45335: BlockingRecv error: recv got EOF from 127.26.66.130:45335 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 08 11:32:32 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:32 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:32.711967 4062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:32.702526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.129:60215)
0808 11:32:32.703075 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:32.703098 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:32.703216 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:32.703517 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:32.703520 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:32.704039 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:32.704220 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:32.704229 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:32.705300 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:32.705303 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:32.706211 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:32.706223 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:32.707227 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:32.707233 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:32.707415 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:32.708109 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:32.708126 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:32.711678 (+ 3552us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":258,"threads_started":1}
W20260808 11:32:32.712182 4063 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:32.702694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:60215 (local address 127.26.66.190:45603)
0808 11:32:32.703197 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:32.703201 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:32.703217 (+ 16us) server_negotiation.cc:407] Connection header received
0808 11:32:32.703328 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:32.703332 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:32.703390 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:32.703476 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:32.704349 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:32.705194 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:32.706376 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:32.707070 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:32.707209 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:32.711871 (+ 4662us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.129:60215: BlockingRecv error: recv got EOF from 127.26.66.129:60215 (error 108)
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":292,"threads_started":1}
Aug 08 11:32:32 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:32 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:32.990772 4064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:32.982010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.131:34453)
0808 11:32:32.982608 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:32.982623 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:32.982737 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:32.983027 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:32.983030 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:32.983426 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:32.983598 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:32.983607 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:32.984601 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:32.984604 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:32.985579 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:32.985591 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:32.986246 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:32.986251 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:32.986377 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:32.986972 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:32.986989 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:32.990371 (+ 3382us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":357,"threads_started":1}
W20260808 11:32:32.990866 4063 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:32.982113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:34453 (local address 127.26.66.190:45603)
0808 11:32:32.982292 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:32.982296 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:32.982697 (+ 401us) server_negotiation.cc:407] Connection header received
0808 11:32:32.982834 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:32.982838 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:32.982901 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:32.982985 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:32.983723 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:32.984490 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:32.985715 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:32.986123 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:32.986212 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:32.990566 (+ 4354us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.131:34453: BlockingRecv error: recv got EOF from 127.26.66.131:34453 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 08 11:32:33 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:33 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:33.160565 4065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:33.151435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.130:56547)
0808 11:32:33.152000 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:33.152016 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:33.152172 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:33.152509 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:33.152518 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:33.152966 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:33.153150 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:33.153159 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:33.154167 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:33.154175 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:33.155253 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:33.155266 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:33.156040 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:33.156045 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:33.156235 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:33.156961 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:33.156979 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:33.160325 (+ 3346us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":303,"threads_started":1}
W20260808 11:32:33.160776 4063 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:33.151536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:56547 (local address 127.26.66.190:45603)
0808 11:32:33.151745 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:33.151754 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:33.152100 (+ 346us) server_negotiation.cc:407] Connection header received
0808 11:32:33.152293 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:33.152300 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:33.152367 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:33.152468 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:33.153290 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:33.154037 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:33.155395 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:33.155877 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:33.156028 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:33.160504 (+ 4476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.130:56547: BlockingRecv error: recv got EOF from 127.26.66.130:56547 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 08 11:32:33 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:33 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:33.722930 4067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:33.712866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.129:34551)
0808 11:32:33.713640 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:33.713656 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:33.713829 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:33.714168 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:33.714172 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:33.714633 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:33.714826 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:33.714842 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:33.715942 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:33.715948 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:33.716913 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:33.716925 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:33.717679 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:33.717686 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:33.717885 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:33.718472 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:33.718488 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:33.722568 (+ 4080us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":685,"thread_start_us":530,"threads_started":1}
W20260808 11:32:33.723022 4066 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:33.712904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:34551 (local address 127.26.66.190:45603)
0808 11:32:33.713438 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:33.713446 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:33.713777 (+ 331us) server_negotiation.cc:407] Connection header received
0808 11:32:33.713950 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:33.713959 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:33.714029 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:33.714138 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:33.714976 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:33.715780 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:33.717052 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:33.717499 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:33.717642 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:33.722800 (+ 5158us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.129:34551: BlockingRecv error: recv got EOF from 127.26.66.129:34551 (error 108)
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":278,"threads_started":1}
Aug 08 11:32:33 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:33 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:34.000980 4068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:33.991775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.131:58193)
0808 11:32:33.992340 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:33.992357 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:33.992478 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:33.992779 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:33.992782 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:33.993209 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:33.993479 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:33.993495 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:33.994718 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:33.994726 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:33.995723 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:33.995736 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:33.996485 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:33.996491 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:33.996667 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:33.997265 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:33.997283 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:34.000746 (+ 3463us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":330,"threads_started":1}
W20260808 11:32:34.001386 4066 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:33.991934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:58193 (local address 127.26.66.190:45603)
0808 11:32:33.992107 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:33.992112 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:33.992430 (+ 318us) server_negotiation.cc:407] Connection header received
0808 11:32:33.992573 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:33.992577 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:33.992639 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:33.992721 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:33.993633 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:33.994541 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:33.995868 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:33.996318 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:33.996452 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:34.000928 (+ 4476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.131:58193: BlockingRecv error: recv got EOF from 127.26.66.131:58193 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 08 11:32:34 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:34 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:34.170369 4069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:34.161504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.130:34095)
0808 11:32:34.162033 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:34.162051 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:34.162172 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:34.162489 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:34.162493 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:34.162893 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:34.163063 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:34.163071 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:34.164076 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:34.164080 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:34.165005 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:34.165016 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:34.165700 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:34.165705 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:34.165840 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:34.166477 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:34.166494 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:34.170031 (+ 3537us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":280,"threads_started":1}
W20260808 11:32:34.170567 4066 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:34.161581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:34095 (local address 127.26.66.190:45603)
0808 11:32:34.161857 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:34.161863 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:34.162136 (+ 273us) server_negotiation.cc:407] Connection header received
0808 11:32:34.162275 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:34.162279 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:34.162364 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:34.162446 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:34.163187 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:34.163945 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:34.165127 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:34.165548 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:34.165637 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:34.170246 (+ 4609us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.130:34095: BlockingRecv error: recv got EOF from 127.26.66.130:34095 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 08 11:32:34 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:34 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:34.733166 4071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:34.723955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.129:36853)
0808 11:32:34.724486 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:34.724504 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:34.724625 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:34.724942 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:34.724945 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:34.725384 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:34.725546 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:34.725555 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:34.726551 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:34.726555 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:34.727594 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:34.727606 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:34.728324 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:34.728328 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:34.728458 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:34.729020 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:34.729037 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:34.732940 (+ 3903us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":274,"threads_started":1}
W20260808 11:32:34.733366 4070 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:34.723978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:36853 (local address 127.26.66.190:45603)
0808 11:32:34.724444 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:34.724448 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:34.724580 (+ 132us) server_negotiation.cc:407] Connection header received
0808 11:32:34.724724 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:34.724727 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:34.724801 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:34.724898 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:34.725670 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:34.726404 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:34.727730 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:34.728186 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:34.728280 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:34.733120 (+ 4840us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.129:36853: BlockingRecv error: recv got EOF from 127.26.66.129:36853 (error 108)
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":258,"threads_started":1}
Aug 08 11:32:35 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:35 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:35.016206 4072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:35.002051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.131:41247)
0808 11:32:35.002629 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:35.002646 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:35.002797 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:35.003135 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:35.003139 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:35.003690 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:35.003999 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:35.004010 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:35.005246 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:35.005252 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:35.006219 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:35.006230 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:35.006982 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:35.006988 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:35.007179 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:35.012244 (+ 5065us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:35.012263 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:35.015847 (+ 3584us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":313,"threads_started":1}
W20260808 11:32:35.016350 4070 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:35.002158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:41247 (local address 127.26.66.190:45603)
0808 11:32:35.002389 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:35.002397 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:35.002727 (+ 330us) server_negotiation.cc:407] Connection header received
0808 11:32:35.002919 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:35.002924 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:35.002999 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:35.003097 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:35.004131 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:35.005099 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:35.006385 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:35.006794 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:35.006937 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:35.016085 (+ 9148us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.131:41247: BlockingRecv error: recv got EOF from 127.26.66.131:41247 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 08 11:32:35 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:35 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:35.180256 4073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:35.171486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.130:38723)
0808 11:32:35.172039 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:35.172054 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:35.172206 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:35.172570 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:35.172576 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:35.173028 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:35.173178 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:35.173188 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:35.174217 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:35.174223 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:35.175137 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:35.175149 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:35.175842 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:35.175848 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:35.176054 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:35.176609 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:35.176626 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:35.179998 (+ 3372us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":281,"threads_started":1}
W20260808 11:32:35.180464 4070 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:35.171652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:38723 (local address 127.26.66.190:45603)
0808 11:32:35.171876 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:35.171883 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:35.172139 (+ 256us) server_negotiation.cc:407] Connection header received
0808 11:32:35.172348 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:35.172353 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:35.172428 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:35.172531 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:35.173334 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:35.174077 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:35.175287 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:35.175685 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:35.175820 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:35.180186 (+ 4366us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.130:38723: BlockingRecv error: recv got EOF from 127.26.66.130:38723 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 08 11:32:35 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:35 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.129@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:35.743544 4074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:35.734548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.129:45853)
0808 11:32:35.735041 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:35.735058 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:35.735162 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:35.735615 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:35.735618 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:35.736015 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:35.736265 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:35.736277 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:35.737358 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:35.737362 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:35.738269 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:35.738281 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:35.738945 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:35.738949 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:35.739083 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:35.739642 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:35.739659 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:35.743168 (+ 3509us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":231,"threads_started":1}
W20260808 11:32:35.743796 4075 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:35.734619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:45853 (local address 127.26.66.190:45603)
0808 11:32:35.735356 (+ 737us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:35.735361 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:35.735377 (+ 16us) server_negotiation.cc:407] Connection header received
0808 11:32:35.735419 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:35.735423 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:35.735490 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:35.735578 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:35.736414 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:35.737200 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:35.738402 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:35.738824 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:35.738914 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:35.743379 (+ 4465us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.129:45853: BlockingRecv error: recv got EOF from 127.26.66.129:45853 (error 108)
Metrics: {"server-negotiator.queue_time_us":650,"thread_start_us":537,"threads_started":1}
Aug 08 11:32:36 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:36 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.131@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:36.026094 4076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:36.017265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.131:44021)
0808 11:32:36.017898 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:36.017913 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:36.018025 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:36.018365 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:36.018370 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:36.018823 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:36.018972 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:36.018980 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:36.020082 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:36.020087 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:36.021024 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:36.021036 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:36.021803 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:36.021807 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:36.021927 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:36.022532 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:36.022550 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:36.025873 (+ 3323us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":363,"threads_started":1}
W20260808 11:32:36.026290 4075 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:36.017292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:44021 (local address 127.26.66.190:45603)
0808 11:32:36.017598 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:36.017623 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:36.017996 (+ 373us) server_negotiation.cc:407] Connection header received
0808 11:32:36.018151 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:36.018157 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:36.018228 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:36.018333 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:36.019115 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:36.019943 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:36.021189 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:36.021658 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:36.021765 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:36.026049 (+ 4284us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.131:44021: BlockingRecv error: recv got EOF from 127.26.66.131:44021 (error 108)
Metrics: {"server-negotiator.queue_time_us":180}
Aug 08 11:32:36 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 11:32:36 dist-test-slave-zkpd krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.66.130@KRBTEST.COM for oryx/127.26.66.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 11:32:36.190465 4077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:36.181540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45603 (local address 127.26.66.130:50351)
0808 11:32:36.182060 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:36.182075 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:36.182227 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:36.182705 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:36.182711 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:36.183144 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:36.183396 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:36.183424 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:36.184472 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:36.184476 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:36.185458 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:36.185470 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:36.186084 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:36.186088 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:36.186202 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:36.186766 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:36.186783 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:36.190213 (+ 3430us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.66.190:45603: Server oryx/127.26.66.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":266,"threads_started":1}
W20260808 11:32:36.190706 4075 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:36.181654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:50351 (local address 127.26.66.190:45603)
0808 11:32:36.181895 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:36.181901 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:36.182167 (+ 266us) server_negotiation.cc:407] Connection header received
0808 11:32:36.182400 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:36.182404 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:36.182519 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:36.182622 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:36.183564 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:36.184348 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:36.185576 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:36.185961 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:36.186051 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:36.190442 (+ 4391us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.66.130:50351: BlockingRecv error: recv got EOF from 127.26.66.130:50351 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 11:32:36.686094 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 3590
I20260808 11:32:36.698904 4079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:36.687024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59306 (local address 127.26.66.129:33315)
0808 11:32:36.687818 (+ 794us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:36.687827 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:36.688031 (+ 204us) server_negotiation.cc:407] Connection header received
0808 11:32:36.688149 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:36.688155 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:36.688399 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:36.688557 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:36.689910 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:36.690896 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:36.692271 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:36.692834 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:36.692980 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:36.695745 (+ 2765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:36.695754 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:36.695766 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:36.695813 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:36.698225 (+ 2412us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.26.66.129@KRBTEST.COM not found in keytab (ticket kvno 2)
0808 11:32:36.698583 (+ 358us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59306: Request ticket server kudu/127.26.66.129@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":564,"thread_start_us":347,"threads_started":1}
W20260808 11:32:36.698962 26890 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 3590: Not authorized: Client connection negotiation failed: client connection to 127.26.66.129:33315: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.26.66.129@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260808 11:32:36.699023 4079 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59306: Request ticket server kudu/127.26.66.129@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 11:32:36.699155 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 3590
I20260808 11:32:36.721470 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 3749
I20260808 11:32:36.734019 4080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:36.722695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40814 (local address 127.26.66.130:35755)
0808 11:32:36.723314 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:36.723321 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:36.723346 (+ 25us) server_negotiation.cc:407] Connection header received
0808 11:32:36.723419 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:36.723426 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:36.723645 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:36.723874 (+ 229us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:36.725137 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:36.726212 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:36.727438 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:36.728070 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:36.728218 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:36.730636 (+ 2418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:36.730644 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:36.730657 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:36.730696 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:36.733327 (+ 2631us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.26.66.130@KRBTEST.COM not found in keytab (ticket kvno 2)
0808 11:32:36.733677 (+ 350us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40814: Request ticket server kudu/127.26.66.130@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":314,"threads_started":1}
W20260808 11:32:36.734078 26890 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 3749: Not authorized: Client connection negotiation failed: client connection to 127.26.66.130:35755: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.26.66.130@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260808 11:32:36.734148 4080 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40814: Request ticket server kudu/127.26.66.130@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 11:32:36.734268 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 3749
I20260808 11:32:36.755494 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 3885
I20260808 11:32:36.768173 4081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:36.756609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46402 (local address 127.26.66.131:33057)
0808 11:32:36.757173 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:36.757181 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:36.757207 (+ 26us) server_negotiation.cc:407] Connection header received
0808 11:32:36.757270 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:36.757277 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:36.757517 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:36.757725 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:36.759194 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:36.760274 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:36.761492 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:36.762047 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:36.762186 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:36.764916 (+ 2730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:36.764926 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:36.764944 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:36.764997 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:36.767594 (+ 2597us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.26.66.131@KRBTEST.COM not found in keytab (ticket kvno 2)
0808 11:32:36.767860 (+ 266us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46402: Request ticket server kudu/127.26.66.131@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":252,"threads_started":1}
W20260808 11:32:36.768306 4081 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46402: Request ticket server kudu/127.26.66.131@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260808 11:32:36.768317 26890 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 3885: Not authorized: Client connection negotiation failed: client connection to 127.26.66.131:33057: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.26.66.131@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 11:32:36.768464 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 3885
I20260808 11:32:36.789124 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 3520
I20260808 11:32:36.790503 3583 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:36.909577 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 3520
2026-08-08T11:32:36Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (21846 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T11:32:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:32:36Z Disabled control of system clock
I20260808 11:32:37.003077 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:45875
--webserver_interface=127.26.66.190
--webserver_port=0
--builtin_ntp_servers=127.26.66.148:37983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:45875
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 11:32:37.350113 4086 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:37.350383 4086 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:37.350461 4086 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:37.357640 4086 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:32:37.357745 4086 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:37.357795 4086 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:37.357851 4086 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:32:37.357895 4086 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:32:37.367450 4086 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:37983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:45875
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:45875
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:37.368691 4086 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:37.370452 4086 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:37.382747 4095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:37.382874 4093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:37.382834 4092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:37.383127 4086 server_base.cc:1034] running on GCE node
I20260808 11:32:37.384155 4086 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:37.385464 4086 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:37.386659 4086 hybrid_clock.cc:648] HybridClock initialized: now 1786188757386599 us; error 48 us; skew 500 ppm
I20260808 11:32:37.387005 4086 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:32:37.394484 4086 webserver.cc:460] Webserver started at http://127.26.66.190:34161/ using document root <none> and password file <none>
I20260808 11:32:37.395169 4086 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:37.395294 4086 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:37.395661 4086 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:32:37.398542 4086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "1fcfc20db961470c838c8cb885b4438d"
format_stamp: "Formatted at 2026-08-08 11:32:37 on dist-test-slave-zkpd"
server_key: "d87a066a5828e528fa5e9f8d6cacfd70"
server_key_iv: "07beceee8a7a6b43cb95a21f53b78ed0"
server_key_version: "encryptionkey@0"
I20260808 11:32:37.399325 4086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "1fcfc20db961470c838c8cb885b4438d"
format_stamp: "Formatted at 2026-08-08 11:32:37 on dist-test-slave-zkpd"
server_key: "d87a066a5828e528fa5e9f8d6cacfd70"
server_key_iv: "07beceee8a7a6b43cb95a21f53b78ed0"
server_key_version: "encryptionkey@0"
I20260808 11:32:37.404265 4086 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 11:32:37.407653 4101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:37.408953 4086 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:32:37.409126 4086 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "1fcfc20db961470c838c8cb885b4438d"
format_stamp: "Formatted at 2026-08-08 11:32:37 on dist-test-slave-zkpd"
server_key: "d87a066a5828e528fa5e9f8d6cacfd70"
server_key_iv: "07beceee8a7a6b43cb95a21f53b78ed0"
server_key_version: "encryptionkey@0"
I20260808 11:32:37.409341 4086 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:37.421028 4086 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:37.421769 4086 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:37.422057 4086 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:37.440452 4086 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:45875
I20260808 11:32:37.440475 4153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:45875 every 8 connection(s)
I20260808 11:32:37.441778 4086 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:32:37.445401 4154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:37.447660 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 4086
I20260808 11:32:37.447928 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:32:37.448601 26890 external_mini_cluster.cc:1428] Setting key f2502c407202cf02d074b5a74686d75a
I20260808 11:32:37.457233 4154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fcfc20db961470c838c8cb885b4438d: Bootstrap starting.
I20260808 11:32:37.461582 4154 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1fcfc20db961470c838c8cb885b4438d: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:37.463013 4154 log.cc:824] T 00000000000000000000000000000000 P 1fcfc20db961470c838c8cb885b4438d: Log is configured to *not* fsync() on all Append() calls
I20260808 11:32:37.464547 4157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:37.450636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48102 (local address 127.26.66.190:45875)
0808 11:32:37.451648 (+ 1012us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:37.451659 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:37.451698 (+ 39us) server_negotiation.cc:407] Connection header received
0808 11:32:37.453334 (+ 1636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:37.453356 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:37.453841 (+ 485us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:37.454154 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:37.454876 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:37.456237 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:37.458178 (+ 1941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:37.459416 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:37.459619 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:37.461218 (+ 1599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:37.461231 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:37.461253 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:32:37.462058 (+ 805us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:37.462204 (+ 146us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:32:37.462233 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:37.462368 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:37.462704 (+ 336us) server_negotiation.cc:299] Negotiation successful
0808 11:32:37.463151 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":637,"thread_start_us":393,"threads_started":1}
I20260808 11:32:37.466655 4154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fcfc20db961470c838c8cb885b4438d: No bootstrap required, opened a new log
I20260808 11:32:37.474574 4154 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1fcfc20db961470c838c8cb885b4438d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fcfc20db961470c838c8cb885b4438d" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45875 } }
I20260808 11:32:37.474891 4154 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1fcfc20db961470c838c8cb885b4438d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:37.474965 4154 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1fcfc20db961470c838c8cb885b4438d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fcfc20db961470c838c8cb885b4438d, State: Initialized, Role: FOLLOWER
I20260808 11:32:37.475509 4154 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1fcfc20db961470c838c8cb885b4438d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fcfc20db961470c838c8cb885b4438d" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45875 } }
I20260808 11:32:37.475708 4154 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1fcfc20db961470c838c8cb885b4438d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:32:37.475811 4154 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1fcfc20db961470c838c8cb885b4438d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:32:37.476001 4154 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1fcfc20db961470c838c8cb885b4438d [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:37.478166 4154 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1fcfc20db961470c838c8cb885b4438d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fcfc20db961470c838c8cb885b4438d" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45875 } }
I20260808 11:32:37.478595 4154 leader_election.cc:302] T 00000000000000000000000000000000 P 1fcfc20db961470c838c8cb885b4438d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1fcfc20db961470c838c8cb885b4438d; no voters:
I20260808 11:32:37.479099 4154 leader_election.cc:288] T 00000000000000000000000000000000 P 1fcfc20db961470c838c8cb885b4438d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:32:37.479254 4159 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1fcfc20db961470c838c8cb885b4438d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:32:37.480427 4159 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1fcfc20db961470c838c8cb885b4438d [term 1 LEADER]: Becoming Leader. State: Replica: 1fcfc20db961470c838c8cb885b4438d, State: Running, Role: LEADER
I20260808 11:32:37.480968 4159 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1fcfc20db961470c838c8cb885b4438d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fcfc20db961470c838c8cb885b4438d" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45875 } }
I20260808 11:32:37.481401 4154 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1fcfc20db961470c838c8cb885b4438d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:32:37.483697 4161 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fcfc20db961470c838c8cb885b4438d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1fcfc20db961470c838c8cb885b4438d. Latest consensus state: current_term: 1 leader_uuid: "1fcfc20db961470c838c8cb885b4438d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fcfc20db961470c838c8cb885b4438d" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45875 } } }
I20260808 11:32:37.483799 4160 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fcfc20db961470c838c8cb885b4438d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1fcfc20db961470c838c8cb885b4438d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fcfc20db961470c838c8cb885b4438d" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45875 } } }
I20260808 11:32:37.484130 4161 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fcfc20db961470c838c8cb885b4438d [sys.catalog]: This master's current role is: LEADER
I20260808 11:32:37.484242 4160 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fcfc20db961470c838c8cb885b4438d [sys.catalog]: This master's current role is: LEADER
I20260808 11:32:37.487805 4165 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:32:37.492853 4165 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:32:37.503579 4165 catalog_manager.cc:1347] Generated new cluster ID: 0ca6ef4fb7944600b1929551ceed6f30
I20260808 11:32:37.503693 4165 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:32:37.529655 4165 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:32:37.530946 4165 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:32:37.544936 4165 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1fcfc20db961470c838c8cb885b4438d: Generated new TSK 0
I20260808 11:32:37.545760 4165 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:32:37.553268 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:0
--local_ip_for_outbound_sockets=127.26.66.129
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45875
--builtin_ntp_servers=127.26.66.148:37983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 11:32:37.893468 4179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:37.893786 4179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:37.893954 4179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:37.901087 4179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:37.901177 4179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:37.901376 4179 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:32:37.910147 4179 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:37983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45875
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:37.911346 4179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:37.913183 4179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:37.926450 4187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:37.926585 4184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:37.926479 4185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:37.927556 4179 server_base.cc:1034] running on GCE node
I20260808 11:32:37.928239 4179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:37.929199 4179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:37.930402 4179 hybrid_clock.cc:648] HybridClock initialized: now 1786188757930354 us; error 40 us; skew 500 ppm
I20260808 11:32:37.930720 4179 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:32:37.933130 4179 webserver.cc:460] Webserver started at http://127.26.66.129:42825/ using document root <none> and password file <none>
I20260808 11:32:37.933837 4179 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:37.933959 4179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:37.934295 4179 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:32:37.937150 4179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/data/instance:
uuid: "cae0e8791a494eedb196547079634b52"
format_stamp: "Formatted at 2026-08-08 11:32:37 on dist-test-slave-zkpd"
server_key: "b639e72a7f3e6c250f23eadd79ad4514"
server_key_iv: "c13fb88fa3dc6b603c99ce51fc663de2"
server_key_version: "encryptionkey@0"
I20260808 11:32:37.937944 4179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance:
uuid: "cae0e8791a494eedb196547079634b52"
format_stamp: "Formatted at 2026-08-08 11:32:37 on dist-test-slave-zkpd"
server_key: "b639e72a7f3e6c250f23eadd79ad4514"
server_key_iv: "c13fb88fa3dc6b603c99ce51fc663de2"
server_key_version: "encryptionkey@0"
I20260808 11:32:37.942948 4179 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 11:32:37.946303 4193 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:37.947525 4179 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 11:32:37.947702 4179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "cae0e8791a494eedb196547079634b52"
format_stamp: "Formatted at 2026-08-08 11:32:37 on dist-test-slave-zkpd"
server_key: "b639e72a7f3e6c250f23eadd79ad4514"
server_key_iv: "c13fb88fa3dc6b603c99ce51fc663de2"
server_key_version: "encryptionkey@0"
I20260808 11:32:37.947939 4179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:37.971148 4179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:37.971992 4179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:37.972265 4179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:37.973178 4179 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:32:37.974596 4179 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:32:37.974682 4179 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:37.974761 4179 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:32:37.974823 4179 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:38.009099 4179 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:44997
I20260808 11:32:38.009189 4307 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:44997 every 8 connection(s)
I20260808 11:32:38.010402 4179 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:32:38.014323 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 4179
I20260808 11:32:38.014567 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance
I20260808 11:32:38.015317 26890 external_mini_cluster.cc:1428] Setting key 9c13cd005514460f2509c0f753876f3e
I20260808 11:32:38.017988 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:0
--local_ip_for_outbound_sockets=127.26.66.130
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45875
--builtin_ntp_servers=127.26.66.148:37983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 11:32:38.023137 4310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:38.013073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:36113 (local address 127.26.66.190:45875)
0808 11:32:38.013528 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:38.013532 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:38.014883 (+ 1351us) server_negotiation.cc:407] Connection header received
0808 11:32:38.016781 (+ 1898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:38.016787 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:38.016873 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:38.017003 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:38.018023 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:38.018800 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:38.020413 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:38.020831 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:38.020969 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:38.022297 (+ 1328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:38.022302 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:38.022305 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:32:38.022330 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:38.022378 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:32:38.022390 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:38.022487 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:38.022708 (+ 221us) server_negotiation.cc:299] Negotiation successful
0808 11:32:38.022809 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":205,"threads_started":1}
I20260808 11:32:38.024147 4311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:38.013666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45875 (local address 127.26.66.129:36113)
0808 11:32:38.014725 (+ 1059us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:38.014764 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:38.016520 (+ 1756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:38.017226 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:38.017234 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:38.017324 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:38.017859 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:38.017875 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:38.018976 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:38.018980 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:38.020270 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:38.020282 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:38.021060 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:38.021067 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:38.021309 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:38.021998 (+ 689us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 11:32:38.022001 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:38.022038 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 11:32:38.022113 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:38.022488 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:38.022503 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:38.022514 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 11:32:38.022695 (+ 181us) client_negotiation.cc:240] Negotiation successful
0808 11:32:38.023085 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":317,"threads_started":1}
I20260808 11:32:38.025674 4308 heartbeater.cc:347] Connected to a master server at 127.26.66.190:45875
I20260808 11:32:38.025974 4308 heartbeater.cc:464] Registering TS with master...
I20260808 11:32:38.026677 4308 heartbeater.cc:511] Master 127.26.66.190:45875 requested a full tablet report, sending...
I20260808 11:32:38.028913 4118 ts_manager.cc:194] Registered new tserver with Master: cae0e8791a494eedb196547079634b52 (127.26.66.129:44997)
I20260808 11:32:38.030779 4118 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.66.129:36113
W20260808 11:32:38.362766 4312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:38.363040 4312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:38.363126 4312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:38.370272 4312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:38.370362 4312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:38.370460 4312 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:32:38.379372 4312 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:37983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45875
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:38.380533 4312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:38.382269 4312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:38.395177 4318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:38.395401 4320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:38.395675 4317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:38.396241 4312 server_base.cc:1034] running on GCE node
I20260808 11:32:38.396855 4312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:38.397718 4312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:38.398948 4312 hybrid_clock.cc:648] HybridClock initialized: now 1786188758398912 us; error 47 us; skew 500 ppm
I20260808 11:32:38.399263 4312 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:32:38.401512 4312 webserver.cc:460] Webserver started at http://127.26.66.130:45693/ using document root <none> and password file <none>
I20260808 11:32:38.402176 4312 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:38.402313 4312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:38.402645 4312 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:32:38.405548 4312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/data/instance:
uuid: "ea585b7bd2b74b528966e21ca984b196"
format_stamp: "Formatted at 2026-08-08 11:32:38 on dist-test-slave-zkpd"
server_key: "3852ab37ff9aef38e8229c0d55716570"
server_key_iv: "0fa72723140868f0d434d9d0696ee35a"
server_key_version: "encryptionkey@0"
I20260808 11:32:38.406373 4312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance:
uuid: "ea585b7bd2b74b528966e21ca984b196"
format_stamp: "Formatted at 2026-08-08 11:32:38 on dist-test-slave-zkpd"
server_key: "3852ab37ff9aef38e8229c0d55716570"
server_key_iv: "0fa72723140868f0d434d9d0696ee35a"
server_key_version: "encryptionkey@0"
I20260808 11:32:38.411193 4312 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 11:32:38.414588 4326 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:38.415817 4312 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 11:32:38.416025 4312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "ea585b7bd2b74b528966e21ca984b196"
format_stamp: "Formatted at 2026-08-08 11:32:38 on dist-test-slave-zkpd"
server_key: "3852ab37ff9aef38e8229c0d55716570"
server_key_iv: "0fa72723140868f0d434d9d0696ee35a"
server_key_version: "encryptionkey@0"
I20260808 11:32:38.416249 4312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:38.430114 4312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:38.430887 4312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:38.431196 4312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:38.432209 4312 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:32:38.433619 4312 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:32:38.433758 4312 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:38.433897 4312 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:32:38.433984 4312 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:38.469743 4312 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:39009
I20260808 11:32:38.469799 4439 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:39009 every 8 connection(s)
I20260808 11:32:38.471017 4312 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:32:38.478765 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 4312
I20260808 11:32:38.478981 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance
I20260808 11:32:38.479574 26890 external_mini_cluster.cc:1428] Setting key 1278811dd5b0c512c208b6277f5b4f5a
I20260808 11:32:38.482803 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:0
--local_ip_for_outbound_sockets=127.26.66.131
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45875
--builtin_ntp_servers=127.26.66.148:37983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 11:32:38.484124 4310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:38.473557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:59375 (local address 127.26.66.190:45875)
0808 11:32:38.473782 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:38.473786 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:38.475075 (+ 1289us) server_negotiation.cc:407] Connection header received
0808 11:32:38.476901 (+ 1826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:38.476907 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:38.477000 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:38.477118 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:38.478263 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:38.479416 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:38.481078 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:38.481503 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:38.481645 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:38.483282 (+ 1637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:38.483287 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:38.483290 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:32:38.483307 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:38.483342 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:32:38.483353 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:38.483454 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:38.483698 (+ 244us) server_negotiation.cc:299] Negotiation successful
0808 11:32:38.483798 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 11:32:38.485105 4442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:38.474051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45875 (local address 127.26.66.130:59375)
0808 11:32:38.474919 (+ 868us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:38.474954 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:38.476639 (+ 1685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:38.477350 (+ 711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:38.477358 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:38.477437 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:38.478037 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:38.478062 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:38.479578 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:38.479582 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:38.480905 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:38.480917 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:38.481777 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:38.481787 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:38.482005 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:38.482929 (+ 924us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 11:32:38.482936 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:38.483001 (+ 65us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 11:32:38.483091 (+ 90us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:38.483456 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:38.483470 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:38.483481 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 11:32:38.483679 (+ 198us) client_negotiation.cc:240] Negotiation successful
0808 11:32:38.484086 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":277,"threads_started":1}
I20260808 11:32:38.486487 4440 heartbeater.cc:347] Connected to a master server at 127.26.66.190:45875
I20260808 11:32:38.486804 4440 heartbeater.cc:464] Registering TS with master...
I20260808 11:32:38.487772 4440 heartbeater.cc:511] Master 127.26.66.190:45875 requested a full tablet report, sending...
I20260808 11:32:38.489428 4118 ts_manager.cc:194] Registered new tserver with Master: ea585b7bd2b74b528966e21ca984b196 (127.26.66.130:39009)
I20260808 11:32:38.490607 4118 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.66.130:59375
W20260808 11:32:38.825829 4443 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:38.826088 4443 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:38.826236 4443 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:38.833386 4443 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:38.833482 4443 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:38.833649 4443 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:32:38.843209 4443 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:37983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45875
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:38.844559 4443 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:38.846323 4443 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:38.859436 4449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:38.859656 4450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:38.859659 4452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:38.860589 4443 server_base.cc:1034] running on GCE node
I20260808 11:32:38.861176 4443 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:38.862099 4443 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:38.863325 4443 hybrid_clock.cc:648] HybridClock initialized: now 1786188758863275 us; error 58 us; skew 500 ppm
I20260808 11:32:38.863641 4443 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:32:38.865871 4443 webserver.cc:460] Webserver started at http://127.26.66.131:40697/ using document root <none> and password file <none>
I20260808 11:32:38.866583 4443 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:38.866719 4443 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:38.867058 4443 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:32:38.869957 4443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/data/instance:
uuid: "44c438b09d334ce892aa6070b7866792"
format_stamp: "Formatted at 2026-08-08 11:32:38 on dist-test-slave-zkpd"
server_key: "7668960ec06f341175b4af8469572800"
server_key_iv: "38f05aad6e40644410343ce30689168e"
server_key_version: "encryptionkey@0"
I20260808 11:32:38.870764 4443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance:
uuid: "44c438b09d334ce892aa6070b7866792"
format_stamp: "Formatted at 2026-08-08 11:32:38 on dist-test-slave-zkpd"
server_key: "7668960ec06f341175b4af8469572800"
server_key_iv: "38f05aad6e40644410343ce30689168e"
server_key_version: "encryptionkey@0"
I20260808 11:32:38.875782 4443 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 11:32:38.879365 4458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:38.880692 4443 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:32:38.880880 4443 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "44c438b09d334ce892aa6070b7866792"
format_stamp: "Formatted at 2026-08-08 11:32:38 on dist-test-slave-zkpd"
server_key: "7668960ec06f341175b4af8469572800"
server_key_iv: "38f05aad6e40644410343ce30689168e"
server_key_version: "encryptionkey@0"
I20260808 11:32:38.881107 4443 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:38.900348 4443 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:38.901182 4443 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:38.901508 4443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:38.902552 4443 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:32:38.904013 4443 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:32:38.904142 4443 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:38.904278 4443 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:32:38.904373 4443 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:38.938588 4443 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:42653
I20260808 11:32:38.938644 4572 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:42653 every 8 connection(s)
I20260808 11:32:38.939962 4443 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:32:38.943256 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 4443
I20260808 11:32:38.943506 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance
I20260808 11:32:38.944134 26890 external_mini_cluster.cc:1428] Setting key 5c42bc24ea451e3b5f9e85ae437d022a
I20260808 11:32:38.952785 4310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:38.942508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:58001 (local address 127.26.66.190:45875)
0808 11:32:38.942690 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:38.942694 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:38.944375 (+ 1681us) server_negotiation.cc:407] Connection header received
0808 11:32:38.946324 (+ 1949us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:38.946330 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:38.946424 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:38.946538 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:38.947617 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:38.948439 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:38.949988 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:38.950424 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:38.950565 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:38.951953 (+ 1388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:38.951958 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:38.951962 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:32:38.951981 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:38.952011 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:32:38.952023 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:38.952125 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:38.952355 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 11:32:38.952453 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 11:32:38.953737 4575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:38.943041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45875 (local address 127.26.66.131:58001)
0808 11:32:38.944171 (+ 1130us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:38.944242 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:38.946036 (+ 1794us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:38.946782 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:38.946790 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:38.946883 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:38.947443 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:38.947461 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:38.948598 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:38.948603 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:38.949844 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:38.949857 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:38.950657 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:38.950666 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:38.950965 (+ 299us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:38.951591 (+ 626us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 11:32:38.951594 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:38.951631 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 11:32:38.951710 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:38.952127 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:38.952142 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:38.952153 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 11:32:38.952333 (+ 180us) client_negotiation.cc:240] Negotiation successful
0808 11:32:38.952719 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":348,"threads_started":1}
I20260808 11:32:38.955044 4573 heartbeater.cc:347] Connected to a master server at 127.26.66.190:45875
I20260808 11:32:38.955339 4573 heartbeater.cc:464] Registering TS with master...
I20260808 11:32:38.956179 4573 heartbeater.cc:511] Master 127.26.66.190:45875 requested a full tablet report, sending...
I20260808 11:32:38.957489 4118 ts_manager.cc:194] Registered new tserver with Master: 44c438b09d334ce892aa6070b7866792 (127.26.66.131:42653)
I20260808 11:32:38.958477 4118 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.66.131:58001
I20260808 11:32:38.959337 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 11:32:38.965916 4310 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:38.964395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48114 (local address 127.26.66.190:45875)
0808 11:32:38.964549 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:38.964553 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:38.965042 (+ 489us) server_negotiation.cc:407] Connection header received
0808 11:32:38.965170 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:38.965174 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:38.965243 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:38.965328 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:38.965665 (+ 337us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48114: BlockingRecv error: recv got EOF from 127.0.0.1:48114 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 11:32:38.966702 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 4179
I20260808 11:32:38.974359 4584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:38.967646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60594 (local address 127.26.66.129:44997)
0808 11:32:38.968201 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:38.968207 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:38.968230 (+ 23us) server_negotiation.cc:407] Connection header received
0808 11:32:38.968282 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:38.968294 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:38.968469 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:38.968627 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:38.969032 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:38.970006 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:38.971234 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:38.971767 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:38.971906 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:38.972957 (+ 1051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:38.972965 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:38.972976 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:32:38.973517 (+ 541us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:38.973561 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:32:38.973581 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:38.973721 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:38.973885 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 11:32:38.974029 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":250,"threads_started":1}
I20260808 11:32:38.975487 4303 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:39.061594 4308 heartbeater.cc:503] Master 127.26.66.190:45875 was elected leader, sending a full tablet report...
I20260808 11:32:39.063128 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 4179
W20260808 11:32:39.083794 4103 connection.cc:535] server connection from 127.26.66.129:36113 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 11:32:39.084100 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 4312
I20260808 11:32:39.091856 4586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:39.085127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38166 (local address 127.26.66.130:39009)
0808 11:32:39.085746 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:39.085753 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:39.085781 (+ 28us) server_negotiation.cc:407] Connection header received
0808 11:32:39.085851 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:39.085857 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:39.086069 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:39.086197 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:39.086550 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:39.087525 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:39.088878 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:39.089426 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:39.089523 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:39.090463 (+ 940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:39.090471 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:39.090484 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:32:39.091074 (+ 590us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:39.091118 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:32:39.091142 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:39.091230 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:39.091362 (+ 132us) server_negotiation.cc:299] Negotiation successful
0808 11:32:39.091529 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":328,"threads_started":1}
I20260808 11:32:39.093151 4435 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:39.175976 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 4312
I20260808 11:32:39.197176 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 4443
I20260808 11:32:39.205389 4588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:39.198280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43358 (local address 127.26.66.131:42653)
0808 11:32:39.198981 (+ 701us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:39.198988 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:39.199020 (+ 32us) server_negotiation.cc:407] Connection header received
0808 11:32:39.199082 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:39.199089 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:39.199313 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:39.199440 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:39.199832 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:39.200953 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:39.202119 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:39.202677 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:39.202787 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:39.203929 (+ 1142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:39.203942 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:39.203962 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:32:39.204557 (+ 595us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:39.204603 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:32:39.204622 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:39.204710 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:39.204853 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 11:32:39.204999 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":536,"thread_start_us":362,"threads_started":1}
I20260808 11:32:39.206727 4568 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:39.293428 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 4443
I20260808 11:32:39.313807 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 4086
I20260808 11:32:39.315014 4149 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:39.418980 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 4086
2026-08-08T11:32:39Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2502 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T11:32:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:32:39Z Disabled control of system clock
I20260808 11:32:39.507855 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:46773
--webserver_interface=127.26.66.190
--webserver_port=0
--builtin_ntp_servers=127.26.66.148:43751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:46773
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 11:32:39.848171 4594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:39.848474 4594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:39.848565 4594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:39.855857 4594 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:32:39.855988 4594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:39.856027 4594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:39.856078 4594 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:32:39.856123 4594 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:32:39.865394 4594 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:43751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:46773
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:46773
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:39.866729 4594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:39.868567 4594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:39.880522 4600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:39.880575 4601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:39.880611 4603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:39.881793 4594 server_base.cc:1034] running on GCE node
I20260808 11:32:39.882515 4594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:39.883867 4594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:39.885136 4594 hybrid_clock.cc:648] HybridClock initialized: now 1786188759885078 us; error 25 us; skew 500 ppm
I20260808 11:32:39.885589 4594 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:32:39.887965 4594 webserver.cc:460] Webserver started at http://127.26.66.190:42245/ using document root <none> and password file <none>
I20260808 11:32:39.888634 4594 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:39.888721 4594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:39.888993 4594 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:32:39.893605 4594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "e3a1ff49f19843bfa302f684f2485bd2"
format_stamp: "Formatted at 2026-08-08 11:32:39 on dist-test-slave-zkpd"
server_key: "4ed4992446ebc31b02e1f62e14d8d5d1"
server_key_iv: "9c0da4924da271089fbafd74152b4074"
server_key_version: "encryptionkey@0"
I20260808 11:32:39.894387 4594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "e3a1ff49f19843bfa302f684f2485bd2"
format_stamp: "Formatted at 2026-08-08 11:32:39 on dist-test-slave-zkpd"
server_key: "4ed4992446ebc31b02e1f62e14d8d5d1"
server_key_iv: "9c0da4924da271089fbafd74152b4074"
server_key_version: "encryptionkey@0"
I20260808 11:32:39.899483 4594 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 11:32:39.902949 4609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:39.904425 4594 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:32:39.904572 4594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "e3a1ff49f19843bfa302f684f2485bd2"
format_stamp: "Formatted at 2026-08-08 11:32:39 on dist-test-slave-zkpd"
server_key: "4ed4992446ebc31b02e1f62e14d8d5d1"
server_key_iv: "9c0da4924da271089fbafd74152b4074"
server_key_version: "encryptionkey@0"
I20260808 11:32:39.904755 4594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:39.910342 4594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:39.911062 4594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:39.911327 4594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:39.929415 4594 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:46773
I20260808 11:32:39.929452 4665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:46773 every 8 connection(s)
I20260808 11:32:39.930712 4594 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:32:39.932670 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 4594
I20260808 11:32:39.932891 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:32:39.933576 26890 external_mini_cluster.cc:1428] Setting key 64feb30e6cc1e93128cbdc043ef2fffb
I20260808 11:32:39.934867 4666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:39.944084 4669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:39.935841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43682 (local address 127.26.66.190:46773)
0808 11:32:39.938625 (+ 2784us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:39.938642 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:39.938769 (+ 127us) server_negotiation.cc:407] Connection header received
0808 11:32:39.940485 (+ 1716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:39.940505 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:39.940911 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:39.941328 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:39.942418 (+ 1090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:39.942424 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:39.942439 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:32:39.942454 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:39.942515 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:32:39.942530 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:39.942786 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:39.942927 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 11:32:39.943164 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2207,"thread_start_us":1965,"threads_started":1}
I20260808 11:32:39.949615 4666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3a1ff49f19843bfa302f684f2485bd2: Bootstrap starting.
I20260808 11:32:39.952543 4666 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e3a1ff49f19843bfa302f684f2485bd2: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:39.953536 4666 log.cc:824] T 00000000000000000000000000000000 P e3a1ff49f19843bfa302f684f2485bd2: Log is configured to *not* fsync() on all Append() calls
I20260808 11:32:39.956490 4666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3a1ff49f19843bfa302f684f2485bd2: No bootstrap required, opened a new log
I20260808 11:32:39.963716 4666 raft_consensus.cc:348] T 00000000000000000000000000000000 P e3a1ff49f19843bfa302f684f2485bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3a1ff49f19843bfa302f684f2485bd2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46773 } }
I20260808 11:32:39.964169 4666 raft_consensus.cc:374] T 00000000000000000000000000000000 P e3a1ff49f19843bfa302f684f2485bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:39.964247 4666 raft_consensus.cc:729] T 00000000000000000000000000000000 P e3a1ff49f19843bfa302f684f2485bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3a1ff49f19843bfa302f684f2485bd2, State: Initialized, Role: FOLLOWER
I20260808 11:32:39.964737 4666 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3a1ff49f19843bfa302f684f2485bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3a1ff49f19843bfa302f684f2485bd2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46773 } }
I20260808 11:32:39.964959 4666 raft_consensus.cc:388] T 00000000000000000000000000000000 P e3a1ff49f19843bfa302f684f2485bd2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:32:39.965057 4666 raft_consensus.cc:482] T 00000000000000000000000000000000 P e3a1ff49f19843bfa302f684f2485bd2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:32:39.965179 4666 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e3a1ff49f19843bfa302f684f2485bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:39.967214 4666 raft_consensus.cc:504] T 00000000000000000000000000000000 P e3a1ff49f19843bfa302f684f2485bd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3a1ff49f19843bfa302f684f2485bd2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46773 } }
I20260808 11:32:39.967645 4666 leader_election.cc:302] T 00000000000000000000000000000000 P e3a1ff49f19843bfa302f684f2485bd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e3a1ff49f19843bfa302f684f2485bd2; no voters:
I20260808 11:32:39.968237 4666 leader_election.cc:288] T 00000000000000000000000000000000 P e3a1ff49f19843bfa302f684f2485bd2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:32:39.968376 4672 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e3a1ff49f19843bfa302f684f2485bd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:32:39.969115 4672 raft_consensus.cc:686] T 00000000000000000000000000000000 P e3a1ff49f19843bfa302f684f2485bd2 [term 1 LEADER]: Becoming Leader. State: Replica: e3a1ff49f19843bfa302f684f2485bd2, State: Running, Role: LEADER
I20260808 11:32:39.969696 4672 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3a1ff49f19843bfa302f684f2485bd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3a1ff49f19843bfa302f684f2485bd2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46773 } }
I20260808 11:32:39.970364 4666 sys_catalog.cc:564] T 00000000000000000000000000000000 P e3a1ff49f19843bfa302f684f2485bd2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:32:39.972849 4674 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3a1ff49f19843bfa302f684f2485bd2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3a1ff49f19843bfa302f684f2485bd2. Latest consensus state: current_term: 1 leader_uuid: "e3a1ff49f19843bfa302f684f2485bd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3a1ff49f19843bfa302f684f2485bd2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46773 } } }
I20260808 11:32:39.973575 4674 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3a1ff49f19843bfa302f684f2485bd2 [sys.catalog]: This master's current role is: LEADER
I20260808 11:32:39.973623 4673 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3a1ff49f19843bfa302f684f2485bd2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e3a1ff49f19843bfa302f684f2485bd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3a1ff49f19843bfa302f684f2485bd2" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46773 } } }
I20260808 11:32:39.975034 4673 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3a1ff49f19843bfa302f684f2485bd2 [sys.catalog]: This master's current role is: LEADER
I20260808 11:32:39.976675 4681 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:32:39.981845 4681 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:32:39.990720 4681 catalog_manager.cc:1347] Generated new cluster ID: dabb632d91634e9399125eb621e97e9f
I20260808 11:32:39.990820 4681 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:32:40.008693 4681 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:32:40.009204 4681 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:32:40.018641 4681 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e3a1ff49f19843bfa302f684f2485bd2: Generated new TSK 0
I20260808 11:32:40.019703 4681 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:32:40.028910 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:0
--local_ip_for_outbound_sockets=127.26.66.129
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46773
--builtin_ntp_servers=127.26.66.148:43751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 11:32:40.378865 4691 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:40.379163 4691 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:40.379333 4691 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:40.386415 4691 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:40.386549 4691 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:40.386722 4691 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:32:40.395493 4691 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:43751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46773
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:40.396757 4691 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:40.398555 4691 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:40.411779 4697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:40.411715 4699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:40.411818 4696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:40.412917 4691 server_base.cc:1034] running on GCE node
I20260808 11:32:40.413537 4691 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:40.414484 4691 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:40.415704 4691 hybrid_clock.cc:648] HybridClock initialized: now 1786188760415632 us; error 88 us; skew 500 ppm
I20260808 11:32:40.416036 4691 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:32:40.418378 4691 webserver.cc:460] Webserver started at http://127.26.66.129:45421/ using document root <none> and password file <none>
I20260808 11:32:40.419005 4691 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:40.419088 4691 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:40.419371 4691 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:32:40.422130 4691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/data/instance:
uuid: "2bfd304b9d55433ca931fe87b0f46ac7"
format_stamp: "Formatted at 2026-08-08 11:32:40 on dist-test-slave-zkpd"
server_key: "03150d3f432903881a4051ab0d829aca"
server_key_iv: "af2cc56576c9fd1235edcc62e21eed95"
server_key_version: "encryptionkey@0"
I20260808 11:32:40.422858 4691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance:
uuid: "2bfd304b9d55433ca931fe87b0f46ac7"
format_stamp: "Formatted at 2026-08-08 11:32:40 on dist-test-slave-zkpd"
server_key: "03150d3f432903881a4051ab0d829aca"
server_key_iv: "af2cc56576c9fd1235edcc62e21eed95"
server_key_version: "encryptionkey@0"
I20260808 11:32:40.427774 4691 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 11:32:40.431099 4705 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:40.432431 4691 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:32:40.432559 4691 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "2bfd304b9d55433ca931fe87b0f46ac7"
format_stamp: "Formatted at 2026-08-08 11:32:40 on dist-test-slave-zkpd"
server_key: "03150d3f432903881a4051ab0d829aca"
server_key_iv: "af2cc56576c9fd1235edcc62e21eed95"
server_key_version: "encryptionkey@0"
I20260808 11:32:40.432744 4691 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:40.438103 4691 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:40.438872 4691 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:40.439088 4691 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:40.439972 4691 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:32:40.441310 4691 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:32:40.441394 4691 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:40.441473 4691 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:32:40.441526 4691 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:40.475060 4691 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:34449
I20260808 11:32:40.475206 4821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:34449 every 8 connection(s)
I20260808 11:32:40.476655 4691 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:32:40.479784 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 4691
I20260808 11:32:40.480039 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance
I20260808 11:32:40.480712 26890 external_mini_cluster.cc:1428] Setting key 293f2715690329a2306a7b8127a8b0e0
I20260808 11:32:40.483563 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:0
--local_ip_for_outbound_sockets=127.26.66.130
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46773
--builtin_ntp_servers=127.26.66.148:43751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 11:32:40.485879 4824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:40.479408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:58935 (local address 127.26.66.190:46773)
0808 11:32:40.479930 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:40.479936 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:40.481291 (+ 1355us) server_negotiation.cc:407] Connection header received
0808 11:32:40.483381 (+ 2090us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:40.483387 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:40.483461 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:40.483592 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:40.485001 (+ 1409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:40.485009 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:40.485016 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:32:40.485039 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:40.485103 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:32:40.485122 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:40.485246 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:40.485428 (+ 182us) server_negotiation.cc:299] Negotiation successful
0808 11:32:40.485495 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":245,"threads_started":1}
I20260808 11:32:40.486558 4825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:40.480007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:46773 (local address 127.26.66.129:58935)
0808 11:32:40.481106 (+ 1099us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:40.481158 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:40.483116 (+ 1958us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:40.483839 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:40.483853 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:40.484024 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:40.484707 (+ 683us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 11:32:40.484709 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:40.484744 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 11:32:40.484830 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:40.485221 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:40.485229 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:40.485234 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 11:32:40.485455 (+ 221us) client_negotiation.cc:240] Negotiation successful
0808 11:32:40.485640 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":365,"threads_started":1}
I20260808 11:32:40.488116 4822 heartbeater.cc:347] Connected to a master server at 127.26.66.190:46773
I20260808 11:32:40.488423 4822 heartbeater.cc:464] Registering TS with master...
I20260808 11:32:40.488997 4822 heartbeater.cc:511] Master 127.26.66.190:46773 requested a full tablet report, sending...
I20260808 11:32:40.490939 4628 ts_manager.cc:194] Registered new tserver with Master: 2bfd304b9d55433ca931fe87b0f46ac7 (127.26.66.129:34449)
W20260808 11:32:40.824318 4826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:40.824586 4826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:40.824774 4826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:40.831854 4826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:40.832021 4826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:40.832203 4826 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:32:40.841101 4826 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:43751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46773
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:40.842317 4826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:40.844074 4826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:40.856977 4831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:40.857014 4832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:40.857069 4834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:40.858150 4826 server_base.cc:1034] running on GCE node
I20260808 11:32:40.858723 4826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:40.859668 4826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:40.860895 4826 hybrid_clock.cc:648] HybridClock initialized: now 1786188760860844 us; error 71 us; skew 500 ppm
I20260808 11:32:40.861204 4826 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:32:40.863375 4826 webserver.cc:460] Webserver started at http://127.26.66.130:43323/ using document root <none> and password file <none>
I20260808 11:32:40.864236 4826 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:40.864382 4826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:40.864737 4826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:32:40.868476 4826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/data/instance:
uuid: "02c91e973f5c415eaad215f7d0118a26"
format_stamp: "Formatted at 2026-08-08 11:32:40 on dist-test-slave-zkpd"
server_key: "c1cc9f29c88342e177dc3df6c2dbbcbb"
server_key_iv: "88c75e7bad4724b3409fc6c8e353ff55"
server_key_version: "encryptionkey@0"
I20260808 11:32:40.869423 4826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance:
uuid: "02c91e973f5c415eaad215f7d0118a26"
format_stamp: "Formatted at 2026-08-08 11:32:40 on dist-test-slave-zkpd"
server_key: "c1cc9f29c88342e177dc3df6c2dbbcbb"
server_key_iv: "88c75e7bad4724b3409fc6c8e353ff55"
server_key_version: "encryptionkey@0"
I20260808 11:32:40.875360 4826 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 11:32:40.879068 4840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:40.880412 4826 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:32:40.880587 4826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "02c91e973f5c415eaad215f7d0118a26"
format_stamp: "Formatted at 2026-08-08 11:32:40 on dist-test-slave-zkpd"
server_key: "c1cc9f29c88342e177dc3df6c2dbbcbb"
server_key_iv: "88c75e7bad4724b3409fc6c8e353ff55"
server_key_version: "encryptionkey@0"
I20260808 11:32:40.880811 4826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:40.886461 4826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:40.887218 4826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:40.887495 4826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:40.888500 4826 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:32:40.889846 4826 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:32:40.889974 4826 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:40.890098 4826 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:32:40.890184 4826 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:40.923204 4826 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:38933
I20260808 11:32:40.923247 4957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:38933 every 8 connection(s)
I20260808 11:32:40.924539 4826 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:32:40.933188 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 4826
I20260808 11:32:40.933373 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance
I20260808 11:32:40.933727 4824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:40.927066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:34107 (local address 127.26.66.190:46773)
0808 11:32:40.927286 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:40.927292 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:40.928923 (+ 1631us) server_negotiation.cc:407] Connection header received
0808 11:32:40.931276 (+ 2353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:40.931281 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:40.931337 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:40.931450 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:40.932919 (+ 1469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:40.932928 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:40.932931 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:32:40.932952 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:40.932996 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:32:40.933012 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:40.933139 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:40.933355 (+ 216us) server_negotiation.cc:299] Negotiation successful
0808 11:32:40.933418 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 11:32:40.933916 26890 external_mini_cluster.cc:1428] Setting key ebe6b503e2a968cb5df617dce8f19691
I20260808 11:32:40.935357 4960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:40.927645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:46773 (local address 127.26.66.130:34107)
0808 11:32:40.928725 (+ 1080us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:40.928772 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:40.930997 (+ 2225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:40.931703 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:40.931714 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:40.931831 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:40.932543 (+ 712us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 11:32:40.932547 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:40.932608 (+ 61us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 11:32:40.932723 (+ 115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:40.933129 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:40.933139 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:40.933147 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 11:32:40.934025 (+ 878us) client_negotiation.cc:240] Negotiation successful
0808 11:32:40.934255 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":361,"threads_started":1}
I20260808 11:32:40.937004 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:0
--local_ip_for_outbound_sockets=127.26.66.131
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46773
--builtin_ntp_servers=127.26.66.148:43751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 11:32:40.937098 4958 heartbeater.cc:347] Connected to a master server at 127.26.66.190:46773
I20260808 11:32:40.937374 4958 heartbeater.cc:464] Registering TS with master...
I20260808 11:32:40.937987 4958 heartbeater.cc:511] Master 127.26.66.190:46773 requested a full tablet report, sending...
I20260808 11:32:40.939580 4628 ts_manager.cc:194] Registered new tserver with Master: 02c91e973f5c415eaad215f7d0118a26 (127.26.66.130:38933)
W20260808 11:32:41.293246 4961 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:41.293582 4961 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:41.293692 4961 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:41.301499 4961 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:41.301637 4961 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:41.301761 4961 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:32:41.311666 4961 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:43751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46773
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:41.313097 4961 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:41.314913 4961 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:41.328684 4969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:41.328653 4967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:41.329284 4966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:41.329748 4961 server_base.cc:1034] running on GCE node
I20260808 11:32:41.330454 4961 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:41.331401 4961 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:41.332636 4961 hybrid_clock.cc:648] HybridClock initialized: now 1786188761332582 us; error 40 us; skew 500 ppm
I20260808 11:32:41.332949 4961 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:32:41.335347 4961 webserver.cc:460] Webserver started at http://127.26.66.131:37045/ using document root <none> and password file <none>
I20260808 11:32:41.336135 4961 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:41.336234 4961 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:41.336525 4961 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:32:41.339458 4961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/data/instance:
uuid: "4fe520f49f4e46aca976d81def4f60d1"
format_stamp: "Formatted at 2026-08-08 11:32:41 on dist-test-slave-zkpd"
server_key: "5cb18d44e5adda1e893c860d912666bd"
server_key_iv: "9239b7140d401b98ad98a644d0d5e544"
server_key_version: "encryptionkey@0"
I20260808 11:32:41.340327 4961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance:
uuid: "4fe520f49f4e46aca976d81def4f60d1"
format_stamp: "Formatted at 2026-08-08 11:32:41 on dist-test-slave-zkpd"
server_key: "5cb18d44e5adda1e893c860d912666bd"
server_key_iv: "9239b7140d401b98ad98a644d0d5e544"
server_key_version: "encryptionkey@0"
I20260808 11:32:41.345417 4961 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 11:32:41.348802 4975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:41.350155 4961 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 11:32:41.350296 4961 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "4fe520f49f4e46aca976d81def4f60d1"
format_stamp: "Formatted at 2026-08-08 11:32:41 on dist-test-slave-zkpd"
server_key: "5cb18d44e5adda1e893c860d912666bd"
server_key_iv: "9239b7140d401b98ad98a644d0d5e544"
server_key_version: "encryptionkey@0"
I20260808 11:32:41.350500 4961 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:41.356252 4961 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:41.357028 4961 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:41.357259 4961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:41.358227 4961 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:32:41.359633 4961 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:32:41.359722 4961 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:41.359804 4961 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:32:41.359860 4961 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:41.394696 4961 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:40939
I20260808 11:32:41.394752 5095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:40939 every 8 connection(s)
I20260808 11:32:41.396204 4961 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:32:41.398617 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 4961
I20260808 11:32:41.398820 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance
I20260808 11:32:41.399438 26890 external_mini_cluster.cc:1428] Setting key 769ba76ecf87f034a316ac27bb0c4c97
I20260808 11:32:41.405675 4824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:41.399079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:50181 (local address 127.26.66.190:46773)
0808 11:32:41.399265 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:41.399269 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:41.401142 (+ 1873us) server_negotiation.cc:407] Connection header received
0808 11:32:41.403388 (+ 2246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:41.403393 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:41.403464 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:41.403587 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:41.404911 (+ 1324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:41.404917 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:41.404922 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:32:41.404941 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:41.404981 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:32:41.404993 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:41.405121 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:41.405320 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 11:32:41.405389 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 11:32:41.406581 5098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:41.399769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:46773 (local address 127.26.66.131:50181)
0808 11:32:41.400960 (+ 1191us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:41.401021 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:41.403128 (+ 2107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:41.403832 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:41.403840 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:41.403987 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:41.404606 (+ 619us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 11:32:41.404609 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:41.404645 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 11:32:41.404729 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:41.405087 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:41.405100 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:41.405110 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 11:32:41.405399 (+ 289us) client_negotiation.cc:240] Negotiation successful
0808 11:32:41.405653 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":616,"thread_start_us":372,"threads_started":1}
I20260808 11:32:41.407941 5096 heartbeater.cc:347] Connected to a master server at 127.26.66.190:46773
I20260808 11:32:41.408262 5096 heartbeater.cc:464] Registering TS with master...
I20260808 11:32:41.408967 5096 heartbeater.cc:511] Master 127.26.66.190:46773 requested a full tablet report, sending...
I20260808 11:32:41.410319 4628 ts_manager.cc:194] Registered new tserver with Master: 4fe520f49f4e46aca976d81def4f60d1 (127.26.66.131:40939)
I20260808 11:32:41.414889 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 11:32:41.421322 4824 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:32:41.419573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42910 (local address 127.26.66.190:46773)
0808 11:32:41.419793 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:41.419800 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:41.420350 (+ 550us) server_negotiation.cc:407] Connection header received
0808 11:32:41.420482 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:41.420486 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:41.420539 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:41.420621 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:41.421059 (+ 438us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42910: BlockingRecv error: recv got EOF from 127.0.0.1:42910 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 11:32:41.421778 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 4691
I20260808 11:32:41.425421 5105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:41.422778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36284 (local address 127.26.66.129:34449)
0808 11:32:41.423364 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:41.423371 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:41.423397 (+ 26us) server_negotiation.cc:407] Connection header received
0808 11:32:41.423456 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:41.423461 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:41.423653 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:41.423788 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:41.424799 (+ 1011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:41.424807 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:41.424818 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:32:41.424839 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:41.424884 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:32:41.424899 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:41.425010 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:41.425094 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 11:32:41.425172 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":306,"threads_started":1}
I20260808 11:32:41.426743 4817 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:41.511516 4822 heartbeater.cc:503] Master 127.26.66.190:46773 was elected leader, sending a full tablet report...
I20260808 11:32:41.512562 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 4691
W20260808 11:32:41.533201 4611 connection.cc:535] server connection from 127.26.66.129:58935 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 11:32:41.533452 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 4826
I20260808 11:32:41.537176 5107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:41.534500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50234 (local address 127.26.66.130:38933)
0808 11:32:41.535015 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:41.535022 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:41.535049 (+ 27us) server_negotiation.cc:407] Connection header received
0808 11:32:41.535114 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:41.535121 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:41.535367 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:41.535540 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:41.536490 (+ 950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:41.536497 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:41.536509 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:32:41.536520 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:41.536560 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:32:41.536574 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:41.536680 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:41.536779 (+ 99us) server_negotiation.cc:299] Negotiation successful
0808 11:32:41.536864 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":248,"threads_started":1}
I20260808 11:32:41.538426 4953 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:41.621006 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 4826
I20260808 11:32:41.641202 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 4961
I20260808 11:32:41.645138 5109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:41.642092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33236 (local address 127.26.66.131:40939)
0808 11:32:41.642691 (+ 599us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:41.642699 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:41.642730 (+ 31us) server_negotiation.cc:407] Connection header received
0808 11:32:41.642793 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:41.642799 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:41.643028 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:41.643204 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:41.644370 (+ 1166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:41.644377 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:41.644388 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:32:41.644400 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:41.644441 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:32:41.644454 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:41.644650 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:41.644723 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 11:32:41.644848 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":272,"threads_started":1}
I20260808 11:32:41.646394 5090 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:41.730325 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 4961
I20260808 11:32:41.750618 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 4594
I20260808 11:32:41.751981 4660 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:41.857349 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 4594
2026-08-08T11:32:41Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2439 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:32:41 dist-test-slave-zkpd krb5kdc[5114](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:32:41 dist-test-slave-zkpd krb5kdc[5114](info): set up 2 sockets
Aug 08 11:32:41 dist-test-slave-zkpd krb5kdc[5114](info): commencing operation
krb5kdc: starting...
W20260808 11:32:43.019281 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.004s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:32:43 dist-test-slave-zkpd krb5kdc[5114](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188763, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:32:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:32:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:32:43.315412 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:46085
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:44605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:46085
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:32:43.655429 5127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:43.655756 5127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:43.655982 5127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:43.663770 5127 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:32:43.663926 5127 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:43.664011 5127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:43.664093 5127 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:32:43.664157 5127 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:32:43.674129 5127 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:44605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:46085
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:46085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:43.675467 5127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:43.676878 5127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:43.689406 5132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:43.689343 5134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:43.689448 5136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:43.690231 5127 server_base.cc:1034] running on GCE node
I20260808 11:32:43.691048 5127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:43.692564 5127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:43.693799 5127 hybrid_clock.cc:648] HybridClock initialized: now 1786188763693752 us; error 36 us; skew 500 ppm
I20260808 11:32:43.694142 5127 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:32:43 dist-test-slave-zkpd krb5kdc[5114](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188763, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:32:43.697238 5127 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:32:43.698637 5127 webserver.cc:460] Webserver started at http://127.26.66.190:35679/ using document root <none> and password file <none>
I20260808 11:32:43.699311 5127 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:43.699456 5127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:43.699769 5127 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:32:43.702752 5127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "82469f1fe95f45fdaa8bd334671aa312"
format_stamp: "Formatted at 2026-08-08 11:32:43 on dist-test-slave-zkpd"
server_key: "d58b7cad6d94e82d03777901dbd89088"
server_key_iv: "41da51e64195583429d282339301d088"
server_key_version: "encryptionkey@0"
I20260808 11:32:43.703532 5127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "82469f1fe95f45fdaa8bd334671aa312"
format_stamp: "Formatted at 2026-08-08 11:32:43 on dist-test-slave-zkpd"
server_key: "d58b7cad6d94e82d03777901dbd89088"
server_key_iv: "41da51e64195583429d282339301d088"
server_key_version: "encryptionkey@0"
I20260808 11:32:43.708609 5127 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260808 11:32:43.712095 5143 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:43.713351 5127 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 11:32:43.713536 5127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "82469f1fe95f45fdaa8bd334671aa312"
format_stamp: "Formatted at 2026-08-08 11:32:43 on dist-test-slave-zkpd"
server_key: "d58b7cad6d94e82d03777901dbd89088"
server_key_iv: "41da51e64195583429d282339301d088"
server_key_version: "encryptionkey@0"
I20260808 11:32:43.713745 5127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:43.725350 5127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:43.729203 5127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:43.729491 5127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:43.747979 5127 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:46085
I20260808 11:32:43.748036 5198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:46085 every 8 connection(s)
I20260808 11:32:43.749383 5127 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:32:43.753333 5199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:43.753563 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 5127
I20260808 11:32:43.753796 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:32:43.754493 26890 external_mini_cluster.cc:1428] Setting key ffa1568747bec207295d532bf1f2baa2
I20260808 11:32:43.769490 5199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82469f1fe95f45fdaa8bd334671aa312: Bootstrap starting.
Aug 08 11:32:43 dist-test-slave-zkpd krb5kdc[5114](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188763, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:32:43.773537 5199 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82469f1fe95f45fdaa8bd334671aa312: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:43.775230 5199 log.cc:824] T 00000000000000000000000000000000 P 82469f1fe95f45fdaa8bd334671aa312: Log is configured to *not* fsync() on all Append() calls
I20260808 11:32:43.778970 5199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82469f1fe95f45fdaa8bd334671aa312: No bootstrap required, opened a new log
I20260808 11:32:43.781924 5202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:43.756511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52002 (local address 127.26.66.190:46085)
0808 11:32:43.757410 (+ 899us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:43.757427 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:43.757484 (+ 57us) server_negotiation.cc:407] Connection header received
0808 11:32:43.760782 (+ 3298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:43.760823 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:43.761387 (+ 564us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:43.761885 (+ 498us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:43.763242 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:43.765478 (+ 2236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:43.766794 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:43.767997 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:43.768211 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:43.772639 (+ 4428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:43.772651 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:43.772674 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:43.772733 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:43.777066 (+ 4333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:43.777782 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:43.777791 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:43.777799 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:43.778066 (+ 267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:43.778443 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:43.778448 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:43.778452 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:43.779191 (+ 739us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:43.779547 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:43.779924 (+ 377us) server_negotiation.cc:299] Negotiation successful
0808 11:32:43.780401 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":637,"thread_start_us":376,"threads_started":1}
I20260808 11:32:43.788951 5199 raft_consensus.cc:348] T 00000000000000000000000000000000 P 82469f1fe95f45fdaa8bd334671aa312 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82469f1fe95f45fdaa8bd334671aa312" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46085 } }
I20260808 11:32:43.789296 5199 raft_consensus.cc:374] T 00000000000000000000000000000000 P 82469f1fe95f45fdaa8bd334671aa312 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:43.789390 5199 raft_consensus.cc:729] T 00000000000000000000000000000000 P 82469f1fe95f45fdaa8bd334671aa312 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82469f1fe95f45fdaa8bd334671aa312, State: Initialized, Role: FOLLOWER
I20260808 11:32:43.790022 5199 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82469f1fe95f45fdaa8bd334671aa312 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82469f1fe95f45fdaa8bd334671aa312" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46085 } }
I20260808 11:32:43.790242 5199 raft_consensus.cc:388] T 00000000000000000000000000000000 P 82469f1fe95f45fdaa8bd334671aa312 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:32:43.790359 5199 raft_consensus.cc:482] T 00000000000000000000000000000000 P 82469f1fe95f45fdaa8bd334671aa312 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:32:43.790547 5199 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 82469f1fe95f45fdaa8bd334671aa312 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:43.793231 5199 raft_consensus.cc:504] T 00000000000000000000000000000000 P 82469f1fe95f45fdaa8bd334671aa312 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82469f1fe95f45fdaa8bd334671aa312" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46085 } }
I20260808 11:32:43.793772 5199 leader_election.cc:302] T 00000000000000000000000000000000 P 82469f1fe95f45fdaa8bd334671aa312 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 82469f1fe95f45fdaa8bd334671aa312; no voters:
I20260808 11:32:43.794401 5199 leader_election.cc:288] T 00000000000000000000000000000000 P 82469f1fe95f45fdaa8bd334671aa312 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:32:43.794495 5204 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 82469f1fe95f45fdaa8bd334671aa312 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:32:43.795388 5204 raft_consensus.cc:686] T 00000000000000000000000000000000 P 82469f1fe95f45fdaa8bd334671aa312 [term 1 LEADER]: Becoming Leader. State: Replica: 82469f1fe95f45fdaa8bd334671aa312, State: Running, Role: LEADER
I20260808 11:32:43.796007 5204 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82469f1fe95f45fdaa8bd334671aa312 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82469f1fe95f45fdaa8bd334671aa312" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46085 } }
I20260808 11:32:43.796933 5199 sys_catalog.cc:564] T 00000000000000000000000000000000 P 82469f1fe95f45fdaa8bd334671aa312 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:32:43.798758 5206 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82469f1fe95f45fdaa8bd334671aa312 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82469f1fe95f45fdaa8bd334671aa312. Latest consensus state: current_term: 1 leader_uuid: "82469f1fe95f45fdaa8bd334671aa312" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82469f1fe95f45fdaa8bd334671aa312" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46085 } } }
I20260808 11:32:43.799191 5206 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82469f1fe95f45fdaa8bd334671aa312 [sys.catalog]: This master's current role is: LEADER
I20260808 11:32:43.801684 5205 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82469f1fe95f45fdaa8bd334671aa312 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "82469f1fe95f45fdaa8bd334671aa312" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82469f1fe95f45fdaa8bd334671aa312" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46085 } } }
I20260808 11:32:43.802080 5205 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82469f1fe95f45fdaa8bd334671aa312 [sys.catalog]: This master's current role is: LEADER
I20260808 11:32:43.803188 5212 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:32:43.808372 5212 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:32:43.816874 5212 catalog_manager.cc:1347] Generated new cluster ID: 0ff8728cc74746d7b1518ef051a47534
I20260808 11:32:43.817023 5212 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:32:43.850865 5212 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:32:43.852277 5212 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:32:43.859082 5212 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 82469f1fe95f45fdaa8bd334671aa312: Generated new TSK 0
I20260808 11:32:43.859965 5212 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.66.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
I20260808 11:32:43.931351 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:0
--local_ip_for_outbound_sockets=127.26.66.129
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46085
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:44605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:32:44.300367 5226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:44.300637 5226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:44.300873 5226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:44.308516 5226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:44.308642 5226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:44.308830 5226 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:32:44.319640 5226 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:44605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46085
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:44.321028 5226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:44.322448 5226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:44.336073 5231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:44.336098 5232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:44.336319 5234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:44.337034 5226 server_base.cc:1034] running on GCE node
I20260808 11:32:44.337697 5226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:44.338652 5226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:44.339943 5226 hybrid_clock.cc:648] HybridClock initialized: now 1786188764339842 us; error 56 us; skew 500 ppm
I20260808 11:32:44.340267 5226 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:32:44 dist-test-slave-zkpd krb5kdc[5114](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188764, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:32:44.343433 5226 init.cc:377] Logged in from keytab as kudu/127.26.66.129@KRBTEST.COM (short username kudu)
I20260808 11:32:44.344952 5226 webserver.cc:460] Webserver started at http://127.26.66.129:44747/ using document root <none> and password file <none>
I20260808 11:32:44.345667 5226 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:44.345820 5226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:44.346133 5226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:32:44.349128 5226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/data/instance:
uuid: "6fe6edc66455449ab35c4588a5b2e2c2"
format_stamp: "Formatted at 2026-08-08 11:32:44 on dist-test-slave-zkpd"
server_key: "ddce993a0b52f0380a4be0aabeebac41"
server_key_iv: "72d82fba954fadbd15eeaf958ec594c7"
server_key_version: "encryptionkey@0"
I20260808 11:32:44.349890 5226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance:
uuid: "6fe6edc66455449ab35c4588a5b2e2c2"
format_stamp: "Formatted at 2026-08-08 11:32:44 on dist-test-slave-zkpd"
server_key: "ddce993a0b52f0380a4be0aabeebac41"
server_key_iv: "72d82fba954fadbd15eeaf958ec594c7"
server_key_version: "encryptionkey@0"
I20260808 11:32:44.355082 5226 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260808 11:32:44.358551 5241 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:44.359856 5226 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 11:32:44.360092 5226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "6fe6edc66455449ab35c4588a5b2e2c2"
format_stamp: "Formatted at 2026-08-08 11:32:44 on dist-test-slave-zkpd"
server_key: "ddce993a0b52f0380a4be0aabeebac41"
server_key_iv: "72d82fba954fadbd15eeaf958ec594c7"
server_key_version: "encryptionkey@0"
I20260808 11:32:44.360289 5226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:44.376044 5226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:44.379745 5226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:44.380095 5226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:44.381013 5226 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:32:44.382396 5226 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:32:44.382495 5226 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:44.382642 5226 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:32:44.382719 5226 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:44.416980 5226 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:44791
I20260808 11:32:44.417021 5362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:44791 every 8 connection(s)
I20260808 11:32:44.418395 5226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:32:44.423146 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 5226
I20260808 11:32:44.423369 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance
I20260808 11:32:44.424083 26890 external_mini_cluster.cc:1428] Setting key f7e4b3102178da122061ca8094c1866b
Aug 08 11:32:44 dist-test-slave-zkpd krb5kdc[5114](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188764, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:32:44.438822 5365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:44.421112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:49315 (local address 127.26.66.190:46085)
0808 11:32:44.421600 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:44.421606 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:44.422604 (+ 998us) server_negotiation.cc:407] Connection header received
0808 11:32:44.424607 (+ 2003us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:44.424613 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:44.424703 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:44.424827 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:44.426603 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:44.427332 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:44.428998 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:44.429389 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:44.429532 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:44.433018 (+ 3486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:44.433023 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:44.433026 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:44.433059 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:44.435701 (+ 2642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:44.436490 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:44.436495 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:44.436498 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:44.436615 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:44.437069 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:44.437076 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:44.437084 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:44.437342 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:44.437500 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:44.438208 (+ 708us) server_negotiation.cc:299] Negotiation successful
0808 11:32:44.438444 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":223,"threads_started":1}
I20260808 11:32:44.439752 5366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:44.421737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:46085 (local address 127.26.66.129:49315)
0808 11:32:44.422446 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:44.422485 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:44.424332 (+ 1847us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:44.425105 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:44.425115 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:44.425866 (+ 751us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:44.426428 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:44.426447 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:44.427514 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:44.427518 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:44.428819 (+ 1301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:44.428832 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:44.429628 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:44.429637 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:44.429889 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:44.430575 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:44.430597 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:44.432794 (+ 2197us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:44.435860 (+ 3066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:44.435869 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:44.435884 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:44.436352 (+ 468us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:44.436730 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:44.436735 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:44.436739 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:44.436943 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:44.437475 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:44.437482 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:44.437823 (+ 341us) client_negotiation.cc:769] Sending connection context
0808 11:32:44.438095 (+ 272us) client_negotiation.cc:240] Negotiation successful
0808 11:32:44.438612 (+ 517us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":275,"threads_started":1}
I20260808 11:32:44.441524 5363 heartbeater.cc:347] Connected to a master server at 127.26.66.190:46085
I20260808 11:32:44.441843 5363 heartbeater.cc:464] Registering TS with master...
I20260808 11:32:44.442800 5363 heartbeater.cc:511] Master 127.26.66.190:46085 requested a full tablet report, sending...
I20260808 11:32:44.445287 5160 ts_manager.cc:194] Registered new tserver with Master: 6fe6edc66455449ab35c4588a5b2e2c2 (127.26.66.129:44791)
I20260808 11:32:44.447451 5160 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.129@KRBTEST.COM'} at 127.26.66.129:49315
WARNING: no policy specified for kudu/127.26.66.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
I20260808 11:32:44.492936 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:0
--local_ip_for_outbound_sockets=127.26.66.130
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46085
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:44605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:32:44.842083 5369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:44.842401 5369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:44.842579 5369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:44.849629 5369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:44.849787 5369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:44.849963 5369 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:32:44.859475 5369 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:44605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46085
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:44.860845 5369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:44.862119 5369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:44.875372 5375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:44.875463 5374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:44.875434 5377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:44.876181 5369 server_base.cc:1034] running on GCE node
I20260808 11:32:44.876804 5369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:44.877737 5369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:44.878974 5369 hybrid_clock.cc:648] HybridClock initialized: now 1786188764878926 us; error 44 us; skew 500 ppm
I20260808 11:32:44.879282 5369 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:32:44 dist-test-slave-zkpd krb5kdc[5114](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188764, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:32:44.882479 5369 init.cc:377] Logged in from keytab as kudu/127.26.66.130@KRBTEST.COM (short username kudu)
I20260808 11:32:44.883879 5369 webserver.cc:460] Webserver started at http://127.26.66.130:34179/ using document root <none> and password file <none>
I20260808 11:32:44.884618 5369 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:44.884768 5369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:44.885079 5369 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:32:44.887876 5369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/data/instance:
uuid: "8c9d83d2659f452fae21577f95cb3081"
format_stamp: "Formatted at 2026-08-08 11:32:44 on dist-test-slave-zkpd"
server_key: "2f177957d899c43e28918762e4c71828"
server_key_iv: "a229d89ff3ca6749d0a208731bfabf15"
server_key_version: "encryptionkey@0"
I20260808 11:32:44.888705 5369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance:
uuid: "8c9d83d2659f452fae21577f95cb3081"
format_stamp: "Formatted at 2026-08-08 11:32:44 on dist-test-slave-zkpd"
server_key: "2f177957d899c43e28918762e4c71828"
server_key_iv: "a229d89ff3ca6749d0a208731bfabf15"
server_key_version: "encryptionkey@0"
I20260808 11:32:44.893682 5369 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 11:32:44.897151 5384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:44.898674 5369 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:32:44.898855 5369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "8c9d83d2659f452fae21577f95cb3081"
format_stamp: "Formatted at 2026-08-08 11:32:44 on dist-test-slave-zkpd"
server_key: "2f177957d899c43e28918762e4c71828"
server_key_iv: "a229d89ff3ca6749d0a208731bfabf15"
server_key_version: "encryptionkey@0"
I20260808 11:32:44.899070 5369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:44.918972 5369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:44.922860 5369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:44.923171 5369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:44.924140 5369 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:32:44.925457 5369 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:32:44.925560 5369 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:44.925710 5369 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:32:44.925783 5369 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:44.959707 5369 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:46053
I20260808 11:32:44.959761 5506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:46053 every 8 connection(s)
I20260808 11:32:44.961045 5369 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:32:44.962478 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 5369
I20260808 11:32:44.962672 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance
I20260808 11:32:44.963230 26890 external_mini_cluster.cc:1428] Setting key 053d537df2b3ee1402bbad48ceed3202
Aug 08 11:32:44 dist-test-slave-zkpd krb5kdc[5114](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188764, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:32:44.983318 5509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:44.963851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:60487 (local address 127.26.66.190:46085)
0808 11:32:44.964589 (+ 738us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:44.964595 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:44.965607 (+ 1012us) server_negotiation.cc:407] Connection header received
0808 11:32:44.967480 (+ 1873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:44.967488 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:44.967584 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:44.967709 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:44.969375 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:44.970511 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:44.972164 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:44.972942 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:44.973086 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:44.976812 (+ 3726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:44.976820 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:44.976828 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:44.976876 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:44.979944 (+ 3068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:44.980916 (+ 972us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:44.980920 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:44.980922 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:44.981050 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:44.981542 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:44.981547 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:44.981548 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:44.981835 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:44.981946 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:44.982829 (+ 883us) server_negotiation.cc:299] Negotiation successful
0808 11:32:44.983034 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":598,"thread_start_us":389,"threads_started":1}
I20260808 11:32:44.984956 5511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:44.964538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:46085 (local address 127.26.66.130:60487)
0808 11:32:44.965439 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:44.965495 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:44.967203 (+ 1708us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:44.968049 (+ 846us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:44.968058 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:44.968575 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:44.969187 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:44.969209 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:44.970678 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:44.970682 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:44.972023 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:44.972036 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:44.973162 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:44.973167 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:44.973373 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:44.974084 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:44.974112 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:44.976550 (+ 2438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:44.980092 (+ 3542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:44.980104 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:44.980123 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:44.980784 (+ 661us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:44.981157 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:44.981164 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:44.981171 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:44.981431 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:44.981962 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:44.981973 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:44.982446 (+ 473us) client_negotiation.cc:769] Sending connection context
0808 11:32:44.982757 (+ 311us) client_negotiation.cc:240] Negotiation successful
0808 11:32:44.983420 (+ 663us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":374,"threads_started":1}
I20260808 11:32:44.986585 5507 heartbeater.cc:347] Connected to a master server at 127.26.66.190:46085
I20260808 11:32:44.986905 5507 heartbeater.cc:464] Registering TS with master...
I20260808 11:32:44.987654 5507 heartbeater.cc:511] Master 127.26.66.190:46085 requested a full tablet report, sending...
I20260808 11:32:44.989178 5160 ts_manager.cc:194] Registered new tserver with Master: 8c9d83d2659f452fae21577f95cb3081 (127.26.66.130:46053)
I20260808 11:32:44.990010 5160 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.130@KRBTEST.COM'} at 127.26.66.130:60487
WARNING: no policy specified for kudu/127.26.66.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
I20260808 11:32:45.033411 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:0
--local_ip_for_outbound_sockets=127.26.66.131
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46085
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:44605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:32:45.390444 5514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:32:45.390697 5514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:32:45.390899 5514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:32:45.398248 5514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:32:45.398360 5514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:32:45.398545 5514 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:32:45.408187 5514 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:44605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46085
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:32:45.409389 5514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:32:45.410684 5514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:32:45.424717 5521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:45.424846 5522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:32:45.424679 5524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:32:45.425498 5514 server_base.cc:1034] running on GCE node
I20260808 11:32:45.426120 5514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:32:45.426990 5514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:32:45.428221 5514 hybrid_clock.cc:648] HybridClock initialized: now 1786188765428178 us; error 50 us; skew 500 ppm
I20260808 11:32:45.428529 5514 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:32:45 dist-test-slave-zkpd krb5kdc[5114](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188765, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:32:45.431558 5514 init.cc:377] Logged in from keytab as kudu/127.26.66.131@KRBTEST.COM (short username kudu)
I20260808 11:32:45.433079 5514 webserver.cc:460] Webserver started at http://127.26.66.131:45609/ using document root <none> and password file <none>
I20260808 11:32:45.433764 5514 fs_manager.cc:359] Metadata directory not provided
I20260808 11:32:45.433908 5514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:32:45.434212 5514 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:32:45.437084 5514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/data/instance:
uuid: "26376d957247449e8584bf0ee60d7168"
format_stamp: "Formatted at 2026-08-08 11:32:45 on dist-test-slave-zkpd"
server_key: "3cde4cca856e1bb41ada22ad3bd680bd"
server_key_iv: "1c169d07909ad7d3b8eba23c226c2d16"
server_key_version: "encryptionkey@0"
I20260808 11:32:45.437851 5514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance:
uuid: "26376d957247449e8584bf0ee60d7168"
format_stamp: "Formatted at 2026-08-08 11:32:45 on dist-test-slave-zkpd"
server_key: "3cde4cca856e1bb41ada22ad3bd680bd"
server_key_iv: "1c169d07909ad7d3b8eba23c226c2d16"
server_key_version: "encryptionkey@0"
I20260808 11:32:45.442875 5514 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 11:32:45.446211 5531 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:45.447479 5514 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 11:32:45.447647 5514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "26376d957247449e8584bf0ee60d7168"
format_stamp: "Formatted at 2026-08-08 11:32:45 on dist-test-slave-zkpd"
server_key: "3cde4cca856e1bb41ada22ad3bd680bd"
server_key_iv: "1c169d07909ad7d3b8eba23c226c2d16"
server_key_version: "encryptionkey@0"
I20260808 11:32:45.447842 5514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:32:45.451126 5363 heartbeater.cc:503] Master 127.26.66.190:46085 was elected leader, sending a full tablet report...
I20260808 11:32:45.466930 5514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:32:45.470845 5514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:32:45.471135 5514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:32:45.472180 5514 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:32:45.473493 5514 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:32:45.473596 5514 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:45.473771 5514 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:32:45.473848 5514 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:32:45.507766 5514 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:45025
I20260808 11:32:45.507777 5653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:45025 every 8 connection(s)
I20260808 11:32:45.509138 5514 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:32:45.512315 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 5514
I20260808 11:32:45.512501 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance
I20260808 11:32:45.513137 26890 external_mini_cluster.cc:1428] Setting key 16f466e0af44319e30f0088711fcaa97
Aug 08 11:32:45 dist-test-slave-zkpd krb5kdc[5114](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188765, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:32:45.528833 5656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:45.511621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:34823 (local address 127.26.66.190:46085)
0808 11:32:45.512176 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:45.512183 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:45.513349 (+ 1166us) server_negotiation.cc:407] Connection header received
0808 11:32:45.515570 (+ 2221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:45.515574 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:45.515654 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:45.515738 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:45.517429 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.518239 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.519695 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.520185 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.520278 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:45.523461 (+ 3183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:45.523465 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:45.523468 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:45.523504 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:45.525973 (+ 2469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:45.526616 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:45.526619 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:45.526621 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:45.526730 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:45.527129 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:45.527133 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:45.527137 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:45.527396 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:45.527567 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:45.528324 (+ 757us) server_negotiation.cc:299] Negotiation successful
0808 11:32:45.528556 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":265,"threads_started":1}
I20260808 11:32:45.529728 5657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:45.512283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:46085 (local address 127.26.66.131:34823)
0808 11:32:45.513175 (+ 892us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:45.513239 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:45.515274 (+ 2035us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:45.516053 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:45.516065 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:45.516702 (+ 637us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:32:45.517282 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:45.517301 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.518373 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.518376 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:45.519579 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:45.519591 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.520365 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.520369 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:45.520546 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:45.521194 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:32:45.521215 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:32:45.523294 (+ 2079us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:32:45.526091 (+ 2797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:45.526097 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:45.526107 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:45.526496 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:45.526845 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:32:45.526848 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:32:45.526851 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:32:45.527014 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:32:45.527547 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:32:45.527553 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:32:45.527941 (+ 388us) client_negotiation.cc:769] Sending connection context
0808 11:32:45.528189 (+ 248us) client_negotiation.cc:240] Negotiation successful
0808 11:32:45.528689 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":367,"threads_started":1}
I20260808 11:32:45.530974 5654 heartbeater.cc:347] Connected to a master server at 127.26.66.190:46085
I20260808 11:32:45.531270 5654 heartbeater.cc:464] Registering TS with master...
I20260808 11:32:45.532073 5654 heartbeater.cc:511] Master 127.26.66.190:46085 requested a full tablet report, sending...
I20260808 11:32:45.533476 5160 ts_manager.cc:194] Registered new tserver with Master: 26376d957247449e8584bf0ee60d7168 (127.26.66.131:45025)
I20260808 11:32:45.534245 5160 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.131@KRBTEST.COM'} at 127.26.66.131:34823
I20260808 11:32:45.540609 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 11:32:45.556800 5656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:45.545041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52012 (local address 127.26.66.190:46085)
0808 11:32:45.545191 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:45.545195 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:45.545795 (+ 600us) server_negotiation.cc:407] Connection header received
0808 11:32:45.545927 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:45.545931 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:45.546003 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:45.546079 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:45.547469 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.548266 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.549416 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.549798 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.549884 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:45.551989 (+ 2105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:45.551994 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:45.551997 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:45.552040 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:45.554532 (+ 2492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:45.555156 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:45.555159 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:45.555161 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:45.555277 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:45.555604 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:45.555607 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:45.555609 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:45.555945 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:45.556141 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:45.556425 (+ 284us) server_negotiation.cc:299] Negotiation successful
0808 11:32:45.556580 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 11:32:45.560823 5160 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52012:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 11:32:45.567767 5160 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:32:45.600211 5669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:45.579130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:45025 (local address 127.0.0.1:33226)
0808 11:32:45.580170 (+ 1040us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:45.590443 (+ 10273us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:45.590637 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:45.592751 (+ 2114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:45.592762 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:45.592802 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:45.593306 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:45.593324 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.595351 (+ 2027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.595359 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:45.597217 (+ 1858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:45.597239 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.599164 (+ 1925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.599176 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:45.599404 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:45.599452 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 11:32:45.599601 (+ 149us) client_negotiation.cc:240] Negotiation successful
0808 11:32:45.599794 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":719,"thread_start_us":1798,"threads_started":1}
I20260808 11:32:45.600203 5672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:45.579379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33226 (local address 127.26.66.131:45025)
0808 11:32:45.592078 (+ 12699us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:45.592088 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:45.592127 (+ 39us) server_negotiation.cc:407] Connection header received
0808 11:32:45.592237 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:45.592245 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:45.592523 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:45.592735 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:45.593552 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.595220 (+ 1668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.597389 (+ 2169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.598960 (+ 1571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.599085 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:45.599330 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:45.599699 (+ 369us) server_negotiation.cc:299] Negotiation successful
0808 11:32:45.599844 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12451,"thread_start_us":12274,"threads_started":1}
I20260808 11:32:45.601946 5675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:45.579327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:44791 (local address 127.0.0.1:43138)
0808 11:32:45.590587 (+ 11260us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:45.590605 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:45.590696 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:45.594148 (+ 3452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:45.594152 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:45.594175 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:45.594676 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:45.594694 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.596760 (+ 2066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.596766 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:45.599242 (+ 2476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:45.599256 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.601093 (+ 1837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.601101 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:45.601283 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:45.601315 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 11:32:45.601409 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 11:32:45.601524 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11124,"mutex_wait_us":97,"thread_start_us":13178,"threads_started":1}
I20260808 11:32:45.601984 5673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:45.579947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43138 (local address 127.26.66.129:44791)
0808 11:32:45.592517 (+ 12570us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:45.592528 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:45.592564 (+ 36us) server_negotiation.cc:407] Connection header received
0808 11:32:45.593395 (+ 831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:45.593405 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:45.593632 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:45.593854 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:45.594919 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.596552 (+ 1633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.599424 (+ 2872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.600881 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.601017 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:45.601255 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:45.601473 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 11:32:45.601637 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12345,"thread_start_us":12765,"threads_started":1}
I20260808 11:32:45.602761 5671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:45.580007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:46053 (local address 127.0.0.1:34212)
0808 11:32:45.592307 (+ 12300us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:45.592325 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:45.592429 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:45.594415 (+ 1986us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:45.594420 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:45.594445 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:45.594909 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:45.594920 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.596819 (+ 1899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.596823 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:45.599690 (+ 2867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:45.599739 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.601906 (+ 2167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.601915 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:45.602099 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:45.602135 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 11:32:45.602227 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 11:32:45.602369 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12196,"mutex_wait_us":132,"thread_start_us":10277,"threads_started":1}
I20260808 11:32:45.603150 5674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:45.580542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34212 (local address 127.26.66.130:46053)
0808 11:32:45.593612 (+ 13070us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:45.593622 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:45.593654 (+ 32us) server_negotiation.cc:407] Connection header received
0808 11:32:45.593771 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:45.593777 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:45.593996 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:45.594176 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:45.595103 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.596645 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.599936 (+ 3291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.601418 (+ 1482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.601564 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:45.601744 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:45.602574 (+ 830us) server_negotiation.cc:299] Negotiation successful
0808 11:32:45.602751 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12896,"thread_start_us":14280,"threads_started":1}
I20260808 11:32:45.604868 5584 tablet_service.cc:1467] Processing CreateTablet for tablet 3135aee852834fcca56d88636bfd2451 (DEFAULT_TABLE table=test-table [id=d1df3ddab3bd445ab24d942c67dbfc79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:32:45.605412 5292 tablet_service.cc:1467] Processing CreateTablet for tablet 3135aee852834fcca56d88636bfd2451 (DEFAULT_TABLE table=test-table [id=d1df3ddab3bd445ab24d942c67dbfc79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:32:45.606171 5584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3135aee852834fcca56d88636bfd2451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:45.606623 5292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3135aee852834fcca56d88636bfd2451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:45.611389 5435 tablet_service.cc:1467] Processing CreateTablet for tablet 3135aee852834fcca56d88636bfd2451 (DEFAULT_TABLE table=test-table [id=d1df3ddab3bd445ab24d942c67dbfc79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:32:45.612761 5435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3135aee852834fcca56d88636bfd2451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:32:45.618145 5676 tablet_bootstrap.cc:492] T 3135aee852834fcca56d88636bfd2451 P 6fe6edc66455449ab35c4588a5b2e2c2: Bootstrap starting.
I20260808 11:32:45.621075 5677 tablet_bootstrap.cc:492] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168: Bootstrap starting.
I20260808 11:32:45.621821 5676 tablet_bootstrap.cc:654] T 3135aee852834fcca56d88636bfd2451 P 6fe6edc66455449ab35c4588a5b2e2c2: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:45.623162 5676 log.cc:824] T 3135aee852834fcca56d88636bfd2451 P 6fe6edc66455449ab35c4588a5b2e2c2: Log is configured to *not* fsync() on all Append() calls
I20260808 11:32:45.624656 5677 tablet_bootstrap.cc:654] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:45.625948 5677 log.cc:824] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168: Log is configured to *not* fsync() on all Append() calls
I20260808 11:32:45.626489 5676 tablet_bootstrap.cc:492] T 3135aee852834fcca56d88636bfd2451 P 6fe6edc66455449ab35c4588a5b2e2c2: No bootstrap required, opened a new log
I20260808 11:32:45.626863 5676 ts_tablet_manager.cc:1397] T 3135aee852834fcca56d88636bfd2451 P 6fe6edc66455449ab35c4588a5b2e2c2: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.006s
I20260808 11:32:45.628028 5679 tablet_bootstrap.cc:492] T 3135aee852834fcca56d88636bfd2451 P 8c9d83d2659f452fae21577f95cb3081: Bootstrap starting.
I20260808 11:32:45.629097 5677 tablet_bootstrap.cc:492] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168: No bootstrap required, opened a new log
I20260808 11:32:45.629348 5677 ts_tablet_manager.cc:1397] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260808 11:32:45.630632 5679 tablet_bootstrap.cc:654] T 3135aee852834fcca56d88636bfd2451 P 8c9d83d2659f452fae21577f95cb3081: Neither blocks nor log segments found. Creating new log.
I20260808 11:32:45.631561 5679 log.cc:824] T 3135aee852834fcca56d88636bfd2451 P 8c9d83d2659f452fae21577f95cb3081: Log is configured to *not* fsync() on all Append() calls
I20260808 11:32:45.634011 5679 tablet_bootstrap.cc:492] T 3135aee852834fcca56d88636bfd2451 P 8c9d83d2659f452fae21577f95cb3081: No bootstrap required, opened a new log
I20260808 11:32:45.634255 5679 ts_tablet_manager.cc:1397] T 3135aee852834fcca56d88636bfd2451 P 8c9d83d2659f452fae21577f95cb3081: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260808 11:32:45.637633 5676 raft_consensus.cc:348] T 3135aee852834fcca56d88636bfd2451 P 6fe6edc66455449ab35c4588a5b2e2c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26376d957247449e8584bf0ee60d7168" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45025 } } peers { permanent_uuid: "6fe6edc66455449ab35c4588a5b2e2c2" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 44791 } } peers { permanent_uuid: "8c9d83d2659f452fae21577f95cb3081" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46053 } }
I20260808 11:32:45.638070 5676 raft_consensus.cc:374] T 3135aee852834fcca56d88636bfd2451 P 6fe6edc66455449ab35c4588a5b2e2c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:45.638199 5676 raft_consensus.cc:729] T 3135aee852834fcca56d88636bfd2451 P 6fe6edc66455449ab35c4588a5b2e2c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fe6edc66455449ab35c4588a5b2e2c2, State: Initialized, Role: FOLLOWER
I20260808 11:32:45.638880 5676 consensus_queue.cc:260] T 3135aee852834fcca56d88636bfd2451 P 6fe6edc66455449ab35c4588a5b2e2c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26376d957247449e8584bf0ee60d7168" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45025 } } peers { permanent_uuid: "6fe6edc66455449ab35c4588a5b2e2c2" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 44791 } } peers { permanent_uuid: "8c9d83d2659f452fae21577f95cb3081" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46053 } }
I20260808 11:32:45.639984 5677 raft_consensus.cc:348] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26376d957247449e8584bf0ee60d7168" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45025 } } peers { permanent_uuid: "6fe6edc66455449ab35c4588a5b2e2c2" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 44791 } } peers { permanent_uuid: "8c9d83d2659f452fae21577f95cb3081" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46053 } }
I20260808 11:32:45.640465 5677 raft_consensus.cc:374] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:45.640622 5677 raft_consensus.cc:729] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26376d957247449e8584bf0ee60d7168, State: Initialized, Role: FOLLOWER
I20260808 11:32:45.640790 5676 ts_tablet_manager.cc:1428] T 3135aee852834fcca56d88636bfd2451 P 6fe6edc66455449ab35c4588a5b2e2c2: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260808 11:32:45.641376 5677 consensus_queue.cc:260] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26376d957247449e8584bf0ee60d7168" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45025 } } peers { permanent_uuid: "6fe6edc66455449ab35c4588a5b2e2c2" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 44791 } } peers { permanent_uuid: "8c9d83d2659f452fae21577f95cb3081" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46053 } }
I20260808 11:32:45.643091 5677 ts_tablet_manager.cc:1428] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260808 11:32:45.642908 5679 raft_consensus.cc:348] T 3135aee852834fcca56d88636bfd2451 P 8c9d83d2659f452fae21577f95cb3081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26376d957247449e8584bf0ee60d7168" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45025 } } peers { permanent_uuid: "6fe6edc66455449ab35c4588a5b2e2c2" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 44791 } } peers { permanent_uuid: "8c9d83d2659f452fae21577f95cb3081" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46053 } }
I20260808 11:32:45.643416 5679 raft_consensus.cc:374] T 3135aee852834fcca56d88636bfd2451 P 8c9d83d2659f452fae21577f95cb3081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:32:45.643520 5679 raft_consensus.cc:729] T 3135aee852834fcca56d88636bfd2451 P 8c9d83d2659f452fae21577f95cb3081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9d83d2659f452fae21577f95cb3081, State: Initialized, Role: FOLLOWER
I20260808 11:32:45.643546 5654 heartbeater.cc:503] Master 127.26.66.190:46085 was elected leader, sending a full tablet report...
I20260808 11:32:45.644091 5679 consensus_queue.cc:260] T 3135aee852834fcca56d88636bfd2451 P 8c9d83d2659f452fae21577f95cb3081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26376d957247449e8584bf0ee60d7168" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45025 } } peers { permanent_uuid: "6fe6edc66455449ab35c4588a5b2e2c2" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 44791 } } peers { permanent_uuid: "8c9d83d2659f452fae21577f95cb3081" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46053 } }
I20260808 11:32:45.645608 5679 ts_tablet_manager.cc:1428] T 3135aee852834fcca56d88636bfd2451 P 8c9d83d2659f452fae21577f95cb3081: Time spent starting tablet: real 0.011s user 0.004s sys 0.008s
I20260808 11:32:45.646061 5507 heartbeater.cc:503] Master 127.26.66.190:46085 was elected leader, sending a full tablet report...
W20260808 11:32:45.670794 5364 tablet.cc:2369] T 3135aee852834fcca56d88636bfd2451 P 6fe6edc66455449ab35c4588a5b2e2c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 11:32:45.713042 5508 tablet.cc:2369] T 3135aee852834fcca56d88636bfd2451 P 8c9d83d2659f452fae21577f95cb3081: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 11:32:45.760840 5655 tablet.cc:2369] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:32:45.839267 5683 raft_consensus.cc:482] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:32:45.839617 5683 raft_consensus.cc:504] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26376d957247449e8584bf0ee60d7168" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45025 } } peers { permanent_uuid: "6fe6edc66455449ab35c4588a5b2e2c2" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 44791 } } peers { permanent_uuid: "8c9d83d2659f452fae21577f95cb3081" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46053 } }
I20260808 11:32:45.841380 5683 leader_election.cc:288] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fe6edc66455449ab35c4588a5b2e2c2 (127.26.66.129:44791), 8c9d83d2659f452fae21577f95cb3081 (127.26.66.130:46053)
I20260808 11:32:45.847349 5657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:45.841815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:44791 (local address 127.26.66.131:49127)
0808 11:32:45.842009 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:45.842031 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:45.842166 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:45.842564 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:45.842568 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:45.842611 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:45.842866 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:45.842877 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.844127 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.844132 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:45.845460 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:45.845472 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.846606 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.846612 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:45.846810 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:45.846835 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 11:32:45.846944 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 11:32:45.847080 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 11:32:45.847349 5673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:45.841769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:49127 (local address 127.26.66.129:44791)
0808 11:32:45.842013 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:45.842019 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:45.842119 (+ 100us) server_negotiation.cc:407] Connection header received
0808 11:32:45.842365 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:45.842370 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:45.842434 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:45.842537 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:45.843026 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.843962 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.845640 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.846433 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.846617 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:45.846691 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:45.846973 (+ 282us) server_negotiation.cc:299] Negotiation successful
0808 11:32:45.847099 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 11:32:45.848546 5674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:45.841959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:47489 (local address 127.26.66.130:46053)
0808 11:32:45.842194 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:45.842201 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:45.843388 (+ 1187us) server_negotiation.cc:407] Connection header received
0808 11:32:45.843597 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:45.843602 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:45.843661 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:45.843762 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:32:45.844390 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.845084 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.846739 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.847618 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.847791 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:45.847862 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:45.848162 (+ 300us) server_negotiation.cc:299] Negotiation successful
0808 11:32:45.848301 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 11:32:45.848620 5685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:45.842459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:46053 (local address 127.26.66.131:47489)
0808 11:32:45.843252 (+ 793us) negotiation.cc:107] Waiting for socket to connect
0808 11:32:45.843271 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 11:32:45.843435 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:32:45.843775 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:32:45.843779 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:32:45.843810 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:32:45.844222 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:45.844233 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.845235 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.845240 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:45.846581 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:32:45.846593 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.847832 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.847837 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:32:45.847971 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:45.847994 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 11:32:45.848100 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 11:32:45.848235 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"mutex_wait_us":25,"thread_start_us":496,"threads_started":1}
I20260808 11:32:45.848439 5315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3135aee852834fcca56d88636bfd2451" candidate_uuid: "26376d957247449e8584bf0ee60d7168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fe6edc66455449ab35c4588a5b2e2c2" is_pre_election: true
I20260808 11:32:45.849018 5315 raft_consensus.cc:2454] T 3135aee852834fcca56d88636bfd2451 P 6fe6edc66455449ab35c4588a5b2e2c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26376d957247449e8584bf0ee60d7168 in term 0.
I20260808 11:32:45.849757 5532 leader_election.cc:302] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26376d957247449e8584bf0ee60d7168, 6fe6edc66455449ab35c4588a5b2e2c2; no voters:
I20260808 11:32:45.849661 5455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3135aee852834fcca56d88636bfd2451" candidate_uuid: "26376d957247449e8584bf0ee60d7168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9d83d2659f452fae21577f95cb3081" is_pre_election: true
I20260808 11:32:45.850131 5683 raft_consensus.cc:2781] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:32:45.850190 5455 raft_consensus.cc:2454] T 3135aee852834fcca56d88636bfd2451 P 8c9d83d2659f452fae21577f95cb3081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26376d957247449e8584bf0ee60d7168 in term 0.
I20260808 11:32:45.850313 5683 raft_consensus.cc:482] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:32:45.850416 5683 raft_consensus.cc:3037] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:45.852782 5683 raft_consensus.cc:504] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26376d957247449e8584bf0ee60d7168" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45025 } } peers { permanent_uuid: "6fe6edc66455449ab35c4588a5b2e2c2" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 44791 } } peers { permanent_uuid: "8c9d83d2659f452fae21577f95cb3081" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46053 } }
I20260808 11:32:45.853343 5683 leader_election.cc:288] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168 [CANDIDATE]: Term 1 election: Requested vote from peers 6fe6edc66455449ab35c4588a5b2e2c2 (127.26.66.129:44791), 8c9d83d2659f452fae21577f95cb3081 (127.26.66.130:46053)
I20260808 11:32:45.853785 5455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3135aee852834fcca56d88636bfd2451" candidate_uuid: "26376d957247449e8584bf0ee60d7168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9d83d2659f452fae21577f95cb3081"
I20260808 11:32:45.853796 5315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3135aee852834fcca56d88636bfd2451" candidate_uuid: "26376d957247449e8584bf0ee60d7168" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fe6edc66455449ab35c4588a5b2e2c2"
I20260808 11:32:45.853984 5455 raft_consensus.cc:3037] T 3135aee852834fcca56d88636bfd2451 P 8c9d83d2659f452fae21577f95cb3081 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:45.853998 5315 raft_consensus.cc:3037] T 3135aee852834fcca56d88636bfd2451 P 6fe6edc66455449ab35c4588a5b2e2c2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:32:45.856176 5315 raft_consensus.cc:2454] T 3135aee852834fcca56d88636bfd2451 P 6fe6edc66455449ab35c4588a5b2e2c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26376d957247449e8584bf0ee60d7168 in term 1.
I20260808 11:32:45.856485 5455 raft_consensus.cc:2454] T 3135aee852834fcca56d88636bfd2451 P 8c9d83d2659f452fae21577f95cb3081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26376d957247449e8584bf0ee60d7168 in term 1.
I20260808 11:32:45.856570 5532 leader_election.cc:302] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26376d957247449e8584bf0ee60d7168, 6fe6edc66455449ab35c4588a5b2e2c2; no voters:
I20260808 11:32:45.856894 5683 raft_consensus.cc:2781] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:32:45.857288 5683 raft_consensus.cc:686] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168 [term 1 LEADER]: Becoming Leader. State: Replica: 26376d957247449e8584bf0ee60d7168, State: Running, Role: LEADER
I20260808 11:32:45.857762 5683 consensus_queue.cc:237] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26376d957247449e8584bf0ee60d7168" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45025 } } peers { permanent_uuid: "6fe6edc66455449ab35c4588a5b2e2c2" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 44791 } } peers { permanent_uuid: "8c9d83d2659f452fae21577f95cb3081" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46053 } }
I20260808 11:32:45.862098 5159 catalog_manager.cc:5495] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26376d957247449e8584bf0ee60d7168 (127.26.66.131). New cstate: current_term: 1 leader_uuid: "26376d957247449e8584bf0ee60d7168" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26376d957247449e8584bf0ee60d7168" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 45025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fe6edc66455449ab35c4588a5b2e2c2" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 44791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9d83d2659f452fae21577f95cb3081" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46053 } health_report { overall_health: UNKNOWN } } }
I20260808 11:32:45.889950 5672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:45.885111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33230 (local address 127.26.66.131:45025)
0808 11:32:45.885298 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:45.885303 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:45.885320 (+ 17us) server_negotiation.cc:407] Connection header received
0808 11:32:45.885430 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:45.885433 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:45.885507 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:45.885633 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:32:45.885994 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.886681 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.887970 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.888367 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.888460 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:45.888888 (+ 428us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:32:45.889378 (+ 490us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:32:45.889486 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:45.889584 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 11:32:45.889646 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 11:32:45.898183 5455 raft_consensus.cc:1261] T 3135aee852834fcca56d88636bfd2451 P 8c9d83d2659f452fae21577f95cb3081 [term 1 FOLLOWER]: Refusing update from remote peer 26376d957247449e8584bf0ee60d7168: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:32:45.898186 5315 raft_consensus.cc:1261] T 3135aee852834fcca56d88636bfd2451 P 6fe6edc66455449ab35c4588a5b2e2c2 [term 1 FOLLOWER]: Refusing update from remote peer 26376d957247449e8584bf0ee60d7168: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:32:45.899186 5686 consensus_queue.cc:1035] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fe6edc66455449ab35c4588a5b2e2c2" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 44791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:32:45.899513 5683 consensus_queue.cc:1035] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9d83d2659f452fae21577f95cb3081" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:32:45.911175 5691 mvcc.cc:205] Tried to move back new op lower bound from 7316229185108656128 to 7316229184956903424. Current Snapshot: MvccSnapshot[applied={T|T < 7316229185108656128}]
I20260808 11:32:45.923102 5160 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52012:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:32:45.923421 5160 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52012:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:32:45.926908 5160 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 82469f1fe95f45fdaa8bd334671aa312: Sending DeleteTablet for 3 replicas of tablet 3135aee852834fcca56d88636bfd2451
I20260808 11:32:45.927969 5584 tablet_service.cc:1514] Processing DeleteTablet for tablet 3135aee852834fcca56d88636bfd2451 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:32:45 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:33226
I20260808 11:32:45.928049 5292 tablet_service.cc:1514] Processing DeleteTablet for tablet 3135aee852834fcca56d88636bfd2451 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:32:45 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:43138
I20260808 11:32:45.928401 5435 tablet_service.cc:1514] Processing DeleteTablet for tablet 3135aee852834fcca56d88636bfd2451 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:32:45 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:34212
I20260808 11:32:45.931921 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 5226
I20260808 11:32:45.947849 5703 tablet_replica.cc:330] T 3135aee852834fcca56d88636bfd2451 P 6fe6edc66455449ab35c4588a5b2e2c2: stopping tablet replica
I20260808 11:32:45.948041 5702 tablet_replica.cc:330] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168: stopping tablet replica
I20260808 11:32:45.948556 5702 raft_consensus.cc:2229] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168 [term 1 LEADER]: Raft consensus shutting down.
I20260808 11:32:45.948745 5704 tablet_replica.cc:330] T 3135aee852834fcca56d88636bfd2451 P 8c9d83d2659f452fae21577f95cb3081: stopping tablet replica
I20260808 11:32:45.949208 5704 raft_consensus.cc:2229] T 3135aee852834fcca56d88636bfd2451 P 8c9d83d2659f452fae21577f95cb3081 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:32:45.949230 5702 raft_consensus.cc:2258] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:32:45.949780 5703 raft_consensus.cc:2229] T 3135aee852834fcca56d88636bfd2451 P 6fe6edc66455449ab35c4588a5b2e2c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:32:45.950296 5703 raft_consensus.cc:2258] T 3135aee852834fcca56d88636bfd2451 P 6fe6edc66455449ab35c4588a5b2e2c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:32:45.951206 5704 raft_consensus.cc:2258] T 3135aee852834fcca56d88636bfd2451 P 8c9d83d2659f452fae21577f95cb3081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:32:45.951349 5702 ts_tablet_manager.cc:1905] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:32:45.954103 5703 ts_tablet_manager.cc:1905] T 3135aee852834fcca56d88636bfd2451 P 6fe6edc66455449ab35c4588a5b2e2c2: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 11:32:45 dist-test-slave-zkpd krb5kdc[5114](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188763, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.129@KRBTEST.COM
I20260808 11:32:45.955456 5704 ts_tablet_manager.cc:1905] T 3135aee852834fcca56d88636bfd2451 P 8c9d83d2659f452fae21577f95cb3081: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:32:45.959501 5702 ts_tablet_manager.cc:1918] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:32:45.959726 5702 log.cc:1196] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-2/wal/wals/3135aee852834fcca56d88636bfd2451
I20260808 11:32:45.960696 5702 ts_tablet_manager.cc:1939] T 3135aee852834fcca56d88636bfd2451 P 26376d957247449e8584bf0ee60d7168: Deleting consensus metadata
I20260808 11:32:45.962487 5145 catalog_manager.cc:4841] TS 26376d957247449e8584bf0ee60d7168 (127.26.66.131:45025): tablet 3135aee852834fcca56d88636bfd2451 (table test-table [id=d1df3ddab3bd445ab24d942c67dbfc79]) successfully deleted
I20260808 11:32:45.965531 5703 ts_tablet_manager.cc:1918] T 3135aee852834fcca56d88636bfd2451 P 6fe6edc66455449ab35c4588a5b2e2c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:32:45.965687 5703 log.cc:1196] T 3135aee852834fcca56d88636bfd2451 P 6fe6edc66455449ab35c4588a5b2e2c2: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-0/wal/wals/3135aee852834fcca56d88636bfd2451
I20260808 11:32:45.966209 5703 ts_tablet_manager.cc:1939] T 3135aee852834fcca56d88636bfd2451 P 6fe6edc66455449ab35c4588a5b2e2c2: Deleting consensus metadata
I20260808 11:32:45.966355 5704 ts_tablet_manager.cc:1918] T 3135aee852834fcca56d88636bfd2451 P 8c9d83d2659f452fae21577f95cb3081: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:32:45.966527 5704 log.cc:1196] T 3135aee852834fcca56d88636bfd2451 P 8c9d83d2659f452fae21577f95cb3081: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786188664137852-26890-0/minicluster-data/ts-1/wal/wals/3135aee852834fcca56d88636bfd2451
I20260808 11:32:45.967109 5704 ts_tablet_manager.cc:1939] T 3135aee852834fcca56d88636bfd2451 P 8c9d83d2659f452fae21577f95cb3081: Deleting consensus metadata
I20260808 11:32:45.968281 5144 catalog_manager.cc:4841] TS 6fe6edc66455449ab35c4588a5b2e2c2 (127.26.66.129:44791): tablet 3135aee852834fcca56d88636bfd2451 (table test-table [id=d1df3ddab3bd445ab24d942c67dbfc79]) successfully deleted
I20260808 11:32:45.970153 5673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:45.933836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43144 (local address 127.26.66.129:44791)
0808 11:32:45.934067 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:45.934076 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:45.937879 (+ 3803us) server_negotiation.cc:407] Connection header received
0808 11:32:45.938808 (+ 929us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:45.938828 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:45.938944 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:45.939032 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:45.943364 (+ 4332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.944936 (+ 1572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.948553 (+ 3617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:45.949200 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:45.949315 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:45.955575 (+ 6260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:45.955589 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:45.955608 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:45.955659 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:45.959473 (+ 3814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:45.960420 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:45.960429 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:45.960433 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:45.960613 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:45.968041 (+ 7428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:45.968048 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:45.968051 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:45.968535 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:45.968861 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:45.969539 (+ 678us) server_negotiation.cc:299] Negotiation successful
0808 11:32:45.969777 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 11:32:45.970986 5358 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:45.971100 5146 catalog_manager.cc:4841] TS 8c9d83d2659f452fae21577f95cb3081 (127.26.66.130:46053): tablet 3135aee852834fcca56d88636bfd2451 (table test-table [id=d1df3ddab3bd445ab24d942c67dbfc79]) successfully deleted
I20260808 11:32:46.074024 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 5226
I20260808 11:32:46.102977 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 5369
Aug 08 11:32:46 dist-test-slave-zkpd krb5kdc[5114](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188763, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.130@KRBTEST.COM
I20260808 11:32:46.120146 5674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:46.103777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34226 (local address 127.26.66.130:46053)
0808 11:32:46.104014 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:46.104020 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:46.104201 (+ 181us) server_negotiation.cc:407] Connection header received
0808 11:32:46.104331 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:46.104337 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:46.104436 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:46.104540 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:46.105768 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:46.106993 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:46.108257 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:46.108880 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:46.109009 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:46.113237 (+ 4228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:46.113255 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:46.113273 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:46.113323 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:46.117065 (+ 3742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:46.117754 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:46.117764 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:46.117768 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:46.117935 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:46.118350 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:46.118356 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:46.118359 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:46.118877 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:46.119173 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:46.119386 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 11:32:46.119606 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 11:32:46.120925 5502 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:46.211314 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 5369
I20260808 11:32:46.233592 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 5514
Aug 08 11:32:46 dist-test-slave-zkpd krb5kdc[5114](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188763, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.131@KRBTEST.COM
I20260808 11:32:46.252087 5672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:32:46.234561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33234 (local address 127.26.66.131:45025)
0808 11:32:46.234761 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 11:32:46.234768 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:32:46.234794 (+ 26us) server_negotiation.cc:407] Connection header received
0808 11:32:46.234975 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:32:46.234980 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:32:46.235095 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:32:46.235245 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:32:46.236594 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:46.237857 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:46.239088 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:32:46.239804 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:32:46.239988 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:32:46.244493 (+ 4505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:32:46.244508 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:32:46.244527 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:32:46.244574 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:32:46.248658 (+ 4084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:46.249290 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:46.249300 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:46.249303 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:46.249486 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:32:46.249873 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:32:46.249880 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:32:46.249883 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:32:46.250509 (+ 626us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:32:46.250971 (+ 462us) server_negotiation.cc:1035] Waiting for connection context
0808 11:32:46.251143 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 11:32:46.251400 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 11:32:46.253072 5648 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:46.378136 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 5514
I20260808 11:32:46.403244 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 5127
I20260808 11:32:46.404484 5193 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:32:46.516134 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 5127
2026-08-08T11:32:46Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4659 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:32:46 dist-test-slave-zkpd krb5kdc[5712](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:32:46 dist-test-slave-zkpd krb5kdc[5712](info): set up 2 sockets
Aug 08 11:32:46 dist-test-slave-zkpd krb5kdc[5712](info): commencing operation
krb5kdc: starting...
W20260808 11:32:47.682590 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.000s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:32:47 dist-test-slave-zkpd krb5kdc[5712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188767, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:32:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:32:47Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.26.66.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.26.66.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.26.66.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/rangeradmin_127.26.66.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.26.66.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/rangeradmin_127.26.66.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.26.66.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.26.66.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.26.66.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/rangerlookup_127.26.66.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.26.66.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/rangerlookup_127.26.66.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.66.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.26.66.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.66.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/HTTP_127.26.66.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.66.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/HTTP_127.26.66.148@KRBTEST.COM.keytab.
I20260808 11:32:48.077070 26890 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskmiEqRe/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/postgres -l logfile start
2026-08-08 11:32:50.458 UTC [5743] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 11:32:50.458 UTC [5743] LOG: listening on IPv4 address "127.26.66.148", port 42217
2026-08-08 11:32:50.462 UTC [5743] LOG: listening on Unix socket "/tmp/.s.PGSQL.42217"
2026-08-08 11:32:50.482 UTC [5746] LOG: database system was shut down at 2026-08-08 11:32:49 UTC
2026-08-08 11:32:50.486 UTC [5743] LOG: database system is ready to accept connections
I20260808 11:32:51.503361 26890 mini_postgres.cc:96] Postgres bound to 42217
2026-08-08 11:32:51.529 UTC [5755] FATAL: database "slave" does not exist
127.26.66.148:42217 - accepting connections
I20260808 11:32:51.530404 26890 mini_ranger.cc:161] Starting Ranger...
I20260808 11:32:51.561888 26890 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 11:32:52.003113 26890 mini_ranger.cc:87] Created ranger Postgres database
I20260808 11:32:52.003288 26890 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ranger-admin
2026-08-08 11:32:52,308 [I] DB FLAVOR :POSTGRES
2026-08-08 11:32:52,308 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 11:32:52,308 [I] Checking connection..
2026-08-08 11:32:52,308 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 11:32:52,560 [I] Checking connection passed.
2026-08-08 11:32:52,560 [I] --------- Verifying version history table ---------
2026-08-08 11:32:52,561 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 11:32:52,790 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 11:32:52,791 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 11:32:53,027 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 11:32:53,028 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 11:32:53,028 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 11:32:53.268 UTC [5822] WARNING: there is no transaction in progress
2026-08-08 11:32:53,275 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 11:32:53,275 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 11:32:53,514 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 11:32:53,514 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 11:32:53,514 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 11:32:53,770 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 11:32:54,028 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-zkpd.c.gcp-upstream.internal','N') ;"
2026-08-08 11:32:54,274 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 11:32:54,522 [I] Table x_portal_user does not exist in database ranger
2026-08-08 11:32:54,522 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 11:32:54,781 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 11:32:54,781 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 11:32:55,014 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 11:32:55,284 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 11:32:55,284 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 11:32:56.209 UTC [5936] WARNING: there is no transaction in progress
2026-08-08 11:32:56.225 UTC [5936] WARNING: there is no transaction in progress
2026-08-08 11:32:56.241 UTC [5936] WARNING: there is no transaction in progress
2026-08-08 11:32:56.256 UTC [5936] WARNING: there is no transaction in progress
2026-08-08 11:32:56.271 UTC [5936] WARNING: there is no transaction in progress
2026-08-08 11:32:56.287 UTC [5936] WARNING: there is no transaction in progress
2026-08-08 11:32:56.344 UTC [5936] WARNING: there is no transaction in progress
2026-08-08 11:32:56.350 UTC [5936] WARNING: there is no transaction in progress
2026-08-08 11:32:56.364 UTC [5936] WARNING: there is no transaction in progress
2026-08-08 11:32:56.374 UTC [5936] WARNING: there is no transaction in progress
2026-08-08 11:32:56.384 UTC [5936] WARNING: there is no transaction in progress
2026-08-08 11:32:56.397 UTC [5936] WARNING: there is no transaction in progress
2026-08-08 11:32:56.406 UTC [5936] WARNING: there is no transaction in progress
2026-08-08 11:32:56.412 UTC [5936] WARNING: there is no transaction in progress
2026-08-08 11:32:56.418 UTC [5936] WARNING: there is no transaction in progress
2026-08-08 11:32:56.424 UTC [5936] WARNING: there is no transaction in progress
2026-08-08 11:32:57,015 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 11:32:57,015 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 11:32:57,286 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 11:32:57,286 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 11:32:57,543 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 11:32:57,543 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 11:32:57,784 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 11:32:57,784 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 11:32:58,015 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 11:32:58,257 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-zkpd.c.gcp-upstream.internal';"
2026-08-08 11:32:58,512 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 11:32:58,512 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 11:32:58,772 [I] DB_PATCHES have already been applied
I20260808 11:32:58.779085 26890 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ranger-admin:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskmiEqRe/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 11:32:58.779198 26890 mini_ranger.cc:193] Using host: 127.26.66.148
I20260808 11:32:58.803433 26890 mini_ranger.cc:227] Ranger admin URL: http://127.26.66.148:40285
Aug 08, 2026 11:32:59 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 11:32:59 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 11:32:59 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 11:32:59 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 11:32:59 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 11:32:59 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 11:32:59 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 11:32:59.973881 26890 mini_ranger.cc:160] Time spent starting Ranger: real 8.443s user 0.003s sys 0.063s
Aug 08, 2026 11:33:19 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 11:33:19 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 11:33:19 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 11:33:19 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 11:33:19 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 11:33:19 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 11:33:19 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 11:33:19 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 11:33:19 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 11:33:19 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 11:33:19 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 11:33:19 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 11:33:19 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 11:33:19 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 11:33:19 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 11:33:19 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 11:33:19 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 11:33:20 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 11:33:20.742782 26890 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.26.66.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.26.66.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.26.66.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/rangerkms_127.26.66.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.26.66.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/rangerkms_127.26.66.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.66.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.26.66.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.66.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/HTTP_127.26.66.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.66.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/HTTP_127.26.66.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 11:33:20 dist-test-slave-zkpd krb5kdc[5712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188800, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 11:33:20.964740 26890 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 11:33:20.992151 26890 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 11:33:21.826396 26890 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 11:33:21.826548 26890 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ranger-kms
I20260808 11:33:21.826710 26890 mini_ranger_kms.cc:227] Using postgres at 127.26.66.148:42217
2026-08-08 11:33:22,288 [I] DB FLAVOR :POSTGRES
2026-08-08 11:33:22,288 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 11:33:22,288 [I] Checking connection
2026-08-08 11:33:22,288 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:42217/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 11:33:22,528 [I] connection success
2026-08-08 11:33:22,528 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 11:33:22,529 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 11:33:22,529 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:42217/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 11:33:22,781 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 11:33:22,781 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 11:33:22,781 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 11:33:22,782 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:42217/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 11:33:23,031 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 11:33:23.505115 26890 mini_ranger_kms.cc:310] Created kms service
I20260808 11:33:23.737574 26890 mini_ranger_kms.cc:326] Created kudu user
I20260808 11:33:23.782927 26890 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 11:33:23 dist-test-slave-zkpd krb5kdc[5712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188800, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.26.66.148@KRBTEST.COM
I20260808 11:33:24.179066 26890 mini_ranger_kms.cc:384] Added ranger policy
I20260808 11:33:24.180896 26890 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ranger-kms:/tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 11:33:24.180980 26890 mini_ranger_kms.cc:240] Using host: 127.26.66.148
I20260808 11:33:24.211024 26890 mini_ranger_kms.cc:276] Ranger KMS PID: 6133
I20260808 11:33:24.211227 26890 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.26.66.148:40343
Aug 08, 2026 11:33:25 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 11:33:25 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 11:33:25 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 11:33:25 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 11:33:25 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 11:33:25 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260808 11:33:26.618769 26890 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.654s user 0.140s sys 0.373s
I20260808 11:33:26.619042 26890 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 11:33:26.619262 26890 mini_ranger_kms.cc:401] 127.26.66.148:40343/kms/v1/keys
Aug 08 11:33:26 dist-test-slave-zkpd krb5kdc[5712](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786188806, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.66.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 08 11:33:27 dist-test-slave-zkpd krb5kdc[5712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188806, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.66.148@KRBTEST.COM for HTTP/127.26.66.148@KRBTEST.COM
Aug 08 11:33:27 dist-test-slave-zkpd krb5kdc[5712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188806, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.66.148@KRBTEST.COM for HTTP/127.26.66.148@KRBTEST.COM
Aug 08 11:33:29 dist-test-slave-zkpd krb5kdc[5712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188809, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:33:29.791007 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:38277
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:45401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:38277
--ranger_config_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.66.148:40343/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:33:30.152433 6187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:33:30.152719 6187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:33:30.152891 6187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:33:30.160287 6187 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:33:30.160414 6187 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:33:30.160524 6187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:33:30.160624 6187 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:33:30.160732 6187 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:33:30.171007 6187 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/master-0/wal
--ranger_kms_url=127.26.66.148:40343/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:38277
--ranger_config_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:38277
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:33:30.172340 6187 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:33:30.173713 6187 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:33:30.185986 6195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:33:30.186105 6193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:33:30.186072 6192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:33:30.186273 6187 server_base.cc:1034] running on GCE node
I20260808 11:33:30.187395 6187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:33:30.188807 6187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:33:30.190048 6187 hybrid_clock.cc:648] HybridClock initialized: now 1786188810189995 us; error 49 us; skew 500 ppm
I20260808 11:33:30.190413 6187 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:33:30 dist-test-slave-zkpd krb5kdc[5712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188810, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:33:30.193607 6187 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:33:30.195142 6187 webserver.cc:460] Webserver started at http://127.26.66.190:46175/ using document root <none> and password file <none>
I20260808 11:33:30.195776 6187 fs_manager.cc:359] Metadata directory not provided
I20260808 11:33:30.195948 6187 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:33:30.196269 6187 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 11:33:30 dist-test-slave-zkpd krb5kdc[5712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188810, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for HTTP/127.26.66.148@KRBTEST.COM
I20260808 11:33:30.252666 6187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "21cb7fc0771a420f81f62c9595d5aa3f"
format_stamp: "Formatted at 2026-08-08 11:33:30 on dist-test-slave-zkpd"
server_key: "a979f92db342a9a1e48f206f48da7044"
server_key_iv: "9780d03af449b10bde34a3aac3888f2a"
server_key_version: "kuduclusterkey@0"
I20260808 11:33:30.253544 6187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "21cb7fc0771a420f81f62c9595d5aa3f"
format_stamp: "Formatted at 2026-08-08 11:33:30 on dist-test-slave-zkpd"
server_key: "a979f92db342a9a1e48f206f48da7044"
server_key_iv: "9780d03af449b10bde34a3aac3888f2a"
server_key_version: "kuduclusterkey@0"
I20260808 11:33:30.259363 6187 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 11:33:30.279793 6203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:33:30.281461 6187 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 11:33:30.281656 6187 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "21cb7fc0771a420f81f62c9595d5aa3f"
format_stamp: "Formatted at 2026-08-08 11:33:30 on dist-test-slave-zkpd"
server_key: "a979f92db342a9a1e48f206f48da7044"
server_key_iv: "9780d03af449b10bde34a3aac3888f2a"
server_key_version: "kuduclusterkey@0"
I20260808 11:33:30.282094 6187 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:33:30.300050 6187 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:33:30.304273 6187 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:33:30.304574 6187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:33:30.323930 6187 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:38277
I20260808 11:33:30.324008 6256 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:38277 every 8 connection(s)
I20260808 11:33:30.325280 6187 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:33:30.326676 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 6187
I20260808 11:33:30.326908 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:33:30.327787 26890 external_mini_cluster.cc:1428] Setting key 8353d3079968838bcea50a4562f05a6e
I20260808 11:33:30.330219 6257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:33:30.342252 6257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21cb7fc0771a420f81f62c9595d5aa3f: Bootstrap starting.
I20260808 11:33:30.345968 6257 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 21cb7fc0771a420f81f62c9595d5aa3f: Neither blocks nor log segments found. Creating new log.
Aug 08 11:33:30 dist-test-slave-zkpd krb5kdc[5712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188809, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:33:30.347045 6257 log.cc:824] T 00000000000000000000000000000000 P 21cb7fc0771a420f81f62c9595d5aa3f: Log is configured to *not* fsync() on all Append() calls
I20260808 11:33:30.349965 6257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21cb7fc0771a420f81f62c9595d5aa3f: No bootstrap required, opened a new log
I20260808 11:33:30.354754 6261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:33:30.329903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40532 (local address 127.26.66.190:38277)
0808 11:33:30.330751 (+ 848us) server_negotiation.cc:206] Beginning negotiation
0808 11:33:30.330762 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 11:33:30.330804 (+ 42us) server_negotiation.cc:407] Connection header received
0808 11:33:30.332447 (+ 1643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:33:30.332468 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:33:30.332843 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:33:30.333174 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:33:30.334754 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:30.336188 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:30.337977 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:30.338623 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:30.338758 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:33:30.347274 (+ 8516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:33:30.347285 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:33:30.347304 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:33:30.347344 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:33:30.350735 (+ 3391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:33:30.351563 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:33:30.351569 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:33:30.351574 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:33:30.351736 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:33:30.352175 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:33:30.352181 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:33:30.352183 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:33:30.352669 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:33:30.352926 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0808 11:33:30.353380 (+ 454us) server_negotiation.cc:299] Negotiation successful
0808 11:33:30.353710 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":622,"thread_start_us":422,"threads_started":1}
I20260808 11:33:30.358592 6257 raft_consensus.cc:348] T 00000000000000000000000000000000 P 21cb7fc0771a420f81f62c9595d5aa3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21cb7fc0771a420f81f62c9595d5aa3f" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38277 } }
I20260808 11:33:30.358963 6257 raft_consensus.cc:374] T 00000000000000000000000000000000 P 21cb7fc0771a420f81f62c9595d5aa3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:33:30.359086 6257 raft_consensus.cc:729] T 00000000000000000000000000000000 P 21cb7fc0771a420f81f62c9595d5aa3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21cb7fc0771a420f81f62c9595d5aa3f, State: Initialized, Role: FOLLOWER
I20260808 11:33:30.359730 6257 consensus_queue.cc:260] T 00000000000000000000000000000000 P 21cb7fc0771a420f81f62c9595d5aa3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21cb7fc0771a420f81f62c9595d5aa3f" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38277 } }
I20260808 11:33:30.360013 6257 raft_consensus.cc:388] T 00000000000000000000000000000000 P 21cb7fc0771a420f81f62c9595d5aa3f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:33:30.360159 6257 raft_consensus.cc:482] T 00000000000000000000000000000000 P 21cb7fc0771a420f81f62c9595d5aa3f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:33:30.360345 6257 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 21cb7fc0771a420f81f62c9595d5aa3f [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:33:30.362488 6257 raft_consensus.cc:504] T 00000000000000000000000000000000 P 21cb7fc0771a420f81f62c9595d5aa3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21cb7fc0771a420f81f62c9595d5aa3f" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38277 } }
I20260808 11:33:30.362996 6257 leader_election.cc:302] T 00000000000000000000000000000000 P 21cb7fc0771a420f81f62c9595d5aa3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 21cb7fc0771a420f81f62c9595d5aa3f; no voters:
I20260808 11:33:30.363571 6257 leader_election.cc:288] T 00000000000000000000000000000000 P 21cb7fc0771a420f81f62c9595d5aa3f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:33:30.363691 6263 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 21cb7fc0771a420f81f62c9595d5aa3f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:33:30.364421 6263 raft_consensus.cc:686] T 00000000000000000000000000000000 P 21cb7fc0771a420f81f62c9595d5aa3f [term 1 LEADER]: Becoming Leader. State: Replica: 21cb7fc0771a420f81f62c9595d5aa3f, State: Running, Role: LEADER
I20260808 11:33:30.364943 6263 consensus_queue.cc:237] T 00000000000000000000000000000000 P 21cb7fc0771a420f81f62c9595d5aa3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21cb7fc0771a420f81f62c9595d5aa3f" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38277 } }
I20260808 11:33:30.365608 6257 sys_catalog.cc:564] T 00000000000000000000000000000000 P 21cb7fc0771a420f81f62c9595d5aa3f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:33:30.368058 6266 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21cb7fc0771a420f81f62c9595d5aa3f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21cb7fc0771a420f81f62c9595d5aa3f. Latest consensus state: current_term: 1 leader_uuid: "21cb7fc0771a420f81f62c9595d5aa3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21cb7fc0771a420f81f62c9595d5aa3f" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38277 } } }
I20260808 11:33:30.368033 6265 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21cb7fc0771a420f81f62c9595d5aa3f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "21cb7fc0771a420f81f62c9595d5aa3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21cb7fc0771a420f81f62c9595d5aa3f" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38277 } } }
I20260808 11:33:30.368614 6265 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21cb7fc0771a420f81f62c9595d5aa3f [sys.catalog]: This master's current role is: LEADER
I20260808 11:33:30.370460 6271 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:33:30.370762 6266 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21cb7fc0771a420f81f62c9595d5aa3f [sys.catalog]: This master's current role is: LEADER
I20260808 11:33:30.375738 6271 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:33:30.385661 6271 catalog_manager.cc:1347] Generated new cluster ID: c38d0165835543159826da47ff674af2
I20260808 11:33:30.385766 6271 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:33:30.391119 6257 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 11:33:30.426687 6271 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:33:30.428798 6271 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:33:30.444726 6271 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 21cb7fc0771a420f81f62c9595d5aa3f: Generated new TSK 0
I20260808 11:33:30.445823 6271 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.66.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
I20260808 11:33:31.183156 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.66.148:40343/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:0
--local_ip_for_outbound_sockets=127.26.66.129
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:38277
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:45401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 11:33:31 dist-test-slave-zkpd krb5kdc[5712](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786188811, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 11:33:31.639287 6306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:33:31.639786 6306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:33:31.640035 6306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:33:31.651544 6306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:33:31.651762 6306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:33:31.652035 6306 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:33:31.667666 6306 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.26.66.148:40343/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:38277
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:33:31.669611 6306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:33:31.671497 6306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:33:31.694001 6316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:33:31.694628 6317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:33:31.698755 6319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:33:31.700711 6306 server_base.cc:1034] running on GCE node
I20260808 11:33:31.701586 6306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:33:31.703980 6306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:33:31.705319 6306 hybrid_clock.cc:648] HybridClock initialized: now 1786188811705207 us; error 97 us; skew 500 ppm
I20260808 11:33:31.705730 6306 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:33:31 dist-test-slave-zkpd krb5kdc[5712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188811, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:33:31.710213 6306 init.cc:377] Logged in from keytab as kudu/127.26.66.129@KRBTEST.COM (short username kudu)
I20260808 11:33:31.712466 6306 webserver.cc:460] Webserver started at http://127.26.66.129:37267/ using document root <none> and password file <none>
I20260808 11:33:31.713375 6306 fs_manager.cc:359] Metadata directory not provided
I20260808 11:33:31.713513 6306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:33:31.713893 6306 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 11:33:31 dist-test-slave-zkpd krb5kdc[5712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188811, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for HTTP/127.26.66.148@KRBTEST.COM
I20260808 11:33:31.739562 6306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-0/data/instance:
uuid: "f3667ef44bdc42f3bc4eb8b454a535e2"
format_stamp: "Formatted at 2026-08-08 11:33:31 on dist-test-slave-zkpd"
server_key: "7d193812e4ea29c811f2b608f3a21847"
server_key_iv: "b1e514b3803101bd8a9bc7bb6d17f8ab"
server_key_version: "kuduclusterkey@0"
I20260808 11:33:31.741523 6306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance:
uuid: "f3667ef44bdc42f3bc4eb8b454a535e2"
format_stamp: "Formatted at 2026-08-08 11:33:31 on dist-test-slave-zkpd"
server_key: "7d193812e4ea29c811f2b608f3a21847"
server_key_iv: "b1e514b3803101bd8a9bc7bb6d17f8ab"
server_key_version: "kuduclusterkey@0"
I20260808 11:33:31.753866 6306 fs_manager.cc:691] Time spent creating directory manager: real 0.012s user 0.004s sys 0.006s
I20260808 11:33:31.784554 6326 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:33:31.786499 6306 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.003s sys 0.004s
I20260808 11:33:31.786782 6306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "f3667ef44bdc42f3bc4eb8b454a535e2"
format_stamp: "Formatted at 2026-08-08 11:33:31 on dist-test-slave-zkpd"
server_key: "7d193812e4ea29c811f2b608f3a21847"
server_key_iv: "b1e514b3803101bd8a9bc7bb6d17f8ab"
server_key_version: "kuduclusterkey@0"
I20260808 11:33:31.787297 6306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:33:31.813786 6306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:33:31.819152 6306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:33:31.819595 6306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:33:31.829595 6306 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:33:31.831427 6306 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:33:31.831527 6306 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:33:31.831696 6306 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:33:31.831770 6306 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:33:31.928236 6306 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:42475
I20260808 11:33:31.928282 6438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:42475 every 8 connection(s)
I20260808 11:33:31.930008 6306 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:33:31.936146 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 6306
I20260808 11:33:31.936389 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance
I20260808 11:33:31.937453 26890 external_mini_cluster.cc:1428] Setting key 57331238cec003e23bd89c22d988326d
Aug 08 11:33:31 dist-test-slave-zkpd krb5kdc[5712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188811, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:33:31.971225 6441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:33:31.934323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:39217 (local address 127.26.66.190:38277)
0808 11:33:31.937984 (+ 3661us) server_negotiation.cc:206] Beginning negotiation
0808 11:33:31.937991 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:33:31.947505 (+ 9514us) server_negotiation.cc:407] Connection header received
0808 11:33:31.947579 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:33:31.947584 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:33:31.947668 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:33:31.947780 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:33:31.949912 (+ 2132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:31.951094 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:31.953542 (+ 2448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:31.954175 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:31.954435 (+ 260us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:33:31.963394 (+ 8959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:33:31.963402 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:33:31.963406 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:33:31.963451 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:33:31.967200 (+ 3749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:33:31.968263 (+ 1063us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:33:31.968269 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:33:31.968273 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:33:31.968423 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:33:31.969026 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:33:31.969031 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:33:31.969035 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:33:31.969419 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:33:31.969558 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 11:33:31.970591 (+ 1033us) server_negotiation.cc:299] Negotiation successful
0808 11:33:31.970845 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3519,"thread_start_us":3386,"threads_started":1}
I20260808 11:33:31.973722 6442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:33:31.935156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38277 (local address 127.26.66.129:39217)
0808 11:33:31.944449 (+ 9293us) negotiation.cc:107] Waiting for socket to connect
0808 11:33:31.944506 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 11:33:31.947102 (+ 2596us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:33:31.948271 (+ 1169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:33:31.948283 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:33:31.948898 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:33:31.949695 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:33:31.949720 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:33:31.951303 (+ 1583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:33:31.951308 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:33:31.953360 (+ 2052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:33:31.953376 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:33:31.954738 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:33:31.954745 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:33:31.955038 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:33:31.955875 (+ 837us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:33:31.960014 (+ 4139us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:33:31.963079 (+ 3065us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:33:31.967391 (+ 4312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:33:31.967401 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:33:31.967419 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:33:31.968112 (+ 693us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:33:31.968580 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:33:31.968585 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:33:31.968589 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:33:31.968874 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:33:31.969656 (+ 782us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:33:31.969665 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:33:31.970118 (+ 453us) client_negotiation.cc:769] Sending connection context
0808 11:33:31.971722 (+ 1604us) client_negotiation.cc:240] Negotiation successful
0808 11:33:31.972299 (+ 577us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8982,"thread_start_us":9775,"threads_started":1}
WARNING: no policy specified for kudu/127.26.66.130@KRBTEST.COM; defaulting to no policy
I20260808 11:33:31.975950 6439 heartbeater.cc:347] Connected to a master server at 127.26.66.190:38277
I20260808 11:33:31.976346 6439 heartbeater.cc:464] Registering TS with master...
I20260808 11:33:31.977185 6439 heartbeater.cc:511] Master 127.26.66.190:38277 requested a full tablet report, sending...
I20260808 11:33:31.979950 6220 ts_manager.cc:194] Registered new tserver with Master: f3667ef44bdc42f3bc4eb8b454a535e2 (127.26.66.129:42475)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.130@KRBTEST.COM" created.
I20260808 11:33:31.982060 6220 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.129@KRBTEST.COM'} at 127.26.66.129:39217
Aug 08 11:33:32 dist-test-slave-zkpd krb5kdc[5712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188811, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for HTTP/127.26.66.148@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
I20260808 11:33:32.025213 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.66.148:40343/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:0
--local_ip_for_outbound_sockets=127.26.66.130
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:38277
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:45401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 11:33:32 dist-test-slave-zkpd krb5kdc[5712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188811, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for HTTP/127.26.66.148@KRBTEST.COM
W20260808 11:33:32.535701 6445 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:33:32.536303 6445 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:33:32.536510 6445 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:33:32.552313 6445 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:33:32.552470 6445 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:33:32.552660 6445 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:33:32.566898 6445 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.26.66.148:40343/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:38277
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:33:32.568992 6445 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:33:32.570853 6445 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:33:32.608306 6452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:33:32.609505 6453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:33:32.616885 6455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:33:32.617336 6445 server_base.cc:1034] running on GCE node
I20260808 11:33:32.618028 6445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:33:32.619115 6445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:33:32.620393 6445 hybrid_clock.cc:648] HybridClock initialized: now 1786188812620335 us; error 66 us; skew 500 ppm
I20260808 11:33:32.620730 6445 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:33:32 dist-test-slave-zkpd krb5kdc[5712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188812, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:33:32.624094 6445 init.cc:377] Logged in from keytab as kudu/127.26.66.130@KRBTEST.COM (short username kudu)
I20260808 11:33:32.631728 6445 webserver.cc:460] Webserver started at http://127.26.66.130:33905/ using document root <none> and password file <none>
I20260808 11:33:32.632530 6445 fs_manager.cc:359] Metadata directory not provided
I20260808 11:33:32.632686 6445 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:33:32.633018 6445 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 11:33:32 dist-test-slave-zkpd krb5kdc[5712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188812, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for HTTP/127.26.66.148@KRBTEST.COM
I20260808 11:33:32.663407 6445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-1/data/instance:
uuid: "804f5ec271f542cea95cfaf83025dede"
format_stamp: "Formatted at 2026-08-08 11:33:32 on dist-test-slave-zkpd"
server_key: "043b45f7d56462b3fae54ad3e1d25da5"
server_key_iv: "61982928fe15c78aa960b24a6b8947e3"
server_key_version: "kuduclusterkey@0"
I20260808 11:33:32.664994 6445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance:
uuid: "804f5ec271f542cea95cfaf83025dede"
format_stamp: "Formatted at 2026-08-08 11:33:32 on dist-test-slave-zkpd"
server_key: "043b45f7d56462b3fae54ad3e1d25da5"
server_key_iv: "61982928fe15c78aa960b24a6b8947e3"
server_key_version: "kuduclusterkey@0"
I20260808 11:33:32.672178 6445 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260808 11:33:32.693959 6471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:33:32.696031 6445 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.006s sys 0.000s
I20260808 11:33:32.696228 6445 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "804f5ec271f542cea95cfaf83025dede"
format_stamp: "Formatted at 2026-08-08 11:33:32 on dist-test-slave-zkpd"
server_key: "043b45f7d56462b3fae54ad3e1d25da5"
server_key_iv: "61982928fe15c78aa960b24a6b8947e3"
server_key_version: "kuduclusterkey@0"
I20260808 11:33:32.696492 6445 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:33:32.730950 6445 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:33:32.736436 6445 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:33:32.736820 6445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:33:32.738062 6445 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:33:32.739815 6445 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:33:32.739931 6445 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260808 11:33:32.740072 6445 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:33:32.740137 6445 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:33:32.791383 6445 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:46785
I20260808 11:33:32.791432 6586 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:46785 every 8 connection(s)
I20260808 11:33:32.793062 6445 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:33:32.802901 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 6445
I20260808 11:33:32.803079 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance
I20260808 11:33:32.803675 26890 external_mini_cluster.cc:1428] Setting key 2e116fddff4e4899d0cf60f9cbf8778f
Aug 08 11:33:32 dist-test-slave-zkpd krb5kdc[5712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188812, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:33:32.824481 6590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:33:32.797083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:48529 (local address 127.26.66.190:38277)
0808 11:33:32.800447 (+ 3364us) server_negotiation.cc:206] Beginning negotiation
0808 11:33:32.800456 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:33:32.801519 (+ 1063us) server_negotiation.cc:407] Connection header received
0808 11:33:32.803698 (+ 2179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:33:32.803706 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:33:32.803854 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:33:32.804003 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:33:32.806213 (+ 2210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:32.807323 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:32.810279 (+ 2956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:32.810986 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:32.811101 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:33:32.816299 (+ 5198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:33:32.816308 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:33:32.816316 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:33:32.816361 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:33:32.820285 (+ 3924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:33:32.821223 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:33:32.821229 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:33:32.821232 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:33:32.821406 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:33:32.821963 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:33:32.821968 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:33:32.821971 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:33:32.822331 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:33:32.822471 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 11:33:32.823651 (+ 1180us) server_negotiation.cc:299] Negotiation successful
0808 11:33:32.823958 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3197,"thread_start_us":3077,"threads_started":1}
I20260808 11:33:32.825330 6589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:33:32.796518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38277 (local address 127.26.66.130:48529)
0808 11:33:32.801042 (+ 4524us) negotiation.cc:107] Waiting for socket to connect
0808 11:33:32.801091 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 11:33:32.803261 (+ 2170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:33:32.804461 (+ 1200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:33:32.804473 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:33:32.805155 (+ 682us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:33:32.805994 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:33:32.806022 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:33:32.807519 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:33:32.807527 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:33:32.810020 (+ 2493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:33:32.810038 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:33:32.811470 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:33:32.811480 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:33:32.811796 (+ 316us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:33:32.812701 (+ 905us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:33:32.812737 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:33:32.816013 (+ 3276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:33:32.820460 (+ 4447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:33:32.820470 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:33:32.820488 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:33:32.821068 (+ 580us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:33:32.821548 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:33:32.821554 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:33:32.821557 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:33:32.821825 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:33:32.822544 (+ 719us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:33:32.822552 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:33:32.823001 (+ 449us) client_negotiation.cc:769] Sending connection context
0808 11:33:32.823328 (+ 327us) client_negotiation.cc:240] Negotiation successful
0808 11:33:32.823869 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4245,"thread_start_us":4024,"threads_started":1}
I20260808 11:33:32.827042 6587 heartbeater.cc:347] Connected to a master server at 127.26.66.190:38277
I20260808 11:33:32.827395 6587 heartbeater.cc:464] Registering TS with master...
I20260808 11:33:32.828308 6587 heartbeater.cc:511] Master 127.26.66.190:38277 requested a full tablet report, sending...
I20260808 11:33:32.830120 6220 ts_manager.cc:194] Registered new tserver with Master: 804f5ec271f542cea95cfaf83025dede (127.26.66.130:46785)
I20260808 11:33:32.831221 6220 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.130@KRBTEST.COM'} at 127.26.66.130:48529
WARNING: no policy specified for kudu/127.26.66.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
I20260808 11:33:32.877558 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.66.148:40343/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:0
--local_ip_for_outbound_sockets=127.26.66.131
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:38277
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:45401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 11:33:32.986474 6439 heartbeater.cc:503] Master 127.26.66.190:38277 was elected leader, sending a full tablet report...
W20260808 11:33:33.235822 6593 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:33:33.236176 6593 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:33:33.236279 6593 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:33:33.243561 6593 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:33:33.243669 6593 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:33:33.243786 6593 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:33:33.256605 6593 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.26.66.148:40343/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:38277
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:33:33.258054 6593 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:33:33.259328 6593 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:33:33.272667 6598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:33:33.272792 6599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:33:33.273023 6601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:33:33.273756 6593 server_base.cc:1034] running on GCE node
I20260808 11:33:33.274379 6593 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:33:33.275306 6593 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:33:33.276501 6593 hybrid_clock.cc:648] HybridClock initialized: now 1786188813276444 us; error 53 us; skew 500 ppm
I20260808 11:33:33.276789 6593 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:33:33 dist-test-slave-zkpd krb5kdc[5712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188813, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:33:33.280231 6593 init.cc:377] Logged in from keytab as kudu/127.26.66.131@KRBTEST.COM (short username kudu)
I20260808 11:33:33.281632 6593 webserver.cc:460] Webserver started at http://127.26.66.131:34385/ using document root <none> and password file <none>
I20260808 11:33:33.282262 6593 fs_manager.cc:359] Metadata directory not provided
I20260808 11:33:33.282366 6593 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:33:33.282621 6593 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 11:33:33 dist-test-slave-zkpd krb5kdc[5712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188813, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for HTTP/127.26.66.148@KRBTEST.COM
I20260808 11:33:33.298317 6593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-2/data/instance:
uuid: "269229464cac4834a290f467c5271f79"
format_stamp: "Formatted at 2026-08-08 11:33:33 on dist-test-slave-zkpd"
server_key: "860fc58d5a8d3e88baa6ba8ca1b4a0d6"
server_key_iv: "f0b6443afa2bf152bea3a596eb36eabb"
server_key_version: "kuduclusterkey@0"
I20260808 11:33:33.299180 6593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance:
uuid: "269229464cac4834a290f467c5271f79"
format_stamp: "Formatted at 2026-08-08 11:33:33 on dist-test-slave-zkpd"
server_key: "860fc58d5a8d3e88baa6ba8ca1b4a0d6"
server_key_iv: "f0b6443afa2bf152bea3a596eb36eabb"
server_key_version: "kuduclusterkey@0"
I20260808 11:33:33.305033 6593 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 11:33:33.322763 6609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:33:33.324445 6593 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 11:33:33.324626 6593 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "269229464cac4834a290f467c5271f79"
format_stamp: "Formatted at 2026-08-08 11:33:33 on dist-test-slave-zkpd"
server_key: "860fc58d5a8d3e88baa6ba8ca1b4a0d6"
server_key_iv: "f0b6443afa2bf152bea3a596eb36eabb"
server_key_version: "kuduclusterkey@0"
I20260808 11:33:33.324875 6593 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:33:33.354568 6593 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:33:33.358210 6593 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:33:33.358539 6593 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:33:33.359535 6593 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:33:33.360929 6593 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:33:33.361037 6593 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:33:33.361183 6593 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:33:33.361266 6593 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:33:33.396283 6593 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:35143
I20260808 11:33:33.396327 6725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:35143 every 8 connection(s)
I20260808 11:33:33.397524 6593 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:33:33.400175 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 6593
I20260808 11:33:33.400400 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance
I20260808 11:33:33.400961 26890 external_mini_cluster.cc:1428] Setting key ac25efa770a714a2908c90a68b9e8afc
Aug 08 11:33:33 dist-test-slave-zkpd krb5kdc[5712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188813, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:33:33.419698 6728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:33:33.400163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:44213 (local address 127.26.66.190:38277)
0808 11:33:33.400769 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0808 11:33:33.400776 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:33:33.401981 (+ 1205us) server_negotiation.cc:407] Connection header received
0808 11:33:33.404878 (+ 2897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:33:33.404884 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:33:33.404974 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:33:33.405112 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:33:33.406985 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.407755 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.409334 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.409811 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.409959 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:33:33.413419 (+ 3460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:33:33.413424 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:33:33.413427 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:33:33.413458 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:33:33.416267 (+ 2809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:33:33.417098 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:33:33.417104 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:33:33.417108 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:33:33.417264 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:33:33.417776 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:33:33.417780 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:33:33.417782 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:33:33.418160 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:33:33.418321 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 11:33:33.419102 (+ 781us) server_negotiation.cc:299] Negotiation successful
0808 11:33:33.419327 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":274,"threads_started":1}
I20260808 11:33:33.420719 6729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:33:33.400863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38277 (local address 127.26.66.131:44213)
0808 11:33:33.401797 (+ 934us) negotiation.cc:107] Waiting for socket to connect
0808 11:33:33.401854 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 11:33:33.404577 (+ 2723us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:33:33.405406 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:33:33.405419 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:33:33.406057 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:33:33.406813 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:33:33.406833 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.407942 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.407952 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:33:33.409169 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:33:33.409181 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.410062 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.410070 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:33:33.410306 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:33:33.411041 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:33:33.411062 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:33:33.413195 (+ 2133us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:33:33.416400 (+ 3205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:33:33.416405 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:33:33.416416 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:33:33.416964 (+ 548us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:33:33.417391 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:33:33.417395 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:33:33.417399 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:33:33.417644 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:33:33.418295 (+ 651us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:33:33.418302 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:33:33.418681 (+ 379us) client_negotiation.cc:769] Sending connection context
0808 11:33:33.418991 (+ 310us) client_negotiation.cc:240] Negotiation successful
0808 11:33:33.419491 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":639,"thread_start_us":343,"threads_started":1}
I20260808 11:33:33.422000 6726 heartbeater.cc:347] Connected to a master server at 127.26.66.190:38277
I20260808 11:33:33.422319 6726 heartbeater.cc:464] Registering TS with master...
I20260808 11:33:33.423029 6726 heartbeater.cc:511] Master 127.26.66.190:38277 requested a full tablet report, sending...
I20260808 11:33:33.424469 6220 ts_manager.cc:194] Registered new tserver with Master: 269229464cac4834a290f467c5271f79 (127.26.66.131:35143)
I20260808 11:33:33.425235 6220 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.131@KRBTEST.COM'} at 127.26.66.131:44213
I20260808 11:33:33.431079 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 11:33:33.449424 6728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:33:33.435676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40106 (local address 127.26.66.190:38277)
0808 11:33:33.435879 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 11:33:33.435887 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:33:33.436379 (+ 492us) server_negotiation.cc:407] Connection header received
0808 11:33:33.436506 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:33:33.436510 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:33:33.436583 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:33:33.436662 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:33:33.438079 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.438776 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.440181 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.440602 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.440695 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:33:33.443010 (+ 2315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:33:33.443014 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:33:33.443018 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:33:33.443049 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:33:33.446483 (+ 3434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:33:33.447343 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:33:33.447349 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:33:33.447352 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:33:33.447510 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:33:33.447927 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:33:33.447934 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:33:33.447938 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:33:33.448233 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:33:33.448491 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0808 11:33:33.448865 (+ 374us) server_negotiation.cc:299] Negotiation successful
0808 11:33:33.449103 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 11:33:33.453496 6220 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40106:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 11:33:33.462199 6220 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:33:33.498190 6742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:33:33.475973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53566 (local address 127.26.66.129:42475)
0808 11:33:33.488906 (+ 12933us) server_negotiation.cc:206] Beginning negotiation
0808 11:33:33.488915 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:33:33.489781 (+ 866us) server_negotiation.cc:407] Connection header received
0808 11:33:33.489893 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:33:33.489901 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:33:33.490167 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:33:33.490415 (+ 248us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:33:33.491212 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.492723 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.495475 (+ 2752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.496992 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.497127 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:33:33.497374 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0808 11:33:33.497666 (+ 292us) server_negotiation.cc:299] Negotiation successful
0808 11:33:33.497844 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12750,"thread_start_us":12938,"threads_started":1}
I20260808 11:33:33.498282 6743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:33:33.475372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:42475 (local address 127.0.0.1:53566)
0808 11:33:33.489026 (+ 13654us) negotiation.cc:107] Waiting for socket to connect
0808 11:33:33.489087 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 11:33:33.489299 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:33:33.490415 (+ 1116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:33:33.490422 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:33:33.490452 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:33:33.490990 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:33:33.491009 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.492893 (+ 1884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.492898 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:33:33.495299 (+ 2401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:33:33.495318 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.497199 (+ 1881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.497205 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:33:33.497410 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:33:33.497465 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 11:33:33.497614 (+ 149us) client_negotiation.cc:240] Negotiation successful
0808 11:33:33.497806 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13303,"mutex_wait_us":11,"thread_start_us":14237,"threads_started":1}
I20260808 11:33:33.499097 6741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:33:33.475504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:35143 (local address 127.0.0.1:36196)
0808 11:33:33.489412 (+ 13908us) negotiation.cc:107] Waiting for socket to connect
0808 11:33:33.489441 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 11:33:33.489625 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:33:33.491698 (+ 2073us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:33:33.491703 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:33:33.491728 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:33:33.492075 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:33:33.492087 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.494129 (+ 2042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.494135 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:33:33.495791 (+ 1656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:33:33.495814 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.498298 (+ 2484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.498307 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:33:33.498484 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:33:33.498513 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 11:33:33.498594 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 11:33:33.498718 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13774,"mutex_wait_us":2,"thread_start_us":13618,"threads_started":1}
I20260808 11:33:33.499240 6740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:33:33.475594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36196 (local address 127.26.66.131:35143)
0808 11:33:33.487567 (+ 11973us) server_negotiation.cc:206] Beginning negotiation
0808 11:33:33.487576 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:33:33.490693 (+ 3117us) server_negotiation.cc:407] Connection header received
0808 11:33:33.490804 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:33:33.490811 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:33:33.491027 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:33:33.491690 (+ 663us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:33:33.492342 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.493995 (+ 1653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.496309 (+ 2314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.497761 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.497887 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:33:33.498117 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0808 11:33:33.498697 (+ 580us) server_negotiation.cc:299] Negotiation successful
0808 11:33:33.498859 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11784,"thread_start_us":11618,"threads_started":1}
I20260808 11:33:33.499269 6744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:33:33.476936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32994 (local address 127.26.66.130:46785)
0808 11:33:33.488213 (+ 11277us) server_negotiation.cc:206] Beginning negotiation
0808 11:33:33.488226 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 11:33:33.490150 (+ 1924us) server_negotiation.cc:407] Connection header received
0808 11:33:33.490249 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:33:33.490253 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:33:33.490433 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:33:33.490638 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:33:33.491388 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.493642 (+ 2254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.496116 (+ 2474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.497507 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.497637 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:33:33.497841 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0808 11:33:33.498719 (+ 878us) server_negotiation.cc:299] Negotiation successful
0808 11:33:33.498904 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11070,"thread_start_us":10896,"threads_started":1}
I20260808 11:33:33.500483 6739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:33:33.476277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:46785 (local address 127.0.0.1:32994)
0808 11:33:33.489861 (+ 13584us) negotiation.cc:107] Waiting for socket to connect
0808 11:33:33.489875 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 11:33:33.490012 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:33:33.490624 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:33:33.490630 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:33:33.490661 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:33:33.491203 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:33:33.491215 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.493815 (+ 2600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.493821 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:33:33.495957 (+ 2136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:33:33.495974 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.498011 (+ 2037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.498017 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:33:33.498203 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:33:33.498259 (+ 56us) client_negotiation.cc:769] Sending connection context
0808 11:33:33.498362 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 11:33:33.500094 (+ 1732us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13489,"mutex_wait_us":87,"thread_start_us":12220,"threads_started":1}
I20260808 11:33:33.502702 6374 tablet_service.cc:1467] Processing CreateTablet for tablet 5cdb595f881f41eeaf0ab17414f49d5f (DEFAULT_TABLE table=test-table [id=79eb4ff5312c418f9690bd9311861f29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:33:33.503017 6659 tablet_service.cc:1467] Processing CreateTablet for tablet 5cdb595f881f41eeaf0ab17414f49d5f (DEFAULT_TABLE table=test-table [id=79eb4ff5312c418f9690bd9311861f29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:33:33.504279 6374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cdb595f881f41eeaf0ab17414f49d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:33:33.504513 6659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cdb595f881f41eeaf0ab17414f49d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:33:33.504300 6521 tablet_service.cc:1467] Processing CreateTablet for tablet 5cdb595f881f41eeaf0ab17414f49d5f (DEFAULT_TABLE table=test-table [id=79eb4ff5312c418f9690bd9311861f29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:33:33.505674 6521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cdb595f881f41eeaf0ab17414f49d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:33:33.517590 6745 tablet_bootstrap.cc:492] T 5cdb595f881f41eeaf0ab17414f49d5f P f3667ef44bdc42f3bc4eb8b454a535e2: Bootstrap starting.
I20260808 11:33:33.521445 6747 tablet_bootstrap.cc:492] T 5cdb595f881f41eeaf0ab17414f49d5f P 804f5ec271f542cea95cfaf83025dede: Bootstrap starting.
I20260808 11:33:33.522183 6745 tablet_bootstrap.cc:654] T 5cdb595f881f41eeaf0ab17414f49d5f P f3667ef44bdc42f3bc4eb8b454a535e2: Neither blocks nor log segments found. Creating new log.
I20260808 11:33:33.523115 6746 tablet_bootstrap.cc:492] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79: Bootstrap starting.
I20260808 11:33:33.523613 6745 log.cc:824] T 5cdb595f881f41eeaf0ab17414f49d5f P f3667ef44bdc42f3bc4eb8b454a535e2: Log is configured to *not* fsync() on all Append() calls
I20260808 11:33:33.525276 6747 tablet_bootstrap.cc:654] T 5cdb595f881f41eeaf0ab17414f49d5f P 804f5ec271f542cea95cfaf83025dede: Neither blocks nor log segments found. Creating new log.
I20260808 11:33:33.526418 6745 tablet_bootstrap.cc:492] T 5cdb595f881f41eeaf0ab17414f49d5f P f3667ef44bdc42f3bc4eb8b454a535e2: No bootstrap required, opened a new log
I20260808 11:33:33.526525 6747 log.cc:824] T 5cdb595f881f41eeaf0ab17414f49d5f P 804f5ec271f542cea95cfaf83025dede: Log is configured to *not* fsync() on all Append() calls
I20260808 11:33:33.526726 6745 ts_tablet_manager.cc:1397] T 5cdb595f881f41eeaf0ab17414f49d5f P f3667ef44bdc42f3bc4eb8b454a535e2: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.004s
I20260808 11:33:33.526794 6746 tablet_bootstrap.cc:654] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79: Neither blocks nor log segments found. Creating new log.
I20260808 11:33:33.528486 6746 log.cc:824] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79: Log is configured to *not* fsync() on all Append() calls
I20260808 11:33:33.529663 6747 tablet_bootstrap.cc:492] T 5cdb595f881f41eeaf0ab17414f49d5f P 804f5ec271f542cea95cfaf83025dede: No bootstrap required, opened a new log
I20260808 11:33:33.530049 6747 ts_tablet_manager.cc:1397] T 5cdb595f881f41eeaf0ab17414f49d5f P 804f5ec271f542cea95cfaf83025dede: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260808 11:33:33.531186 6746 tablet_bootstrap.cc:492] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79: No bootstrap required, opened a new log
I20260808 11:33:33.531441 6746 ts_tablet_manager.cc:1397] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260808 11:33:33.537388 6745 raft_consensus.cc:348] T 5cdb595f881f41eeaf0ab17414f49d5f P f3667ef44bdc42f3bc4eb8b454a535e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "269229464cac4834a290f467c5271f79" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 35143 } } peers { permanent_uuid: "f3667ef44bdc42f3bc4eb8b454a535e2" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42475 } } peers { permanent_uuid: "804f5ec271f542cea95cfaf83025dede" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46785 } }
I20260808 11:33:33.537811 6745 raft_consensus.cc:374] T 5cdb595f881f41eeaf0ab17414f49d5f P f3667ef44bdc42f3bc4eb8b454a535e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:33:33.537892 6745 raft_consensus.cc:729] T 5cdb595f881f41eeaf0ab17414f49d5f P f3667ef44bdc42f3bc4eb8b454a535e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3667ef44bdc42f3bc4eb8b454a535e2, State: Initialized, Role: FOLLOWER
I20260808 11:33:33.538590 6745 consensus_queue.cc:260] T 5cdb595f881f41eeaf0ab17414f49d5f P f3667ef44bdc42f3bc4eb8b454a535e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "269229464cac4834a290f467c5271f79" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 35143 } } peers { permanent_uuid: "f3667ef44bdc42f3bc4eb8b454a535e2" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42475 } } peers { permanent_uuid: "804f5ec271f542cea95cfaf83025dede" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46785 } }
I20260808 11:33:33.539110 6746 raft_consensus.cc:348] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "269229464cac4834a290f467c5271f79" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 35143 } } peers { permanent_uuid: "f3667ef44bdc42f3bc4eb8b454a535e2" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42475 } } peers { permanent_uuid: "804f5ec271f542cea95cfaf83025dede" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46785 } }
I20260808 11:33:33.539572 6746 raft_consensus.cc:374] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:33:33.539670 6746 raft_consensus.cc:729] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 269229464cac4834a290f467c5271f79, State: Initialized, Role: FOLLOWER
I20260808 11:33:33.540261 6746 consensus_queue.cc:260] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "269229464cac4834a290f467c5271f79" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 35143 } } peers { permanent_uuid: "f3667ef44bdc42f3bc4eb8b454a535e2" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42475 } } peers { permanent_uuid: "804f5ec271f542cea95cfaf83025dede" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46785 } }
I20260808 11:33:33.540474 6745 ts_tablet_manager.cc:1428] T 5cdb595f881f41eeaf0ab17414f49d5f P f3667ef44bdc42f3bc4eb8b454a535e2: Time spent starting tablet: real 0.014s user 0.014s sys 0.001s
I20260808 11:33:33.540498 6747 raft_consensus.cc:348] T 5cdb595f881f41eeaf0ab17414f49d5f P 804f5ec271f542cea95cfaf83025dede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "269229464cac4834a290f467c5271f79" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 35143 } } peers { permanent_uuid: "f3667ef44bdc42f3bc4eb8b454a535e2" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42475 } } peers { permanent_uuid: "804f5ec271f542cea95cfaf83025dede" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46785 } }
I20260808 11:33:33.540899 6747 raft_consensus.cc:374] T 5cdb595f881f41eeaf0ab17414f49d5f P 804f5ec271f542cea95cfaf83025dede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:33:33.540971 6747 raft_consensus.cc:729] T 5cdb595f881f41eeaf0ab17414f49d5f P 804f5ec271f542cea95cfaf83025dede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 804f5ec271f542cea95cfaf83025dede, State: Initialized, Role: FOLLOWER
I20260808 11:33:33.541484 6747 consensus_queue.cc:260] T 5cdb595f881f41eeaf0ab17414f49d5f P 804f5ec271f542cea95cfaf83025dede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "269229464cac4834a290f467c5271f79" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 35143 } } peers { permanent_uuid: "f3667ef44bdc42f3bc4eb8b454a535e2" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42475 } } peers { permanent_uuid: "804f5ec271f542cea95cfaf83025dede" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46785 } }
I20260808 11:33:33.542810 6587 heartbeater.cc:503] Master 127.26.66.190:38277 was elected leader, sending a full tablet report...
I20260808 11:33:33.542858 6746 ts_tablet_manager.cc:1428] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79: Time spent starting tablet: real 0.011s user 0.008s sys 0.004s
I20260808 11:33:33.543275 6726 heartbeater.cc:503] Master 127.26.66.190:38277 was elected leader, sending a full tablet report...
I20260808 11:33:33.543363 6747 ts_tablet_manager.cc:1428] T 5cdb595f881f41eeaf0ab17414f49d5f P 804f5ec271f542cea95cfaf83025dede: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
W20260808 11:33:33.555061 6588 tablet.cc:2369] T 5cdb595f881f41eeaf0ab17414f49d5f P 804f5ec271f542cea95cfaf83025dede: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 11:33:33.649204 6727 tablet.cc:2369] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 11:33:33.690750 6440 tablet.cc:2369] T 5cdb595f881f41eeaf0ab17414f49d5f P f3667ef44bdc42f3bc4eb8b454a535e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:33:33.855217 6752 raft_consensus.cc:482] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:33:33.855494 6752 raft_consensus.cc:504] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "269229464cac4834a290f467c5271f79" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 35143 } } peers { permanent_uuid: "f3667ef44bdc42f3bc4eb8b454a535e2" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42475 } } peers { permanent_uuid: "804f5ec271f542cea95cfaf83025dede" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46785 } }
I20260808 11:33:33.857208 6752 leader_election.cc:288] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3667ef44bdc42f3bc4eb8b454a535e2 (127.26.66.129:42475), 804f5ec271f542cea95cfaf83025dede (127.26.66.130:46785)
I20260808 11:33:33.863736 6729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:33:33.857368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:42475 (local address 127.26.66.131:42895)
0808 11:33:33.857542 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 11:33:33.857563 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 11:33:33.857691 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:33:33.858327 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:33:33.858330 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:33:33.858356 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:33:33.858602 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:33:33.858614 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.859873 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.859879 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:33:33.861636 (+ 1757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:33:33.861650 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.862958 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.862966 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:33:33.863152 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:33:33.863209 (+ 57us) client_negotiation.cc:769] Sending connection context
0808 11:33:33.863316 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 11:33:33.863465 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 11:33:33.863749 6742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:33:33.857770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:42895 (local address 127.26.66.129:42475)
0808 11:33:33.857994 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 11:33:33.858002 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:33:33.858026 (+ 24us) server_negotiation.cc:407] Connection header received
0808 11:33:33.858106 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:33:33.858110 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:33:33.858188 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:33:33.858289 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:33:33.858756 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.859729 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.861808 (+ 2079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.862779 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.862913 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:33:33.862967 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 11:33:33.863351 (+ 384us) server_negotiation.cc:299] Negotiation successful
0808 11:33:33.863486 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 11:33:33.864300 6744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:33:33.857652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:33197 (local address 127.26.66.130:46785)
0808 11:33:33.857927 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0808 11:33:33.857936 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:33:33.858428 (+ 492us) server_negotiation.cc:407] Connection header received
0808 11:33:33.858603 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:33:33.858608 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:33:33.858709 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:33:33.858803 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:33:33.859371 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.860451 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.862315 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.863365 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.863506 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:33:33.863571 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 11:33:33.864010 (+ 439us) server_negotiation.cc:299] Negotiation successful
0808 11:33:33.864124 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260808 11:33:33.864856 6754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:33:33.857644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:46785 (local address 127.26.66.131:33197)
0808 11:33:33.858302 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0808 11:33:33.858320 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 11:33:33.858470 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:33:33.858851 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:33:33.858857 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:33:33.858884 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:33:33.859219 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:33:33.859230 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.860596 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.860601 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:33:33.862155 (+ 1554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:33:33.862171 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.863566 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.863573 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:33:33.863752 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:33:33.863794 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 11:33:33.864498 (+ 704us) client_negotiation.cc:240] Negotiation successful
0808 11:33:33.864623 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":334,"threads_started":1}
I20260808 11:33:33.864766 6394 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cdb595f881f41eeaf0ab17414f49d5f" candidate_uuid: "269229464cac4834a290f467c5271f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3667ef44bdc42f3bc4eb8b454a535e2" is_pre_election: true
I20260808 11:33:33.865321 6394 raft_consensus.cc:2454] T 5cdb595f881f41eeaf0ab17414f49d5f P f3667ef44bdc42f3bc4eb8b454a535e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 269229464cac4834a290f467c5271f79 in term 0.
I20260808 11:33:33.866000 6613 leader_election.cc:302] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269229464cac4834a290f467c5271f79, f3667ef44bdc42f3bc4eb8b454a535e2; no voters:
I20260808 11:33:33.865926 6541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cdb595f881f41eeaf0ab17414f49d5f" candidate_uuid: "269229464cac4834a290f467c5271f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "804f5ec271f542cea95cfaf83025dede" is_pre_election: true
I20260808 11:33:33.866454 6752 raft_consensus.cc:2781] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:33:33.866521 6541 raft_consensus.cc:2454] T 5cdb595f881f41eeaf0ab17414f49d5f P 804f5ec271f542cea95cfaf83025dede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 269229464cac4834a290f467c5271f79 in term 0.
I20260808 11:33:33.866622 6752 raft_consensus.cc:482] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:33:33.866744 6752 raft_consensus.cc:3037] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:33:33.869482 6752 raft_consensus.cc:504] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "269229464cac4834a290f467c5271f79" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 35143 } } peers { permanent_uuid: "f3667ef44bdc42f3bc4eb8b454a535e2" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42475 } } peers { permanent_uuid: "804f5ec271f542cea95cfaf83025dede" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46785 } }
I20260808 11:33:33.870100 6752 leader_election.cc:288] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79 [CANDIDATE]: Term 1 election: Requested vote from peers f3667ef44bdc42f3bc4eb8b454a535e2 (127.26.66.129:42475), 804f5ec271f542cea95cfaf83025dede (127.26.66.130:46785)
I20260808 11:33:33.870628 6394 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cdb595f881f41eeaf0ab17414f49d5f" candidate_uuid: "269229464cac4834a290f467c5271f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3667ef44bdc42f3bc4eb8b454a535e2"
I20260808 11:33:33.870627 6541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cdb595f881f41eeaf0ab17414f49d5f" candidate_uuid: "269229464cac4834a290f467c5271f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "804f5ec271f542cea95cfaf83025dede"
I20260808 11:33:33.870844 6541 raft_consensus.cc:3037] T 5cdb595f881f41eeaf0ab17414f49d5f P 804f5ec271f542cea95cfaf83025dede [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:33:33.870844 6394 raft_consensus.cc:3037] T 5cdb595f881f41eeaf0ab17414f49d5f P f3667ef44bdc42f3bc4eb8b454a535e2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:33:33.874177 6541 raft_consensus.cc:2454] T 5cdb595f881f41eeaf0ab17414f49d5f P 804f5ec271f542cea95cfaf83025dede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 269229464cac4834a290f467c5271f79 in term 1.
I20260808 11:33:33.874177 6394 raft_consensus.cc:2454] T 5cdb595f881f41eeaf0ab17414f49d5f P f3667ef44bdc42f3bc4eb8b454a535e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 269229464cac4834a290f467c5271f79 in term 1.
I20260808 11:33:33.874629 6612 leader_election.cc:302] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269229464cac4834a290f467c5271f79, 804f5ec271f542cea95cfaf83025dede; no voters:
I20260808 11:33:33.874979 6752 raft_consensus.cc:2781] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:33:33.875447 6752 raft_consensus.cc:686] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79 [term 1 LEADER]: Becoming Leader. State: Replica: 269229464cac4834a290f467c5271f79, State: Running, Role: LEADER
I20260808 11:33:33.875994 6752 consensus_queue.cc:237] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "269229464cac4834a290f467c5271f79" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 35143 } } peers { permanent_uuid: "f3667ef44bdc42f3bc4eb8b454a535e2" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42475 } } peers { permanent_uuid: "804f5ec271f542cea95cfaf83025dede" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46785 } }
I20260808 11:33:33.880955 6219 catalog_manager.cc:5495] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 269229464cac4834a290f467c5271f79 (127.26.66.131). New cstate: current_term: 1 leader_uuid: "269229464cac4834a290f467c5271f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "269229464cac4834a290f467c5271f79" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 35143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3667ef44bdc42f3bc4eb8b454a535e2" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "804f5ec271f542cea95cfaf83025dede" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46785 } health_report { overall_health: UNKNOWN } } }
I20260808 11:33:33.953332 6740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:33:33.947652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36206 (local address 127.26.66.131:35143)
0808 11:33:33.947883 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 11:33:33.947907 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 11:33:33.947929 (+ 22us) server_negotiation.cc:407] Connection header received
0808 11:33:33.948171 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:33:33.948175 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:33:33.948265 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:33:33.948422 (+ 157us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:33:33.948848 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.949575 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.951127 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:33.951533 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:33.951671 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:33:33.952232 (+ 561us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:33:33.952725 (+ 493us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:33:33.952912 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 11:33:33.952963 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 11:33:33.953046 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 11:33:33.961632 6394 raft_consensus.cc:1261] T 5cdb595f881f41eeaf0ab17414f49d5f P f3667ef44bdc42f3bc4eb8b454a535e2 [term 1 FOLLOWER]: Refusing update from remote peer 269229464cac4834a290f467c5271f79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:33:33.961630 6541 raft_consensus.cc:1261] T 5cdb595f881f41eeaf0ab17414f49d5f P 804f5ec271f542cea95cfaf83025dede [term 1 FOLLOWER]: Refusing update from remote peer 269229464cac4834a290f467c5271f79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:33:33.962747 6752 consensus_queue.cc:1035] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "804f5ec271f542cea95cfaf83025dede" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:33:33.963099 6755 consensus_queue.cc:1035] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3667ef44bdc42f3bc4eb8b454a535e2" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 42475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:33:33.974669 6758 mvcc.cc:205] Tried to move back new op lower bound from 7316229381975724032 to 7316229381640122368. Current Snapshot: MvccSnapshot[applied={T|T < 7316229381975724032}]
I20260808 11:33:33.989399 6219 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40106:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:33:33.989698 6219 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40106:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:33:33.993225 6219 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 21cb7fc0771a420f81f62c9595d5aa3f: Sending DeleteTablet for 3 replicas of tablet 5cdb595f881f41eeaf0ab17414f49d5f
I20260808 11:33:33.994414 6659 tablet_service.cc:1514] Processing DeleteTablet for tablet 5cdb595f881f41eeaf0ab17414f49d5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:33:33 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:36196
I20260808 11:33:33.994534 6374 tablet_service.cc:1514] Processing DeleteTablet for tablet 5cdb595f881f41eeaf0ab17414f49d5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:33:33 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:53566
I20260808 11:33:33.994547 6521 tablet_service.cc:1514] Processing DeleteTablet for tablet 5cdb595f881f41eeaf0ab17414f49d5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:33:33 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:32994
I20260808 11:33:33.996877 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 6306
I20260808 11:33:34.005649 6768 tablet_replica.cc:330] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79: stopping tablet replica
I20260808 11:33:34.006101 6768 raft_consensus.cc:2229] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79 [term 1 LEADER]: Raft consensus shutting down.
I20260808 11:33:34.006789 6768 raft_consensus.cc:2258] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:33:34.007560 6770 tablet_replica.cc:330] T 5cdb595f881f41eeaf0ab17414f49d5f P 804f5ec271f542cea95cfaf83025dede: stopping tablet replica
I20260808 11:33:34.008252 6770 raft_consensus.cc:2229] T 5cdb595f881f41eeaf0ab17414f49d5f P 804f5ec271f542cea95cfaf83025dede [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:33:34.008742 6770 raft_consensus.cc:2258] T 5cdb595f881f41eeaf0ab17414f49d5f P 804f5ec271f542cea95cfaf83025dede [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:33:34.010836 6768 ts_tablet_manager.cc:1905] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:33:34.015089 6769 tablet_replica.cc:330] T 5cdb595f881f41eeaf0ab17414f49d5f P f3667ef44bdc42f3bc4eb8b454a535e2: stopping tablet replica
I20260808 11:33:34.015530 6769 raft_consensus.cc:2229] T 5cdb595f881f41eeaf0ab17414f49d5f P f3667ef44bdc42f3bc4eb8b454a535e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:33:34.016170 6769 raft_consensus.cc:2258] T 5cdb595f881f41eeaf0ab17414f49d5f P f3667ef44bdc42f3bc4eb8b454a535e2 [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 08 11:33:34 dist-test-slave-zkpd krb5kdc[5712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188809, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.129@KRBTEST.COM
I20260808 11:33:34.018472 6768 ts_tablet_manager.cc:1918] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:33:34.018654 6768 log.cc:1196] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-2/wal/wals/5cdb595f881f41eeaf0ab17414f49d5f
I20260808 11:33:34.019236 6768 ts_tablet_manager.cc:1939] T 5cdb595f881f41eeaf0ab17414f49d5f P 269229464cac4834a290f467c5271f79: Deleting consensus metadata
I20260808 11:33:34.019332 6769 ts_tablet_manager.cc:1905] T 5cdb595f881f41eeaf0ab17414f49d5f P f3667ef44bdc42f3bc4eb8b454a535e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:33:34.021452 6770 ts_tablet_manager.cc:1905] T 5cdb595f881f41eeaf0ab17414f49d5f P 804f5ec271f542cea95cfaf83025dede: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:33:34.027256 6742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:33:33.998637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53582 (local address 127.26.66.129:42475)
0808 11:33:33.998868 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 11:33:33.998877 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:33:34.005345 (+ 6468us) server_negotiation.cc:407] Connection header received
0808 11:33:34.005573 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:33:34.005581 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:33:34.005690 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:33:34.005821 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:33:34.008074 (+ 2253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:34.009569 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:34.010941 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:34.011962 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:34.012115 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:33:34.019231 (+ 7116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:33:34.019244 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:33:34.019259 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:33:34.019297 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:33:34.023418 (+ 4121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:33:34.024432 (+ 1014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:33:34.024441 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:33:34.024446 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:33:34.024624 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:33:34.025112 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:33:34.025117 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:33:34.025120 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:33:34.025623 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:33:34.025944 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0808 11:33:34.026492 (+ 548us) server_negotiation.cc:299] Negotiation successful
0808 11:33:34.026744 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 11:33:34.027010 6769 ts_tablet_manager.cc:1918] T 5cdb595f881f41eeaf0ab17414f49d5f P f3667ef44bdc42f3bc4eb8b454a535e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:33:34.027633 6769 log.cc:1196] T 5cdb595f881f41eeaf0ab17414f49d5f P f3667ef44bdc42f3bc4eb8b454a535e2: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-0/wal/wals/5cdb595f881f41eeaf0ab17414f49d5f
I20260808 11:33:34.028282 6769 ts_tablet_manager.cc:1939] T 5cdb595f881f41eeaf0ab17414f49d5f P f3667ef44bdc42f3bc4eb8b454a535e2: Deleting consensus metadata
I20260808 11:33:34.028680 6770 ts_tablet_manager.cc:1918] T 5cdb595f881f41eeaf0ab17414f49d5f P 804f5ec271f542cea95cfaf83025dede: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:33:34.028733 6434 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:33:34.028879 6770 log.cc:1196] T 5cdb595f881f41eeaf0ab17414f49d5f P 804f5ec271f542cea95cfaf83025dede: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786188664137852-26890-0/minicluster-data/ts-1/wal/wals/5cdb595f881f41eeaf0ab17414f49d5f
I20260808 11:33:34.029604 6770 ts_tablet_manager.cc:1939] T 5cdb595f881f41eeaf0ab17414f49d5f P 804f5ec271f542cea95cfaf83025dede: Deleting consensus metadata
I20260808 11:33:34.032271 6206 catalog_manager.cc:4841] TS 804f5ec271f542cea95cfaf83025dede (127.26.66.130:46785): tablet 5cdb595f881f41eeaf0ab17414f49d5f (table test-table [id=79eb4ff5312c418f9690bd9311861f29]) successfully deleted
I20260808 11:33:34.033298 6205 catalog_manager.cc:4841] TS 269229464cac4834a290f467c5271f79 (127.26.66.131:35143): tablet 5cdb595f881f41eeaf0ab17414f49d5f (table test-table [id=79eb4ff5312c418f9690bd9311861f29]) successfully deleted
I20260808 11:33:34.145187 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 6306
I20260808 11:33:34.145460 6207 catalog_manager.cc:4841] TS f3667ef44bdc42f3bc4eb8b454a535e2 (127.26.66.129:42475): tablet 5cdb595f881f41eeaf0ab17414f49d5f (table test-table [id=79eb4ff5312c418f9690bd9311861f29]) successfully deleted
I20260808 11:33:34.167344 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 6445
Aug 08 11:33:34 dist-test-slave-zkpd krb5kdc[5712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188809, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.130@KRBTEST.COM
I20260808 11:33:34.187446 6744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:33:34.168671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33000 (local address 127.26.66.130:46785)
0808 11:33:34.168853 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 11:33:34.168860 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:33:34.168880 (+ 20us) server_negotiation.cc:407] Connection header received
0808 11:33:34.168947 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:33:34.168953 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:33:34.169044 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:33:34.169152 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:33:34.171479 (+ 2327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:34.172581 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:34.175281 (+ 2700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:34.175681 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:34.175802 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:33:34.181027 (+ 5225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:33:34.181046 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:33:34.181062 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:33:34.181093 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:33:34.184308 (+ 3215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:33:34.185101 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:33:34.185109 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:33:34.185111 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:33:34.185238 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:33:34.185632 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:33:34.185635 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:33:34.185637 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:33:34.186114 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:33:34.186342 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0808 11:33:34.186798 (+ 456us) server_negotiation.cc:299] Negotiation successful
0808 11:33:34.187041 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 11:33:34.188202 6582 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:33:34.279870 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 6445
I20260808 11:33:34.303095 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 6593
Aug 08 11:33:34 dist-test-slave-zkpd krb5kdc[5712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188809, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.131@KRBTEST.COM
I20260808 11:33:34.322329 6740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:33:34.303951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36220 (local address 127.26.66.131:35143)
0808 11:33:34.304151 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 11:33:34.304158 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:33:34.304378 (+ 220us) server_negotiation.cc:407] Connection header received
0808 11:33:34.304671 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:33:34.304675 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:33:34.304788 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:33:34.304875 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:33:34.306806 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:34.307565 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:34.309543 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:33:34.310020 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:33:34.310129 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:33:34.315781 (+ 5652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:33:34.315792 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:33:34.315807 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:33:34.315847 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:33:34.319333 (+ 3486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:33:34.320040 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:33:34.320051 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:33:34.320053 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:33:34.320201 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:33:34.320649 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:33:34.320664 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:33:34.320666 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:33:34.321028 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:33:34.321357 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0808 11:33:34.321711 (+ 354us) server_negotiation.cc:299] Negotiation successful
0808 11:33:34.321963 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 11:33:34.323043 6721 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:33:34.446310 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 6593
I20260808 11:33:34.469765 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 6187
I20260808 11:33:34.471058 6251 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:33:34.585821 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 6187
I20260808 11:33:34.611517 26890 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 11:33:34.956794 26890 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 11:33:34.957003 26890 mini_ranger.cc:66] Stopping Ranger...
I20260808 11:33:35.301635 26890 mini_ranger.cc:68] Stopped Ranger
2026-08-08 11:33:35.301 UTC [5743] LOG: received smart shutdown request
2026-08-08 11:33:35.305 UTC [5743] LOG: background worker "logical replication launcher" (PID 5753) exited with exit code 1
2026-08-08 11:33:35.305 UTC [5748] LOG: shutting down
2026-08-08 11:33:35.464 UTC [5743] LOG: database system is shut down
2026-08-08T11:33:35Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (49079 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:33:35 dist-test-slave-zkpd krb5kdc[6784](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:33:35 dist-test-slave-zkpd krb5kdc[6784](info): set up 2 sockets
Aug 08 11:33:35 dist-test-slave-zkpd krb5kdc[6784](info): commencing operation
krb5kdc: starting...
W20260808 11:33:36.761232 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.001s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:33:36 dist-test-slave-zkpd krb5kdc[6784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:33:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:33:36Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.26.66.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.26.66.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.26.66.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/rangeradmin_127.26.66.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.26.66.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/rangeradmin_127.26.66.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.26.66.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.26.66.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.26.66.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/rangerlookup_127.26.66.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.26.66.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/rangerlookup_127.26.66.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.66.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.26.66.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.66.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/HTTP_127.26.66.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.66.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/HTTP_127.26.66.148@KRBTEST.COM.keytab.
I20260808 11:33:37.157001 26890 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskmiEqRe/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/postgres -l logfile start
2026-08-08 11:33:39.570 UTC [6815] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 11:33:39.570 UTC [6815] LOG: listening on IPv4 address "127.26.66.148", port 54241
2026-08-08 11:33:39.574 UTC [6815] LOG: listening on Unix socket "/tmp/.s.PGSQL.54241"
2026-08-08 11:33:39.597 UTC [6817] LOG: database system was shut down at 2026-08-08 11:33:38 UTC
2026-08-08 11:33:39.601 UTC [6815] LOG: database system is ready to accept connections
I20260808 11:33:40.613986 26890 mini_postgres.cc:96] Postgres bound to 54241
2026-08-08 11:33:40.639 UTC [6826] FATAL: database "slave" does not exist
127.26.66.148:54241 - accepting connections
I20260808 11:33:40.640368 26890 mini_ranger.cc:161] Starting Ranger...
I20260808 11:33:40.672394 26890 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 11:33:41.155205 26890 mini_ranger.cc:87] Created ranger Postgres database
I20260808 11:33:41.155339 26890 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ranger-admin
2026-08-08 11:33:41,461 [I] DB FLAVOR :POSTGRES
2026-08-08 11:33:41,461 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 11:33:41,461 [I] Checking connection..
2026-08-08 11:33:41,461 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:54241/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 11:33:41,728 [I] Checking connection passed.
2026-08-08 11:33:41,728 [I] --------- Verifying version history table ---------
2026-08-08 11:33:41,728 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:54241/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 11:33:41,991 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 11:33:41,992 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:54241/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 11:33:42,224 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 11:33:42,225 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 11:33:42,225 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:54241/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 11:33:42.460 UTC [6894] WARNING: there is no transaction in progress
2026-08-08 11:33:42,467 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 11:33:42,467 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:54241/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 11:33:42,719 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 11:33:42,719 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 11:33:42,719 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:54241/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 11:33:42,977 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:54241/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 11:33:43,223 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:54241/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-zkpd.c.gcp-upstream.internal','N') ;"
2026-08-08 11:33:43,467 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:54241/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 11:33:43,734 [I] Table x_portal_user does not exist in database ranger
2026-08-08 11:33:43,735 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:54241/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 11:33:43,997 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 11:33:43,998 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:54241/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 11:33:44,248 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:54241/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 11:33:44,501 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 11:33:44,501 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:54241/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 11:33:45.424 UTC [7007] WARNING: there is no transaction in progress
2026-08-08 11:33:45.439 UTC [7007] WARNING: there is no transaction in progress
2026-08-08 11:33:45.457 UTC [7007] WARNING: there is no transaction in progress
2026-08-08 11:33:45.474 UTC [7007] WARNING: there is no transaction in progress
2026-08-08 11:33:45.489 UTC [7007] WARNING: there is no transaction in progress
2026-08-08 11:33:45.509 UTC [7007] WARNING: there is no transaction in progress
2026-08-08 11:33:45.561 UTC [7007] WARNING: there is no transaction in progress
2026-08-08 11:33:45.568 UTC [7007] WARNING: there is no transaction in progress
2026-08-08 11:33:45.582 UTC [7007] WARNING: there is no transaction in progress
2026-08-08 11:33:45.592 UTC [7007] WARNING: there is no transaction in progress
2026-08-08 11:33:45.603 UTC [7007] WARNING: there is no transaction in progress
2026-08-08 11:33:45.616 UTC [7007] WARNING: there is no transaction in progress
2026-08-08 11:33:45.625 UTC [7007] WARNING: there is no transaction in progress
2026-08-08 11:33:45.631 UTC [7007] WARNING: there is no transaction in progress
2026-08-08 11:33:45.637 UTC [7007] WARNING: there is no transaction in progress
2026-08-08 11:33:45.643 UTC [7007] WARNING: there is no transaction in progress
2026-08-08 11:33:46,220 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 11:33:46,220 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:54241/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 11:33:46,455 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 11:33:46,456 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:54241/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 11:33:46,700 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 11:33:46,700 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:54241/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 11:33:46,967 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 11:33:46,967 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:54241/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 11:33:47,227 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:54241/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 11:33:47,468 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:54241/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-zkpd.c.gcp-upstream.internal';"
2026-08-08 11:33:47,709 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 11:33:47,710 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:54241/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 11:33:47,973 [I] DB_PATCHES have already been applied
I20260808 11:33:47.979815 26890 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ranger-admin:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskmiEqRe/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 11:33:47.979952 26890 mini_ranger.cc:193] Using host: 127.26.66.148
I20260808 11:33:48.002733 26890 mini_ranger.cc:227] Ranger admin URL: http://127.26.66.148:34663
Aug 08, 2026 11:33:48 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 11:33:48 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 11:33:48 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 11:33:48 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 11:33:48 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 11:33:48 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 11:33:48 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 11:33:49.289238 26890 mini_ranger.cc:160] Time spent starting Ranger: real 8.649s user 0.008s sys 0.057s
Aug 08, 2026 11:34:08 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 11:34:08 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 11:34:08 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 11:34:08 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 11:34:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 11:34:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 11:34:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 11:34:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 11:34:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 11:34:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 11:34:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 11:34:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 11:34:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 11:34:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 11:34:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 11:34:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 11:34:08 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 11:34:09 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 11:34:10.221704 26890 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.26.66.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.26.66.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.26.66.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/rangerkms_127.26.66.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.26.66.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/rangerkms_127.26.66.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.66.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.26.66.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.66.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/HTTP_127.26.66.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.66.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/HTTP_127.26.66.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 11:34:10 dist-test-slave-zkpd krb5kdc[6784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188850, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 11:34:10.447132 26890 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 11:34:10.475405 26890 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 11:34:11.304678 26890 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 11:34:11.304809 26890 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ranger-kms
I20260808 11:34:11.304864 26890 mini_ranger_kms.cc:227] Using postgres at 127.26.66.148:54241
2026-08-08 11:34:11,686 [I] DB FLAVOR :POSTGRES
2026-08-08 11:34:11,686 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 11:34:11,687 [I] Checking connection
2026-08-08 11:34:11,687 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:54241/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 11:34:11,950 [I] connection success
2026-08-08 11:34:11,951 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 11:34:11,951 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 11:34:11,951 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:54241/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 11:34:12,202 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 11:34:12,202 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 11:34:12,203 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 11:34:12,203 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.66.148:54241/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 11:34:12,451 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 11:34:12.926671 26890 mini_ranger_kms.cc:310] Created kms service
I20260808 11:34:13.140970 26890 mini_ranger_kms.cc:326] Created kudu user
I20260808 11:34:13.188521 26890 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 11:34:13 dist-test-slave-zkpd krb5kdc[6784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188850, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.26.66.148@KRBTEST.COM
I20260808 11:34:13.599079 26890 mini_ranger_kms.cc:384] Added ranger policy
I20260808 11:34:13.599428 26890 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ranger-kms:/tmp/dist-test-taskmiEqRe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskmiEqRe/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 11:34:13.599485 26890 mini_ranger_kms.cc:240] Using host: 127.26.66.148
I20260808 11:34:13.628674 26890 mini_ranger_kms.cc:276] Ranger KMS PID: 7196
I20260808 11:34:13.628827 26890 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.26.66.148:51621
Aug 08, 2026 11:34:14 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 11:34:14 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 11:34:14 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 11:34:14 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 11:34:14 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 11:34:14 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 11:34:15 dist-test-slave-zkpd krb5kdc[6784](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786188855, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.66.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:34:16.018788 26890 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.572s user 0.093s sys 0.327s
I20260808 11:34:16.019058 26890 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 11:34:16.019248 26890 mini_ranger_kms.cc:401] 127.26.66.148:51621/kms/v1/keys
Aug 08 11:34:16 dist-test-slave-zkpd krb5kdc[6784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188855, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.66.148@KRBTEST.COM for HTTP/127.26.66.148@KRBTEST.COM
Aug 08 11:34:16 dist-test-slave-zkpd krb5kdc[6784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188855, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.66.148@KRBTEST.COM for HTTP/127.26.66.148@KRBTEST.COM
Aug 08 11:34:18 dist-test-slave-zkpd krb5kdc[6784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188858, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:34:19.039440 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:45939
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:45613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:45939
--ranger_config_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.66.148:51621/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:34:19.400568 7249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:34:19.400907 7249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:34:19.401063 7249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:34:19.408618 7249 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:34:19.408764 7249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:34:19.408864 7249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:34:19.408967 7249 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:34:19.409049 7249 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:34:19.419587 7249 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/wal
--ranger_kms_url=127.26.66.148:51621/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:45939
--ranger_config_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:45939
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:34:19.420871 7249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:34:19.422178 7249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:34:19.434247 7257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:19.434291 7255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:19.434338 7254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:19.434932 7249 server_base.cc:1034] running on GCE node
I20260808 11:34:19.435652 7249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:34:19.437048 7249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:34:19.438247 7249 hybrid_clock.cc:648] HybridClock initialized: now 1786188859438212 us; error 43 us; skew 500 ppm
I20260808 11:34:19.438611 7249 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:34:19 dist-test-slave-zkpd krb5kdc[6784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188859, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:34:19.441779 7249 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:34:19.443288 7249 webserver.cc:460] Webserver started at http://127.26.66.190:41569/ using document root <none> and password file <none>
I20260808 11:34:19.444010 7249 fs_manager.cc:359] Metadata directory not provided
I20260808 11:34:19.444159 7249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:34:19.444482 7249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 11:34:19 dist-test-slave-zkpd krb5kdc[6784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188859, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for HTTP/127.26.66.148@KRBTEST.COM
I20260808 11:34:19.511499 7249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "2df8f423c5424fd7b3d9496ad0b9b274"
format_stamp: "Formatted at 2026-08-08 11:34:19 on dist-test-slave-zkpd"
server_key: "0fb79e8d7f345b6eed8321081b6206c2"
server_key_iv: "359f9f60ddeaf56ad586d45652f88df3"
server_key_version: "kuduclusterkey@0"
I20260808 11:34:19.512627 7249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "2df8f423c5424fd7b3d9496ad0b9b274"
format_stamp: "Formatted at 2026-08-08 11:34:19 on dist-test-slave-zkpd"
server_key: "0fb79e8d7f345b6eed8321081b6206c2"
server_key_iv: "359f9f60ddeaf56ad586d45652f88df3"
server_key_version: "kuduclusterkey@0"
I20260808 11:34:19.519734 7249 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260808 11:34:19.544471 7264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:19.546334 7249 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.005s sys 0.003s
I20260808 11:34:19.546551 7249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "2df8f423c5424fd7b3d9496ad0b9b274"
format_stamp: "Formatted at 2026-08-08 11:34:19 on dist-test-slave-zkpd"
server_key: "0fb79e8d7f345b6eed8321081b6206c2"
server_key_iv: "359f9f60ddeaf56ad586d45652f88df3"
server_key_version: "kuduclusterkey@0"
I20260808 11:34:19.546842 7249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:34:19.566497 7249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:34:19.571424 7249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:34:19.571758 7249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:34:19.592350 7249 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:45939
I20260808 11:34:19.592408 7316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:45939 every 8 connection(s)
I20260808 11:34:19.594105 7249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:34:19.598032 7317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:34:19.602869 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 7249
I20260808 11:34:19.603088 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:34:19.604017 26890 external_mini_cluster.cc:1428] Setting key 259db4a7551e7144c7a90b2231482ce8
I20260808 11:34:19.612341 7317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274: Bootstrap starting.
I20260808 11:34:19.618379 7317 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274: Neither blocks nor log segments found. Creating new log.
I20260808 11:34:19.620199 7317 log.cc:824] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274: Log is configured to *not* fsync() on all Append() calls
I20260808 11:34:19.623755 7317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274: No bootstrap required, opened a new log
Aug 08 11:34:19 dist-test-slave-zkpd krb5kdc[6784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188858, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:34:19.634917 7317 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2df8f423c5424fd7b3d9496ad0b9b274" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45939 } }
I20260808 11:34:19.635300 7317 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:34:19.635402 7317 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df8f423c5424fd7b3d9496ad0b9b274, State: Initialized, Role: FOLLOWER
I20260808 11:34:19.636372 7317 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2df8f423c5424fd7b3d9496ad0b9b274" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45939 } }
I20260808 11:34:19.636718 7317 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:34:19.636842 7322 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:34:19.637104 7322 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2df8f423c5424fd7b3d9496ad0b9b274" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45939 } }
I20260808 11:34:19.637643 7317 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:34:19.637811 7317 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:34:19.637693 7322 leader_election.cc:302] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2df8f423c5424fd7b3d9496ad0b9b274; no voters:
I20260808 11:34:19.638654 7322 leader_election.cc:288] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers
I20260808 11:34:19.640583 7317 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2df8f423c5424fd7b3d9496ad0b9b274" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45939 } }
I20260808 11:34:19.640867 7317 leader_election.cc:302] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2df8f423c5424fd7b3d9496ad0b9b274; no voters:
I20260808 11:34:19.640901 7323 raft_consensus.cc:2741] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260808 11:34:19.641125 7317 leader_election.cc:288] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:34:19.642611 7322 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:34:19.642881 7322 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [term 1 LEADER]: Becoming Leader. State: Replica: 2df8f423c5424fd7b3d9496ad0b9b274, State: Running, Role: LEADER
I20260808 11:34:19.643453 7317 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:34:19.643637 7322 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2df8f423c5424fd7b3d9496ad0b9b274" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45939 } }
I20260808 11:34:19.644876 7320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:19.606174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36992 (local address 127.26.66.190:45939)
0808 11:34:19.621117 (+ 14943us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:19.621134 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:19.621188 (+ 54us) server_negotiation.cc:407] Connection header received
0808 11:34:19.623828 (+ 2640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:19.623858 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:19.624406 (+ 548us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:19.624871 (+ 465us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:19.626614 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:19.628910 (+ 2296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:19.630828 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:19.631515 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:19.631656 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:19.636347 (+ 4691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:19.636355 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:19.636373 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:19.636408 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:19.639983 (+ 3575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:19.640656 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:19.640664 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:19.640671 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:19.640909 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:19.641455 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:19.641463 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:19.641468 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:19.642173 (+ 705us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:19.642529 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:19.642960 (+ 431us) server_negotiation.cc:299] Negotiation successful
0808 11:34:19.643351 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14693,"thread_start_us":14431,"threads_started":1}
I20260808 11:34:19.650163 7324 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2df8f423c5424fd7b3d9496ad0b9b274" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2df8f423c5424fd7b3d9496ad0b9b274" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45939 } } }
I20260808 11:34:19.650115 7323 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2df8f423c5424fd7b3d9496ad0b9b274. Latest consensus state: current_term: 1 leader_uuid: "2df8f423c5424fd7b3d9496ad0b9b274" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2df8f423c5424fd7b3d9496ad0b9b274" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45939 } } }
I20260808 11:34:19.650583 7324 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [sys.catalog]: This master's current role is: LEADER
I20260808 11:34:19.650590 7323 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [sys.catalog]: This master's current role is: LEADER
I20260808 11:34:19.651482 7332 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:34:19.667276 7332 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:34:19.668119 7317 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 11:34:19.686594 7332 catalog_manager.cc:1347] Generated new cluster ID: 7fb83346da67488680b63df16ba0aa80
I20260808 11:34:19.686748 7332 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:34:19.712941 7332 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:34:19.715145 7332 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:34:19.727488 7332 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274: Generated new TSK 0
I20260808 11:34:19.728636 7332 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.66.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
I20260808 11:34:20.491822 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.66.148:51621/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:0
--local_ip_for_outbound_sockets=127.26.66.129
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45939
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:45613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 11:34:20 dist-test-slave-zkpd krb5kdc[6784](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786188860, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 11:34:20.935742 7362 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:34:20.936269 7362 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:34:20.936478 7362 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:34:20.948279 7362 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:34:20.948421 7362 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:34:20.948684 7362 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:34:20.964530 7362 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.26.66.148:51621/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45939
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:34:20.966523 7362 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:34:20.968304 7362 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:34:20.984679 7373 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:20.985571 7374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:20.986001 7362 server_base.cc:1034] running on GCE node
W20260808 11:34:20.986049 7376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:20.986877 7362 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:34:20.988097 7362 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:34:20.989391 7362 hybrid_clock.cc:648] HybridClock initialized: now 1786188860989337 us; error 47 us; skew 500 ppm
I20260808 11:34:20.989800 7362 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:34:21 dist-test-slave-zkpd krb5kdc[6784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188861, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:34:21.007334 7362 init.cc:377] Logged in from keytab as kudu/127.26.66.129@KRBTEST.COM (short username kudu)
I20260808 11:34:21.015282 7362 webserver.cc:460] Webserver started at http://127.26.66.129:35343/ using document root <none> and password file <none>
I20260808 11:34:21.016393 7362 fs_manager.cc:359] Metadata directory not provided
I20260808 11:34:21.016607 7362 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:34:21.017060 7362 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 11:34:21 dist-test-slave-zkpd krb5kdc[6784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188861, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for HTTP/127.26.66.148@KRBTEST.COM
I20260808 11:34:21.045773 7362 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/data/instance:
uuid: "86754aeedb784497b0d3c349f79c802e"
format_stamp: "Formatted at 2026-08-08 11:34:21 on dist-test-slave-zkpd"
server_key: "3f32f3408ef817edffd1a73ce85bf236"
server_key_iv: "068197d56705d5d7ef48ea99f79a845b"
server_key_version: "kuduclusterkey@0"
I20260808 11:34:21.046984 7362 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance:
uuid: "86754aeedb784497b0d3c349f79c802e"
format_stamp: "Formatted at 2026-08-08 11:34:21 on dist-test-slave-zkpd"
server_key: "3f32f3408ef817edffd1a73ce85bf236"
server_key_iv: "068197d56705d5d7ef48ea99f79a845b"
server_key_version: "kuduclusterkey@0"
I20260808 11:34:21.066174 7362 fs_manager.cc:691] Time spent creating directory manager: real 0.019s user 0.010s sys 0.007s
I20260808 11:34:21.111690 7383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:21.115525 7362 fs_manager.cc:725] Time spent opening block manager: real 0.023s user 0.006s sys 0.013s
I20260808 11:34:21.115866 7362 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "86754aeedb784497b0d3c349f79c802e"
format_stamp: "Formatted at 2026-08-08 11:34:21 on dist-test-slave-zkpd"
server_key: "3f32f3408ef817edffd1a73ce85bf236"
server_key_iv: "068197d56705d5d7ef48ea99f79a845b"
server_key_version: "kuduclusterkey@0"
I20260808 11:34:21.116286 7362 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:34:21.192723 7362 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:34:21.198107 7362 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:34:21.198563 7362 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:34:21.207894 7362 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:34:21.209800 7362 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:34:21.209918 7362 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:21.210098 7362 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:34:21.210191 7362 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 11:34:21 dist-test-slave-zkpd krb5kdc[6784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188860, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for HTTP/127.26.66.148@KRBTEST.COM
I20260808 11:34:21.353269 7362 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:41813
I20260808 11:34:21.353281 7501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:41813 every 8 connection(s)
I20260808 11:34:21.354962 7362 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:34:21.364166 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 7362
I20260808 11:34:21.364413 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance
I20260808 11:34:21.365232 26890 external_mini_cluster.cc:1428] Setting key 1518d96aa4d23dc7d5fb8d16c271d81c
Aug 08 11:34:21 dist-test-slave-zkpd krb5kdc[6784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188861, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:34:21.381783 7504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:21.357675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:52451 (local address 127.26.66.190:45939)
0808 11:34:21.358203 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:21.358210 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:21.359225 (+ 1015us) server_negotiation.cc:407] Connection header received
0808 11:34:21.361736 (+ 2511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:21.361740 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:21.361816 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:21.361914 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:21.364129 (+ 2215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:21.365321 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:21.367876 (+ 2555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:21.368625 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:21.368768 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:21.373665 (+ 4897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:21.373675 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:21.373680 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:21.373750 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:21.377702 (+ 3952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:21.378720 (+ 1018us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:21.378728 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:21.378734 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:21.378913 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:21.379459 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:21.379466 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:21.379472 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:21.379869 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:21.380029 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:21.381038 (+ 1009us) server_negotiation.cc:299] Negotiation successful
0808 11:34:21.381299 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":256,"threads_started":1}
I20260808 11:34:21.384200 7505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:21.358236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45939 (local address 127.26.66.129:52451)
0808 11:34:21.359030 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:21.359091 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:21.361425 (+ 2334us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:21.362237 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:21.362250 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:21.362982 (+ 732us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:34:21.363875 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:21.363933 (+ 58us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:21.365488 (+ 1555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:21.365496 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:21.367713 (+ 2217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:21.367727 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:21.369103 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:21.369114 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:21.369445 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:21.370289 (+ 844us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:34:21.370323 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:34:21.373366 (+ 3043us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:34:21.377909 (+ 4543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:21.377920 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:21.377941 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:21.378578 (+ 637us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:21.379064 (+ 486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:21.379071 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:21.379078 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:21.379326 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:21.380124 (+ 798us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:34:21.380134 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:34:21.380590 (+ 456us) client_negotiation.cc:769] Sending connection context
0808 11:34:21.382393 (+ 1803us) client_negotiation.cc:240] Negotiation successful
0808 11:34:21.382987 (+ 594us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":293,"threads_started":1}
I20260808 11:34:21.386186 7502 heartbeater.cc:347] Connected to a master server at 127.26.66.190:45939
I20260808 11:34:21.386492 7502 heartbeater.cc:464] Registering TS with master...
I20260808 11:34:21.387406 7502 heartbeater.cc:511] Master 127.26.66.190:45939 requested a full tablet report, sending...
I20260808 11:34:21.389952 7281 ts_manager.cc:194] Registered new tserver with Master: 86754aeedb784497b0d3c349f79c802e (127.26.66.129:41813)
I20260808 11:34:21.392139 7281 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.129@KRBTEST.COM'} at 127.26.66.129:52451
WARNING: no policy specified for kudu/127.26.66.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
I20260808 11:34:21.449437 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.66.148:51621/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:0
--local_ip_for_outbound_sockets=127.26.66.130
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45939
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:45613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 11:34:21 dist-test-slave-zkpd krb5kdc[6784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188860, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for HTTP/127.26.66.148@KRBTEST.COM
W20260808 11:34:21.924806 7509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:34:21.925096 7509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:34:21.925246 7509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:34:21.932747 7509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:34:21.932854 7509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:34:21.933051 7509 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:34:21.942834 7509 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.26.66.148:51621/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45939
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:34:21.944263 7509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:34:21.945693 7509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:34:21.960656 7525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:21.961042 7527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:21.961118 7524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:21.961757 7509 server_base.cc:1034] running on GCE node
I20260808 11:34:21.962432 7509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:34:21.963569 7509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:34:21.964775 7509 hybrid_clock.cc:648] HybridClock initialized: now 1786188861964670 us; error 53 us; skew 500 ppm
I20260808 11:34:21.965191 7509 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:34:21 dist-test-slave-zkpd krb5kdc[6784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188861, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:34:21.968470 7509 init.cc:377] Logged in from keytab as kudu/127.26.66.130@KRBTEST.COM (short username kudu)
I20260808 11:34:21.970032 7509 webserver.cc:460] Webserver started at http://127.26.66.130:42455/ using document root <none> and password file <none>
I20260808 11:34:21.970736 7509 fs_manager.cc:359] Metadata directory not provided
I20260808 11:34:21.970885 7509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:34:21.971203 7509 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 11:34:21 dist-test-slave-zkpd krb5kdc[6784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188861, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for HTTP/127.26.66.148@KRBTEST.COM
I20260808 11:34:21.990602 7509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/data/instance:
uuid: "1544eedf181447ad90af00ba2e567206"
format_stamp: "Formatted at 2026-08-08 11:34:21 on dist-test-slave-zkpd"
server_key: "b815261af90a9458afcd647bd37467e0"
server_key_iv: "b9f27b3aa60344d999cbeec0a5c31b4e"
server_key_version: "kuduclusterkey@0"
I20260808 11:34:21.991665 7509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance:
uuid: "1544eedf181447ad90af00ba2e567206"
format_stamp: "Formatted at 2026-08-08 11:34:21 on dist-test-slave-zkpd"
server_key: "b815261af90a9458afcd647bd37467e0"
server_key_iv: "b9f27b3aa60344d999cbeec0a5c31b4e"
server_key_version: "kuduclusterkey@0"
I20260808 11:34:21.998708 7509 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260808 11:34:22.018450 7534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:22.020510 7509 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 11:34:22.020699 7509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "1544eedf181447ad90af00ba2e567206"
format_stamp: "Formatted at 2026-08-08 11:34:21 on dist-test-slave-zkpd"
server_key: "b815261af90a9458afcd647bd37467e0"
server_key_iv: "b9f27b3aa60344d999cbeec0a5c31b4e"
server_key_version: "kuduclusterkey@0"
I20260808 11:34:22.020984 7509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:34:22.060030 7509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:34:22.065505 7509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:34:22.065864 7509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:34:22.067167 7509 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:34:22.069103 7509 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:34:22.069203 7509 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:22.069345 7509 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:34:22.069419 7509 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:22.114979 7509 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:42693
I20260808 11:34:22.115020 7649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:42693 every 8 connection(s)
I20260808 11:34:22.116662 7509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:34:22.117928 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 7509
I20260808 11:34:22.118095 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance
I20260808 11:34:22.118832 26890 external_mini_cluster.cc:1428] Setting key 923f0c30d320be7285e74e51f95e4dca
Aug 08 11:34:22 dist-test-slave-zkpd krb5kdc[6784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188861, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:34:22.161782 7653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:22.123018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45939 (local address 127.26.66.130:50953)
0808 11:34:22.136683 (+ 13665us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:22.136751 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:22.140059 (+ 3308us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:22.141512 (+ 1453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:22.141526 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:22.142135 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:34:22.142951 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:22.142976 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:22.145089 (+ 2113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:22.145095 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:22.147118 (+ 2023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:22.147134 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:22.148344 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:22.148350 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:22.148643 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:22.149545 (+ 902us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:34:22.149574 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:34:22.152575 (+ 3001us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:34:22.156857 (+ 4282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:22.156865 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:22.156882 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:22.157424 (+ 542us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:22.157894 (+ 470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:22.157899 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:22.157902 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:22.158174 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:22.158912 (+ 738us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:34:22.158920 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:34:22.159333 (+ 413us) client_negotiation.cc:769] Sending connection context
0808 11:34:22.159637 (+ 304us) client_negotiation.cc:240] Negotiation successful
0808 11:34:22.160372 (+ 735us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13244,"thread_start_us":12947,"threads_started":1}
I20260808 11:34:22.162868 7652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:22.122072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:50953 (local address 127.26.66.190:45939)
0808 11:34:22.140934 (+ 18862us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:22.140938 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:22.140955 (+ 17us) server_negotiation.cc:407] Connection header received
0808 11:34:22.141019 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:22.141023 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:22.141083 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:22.141227 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:22.143740 (+ 2513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:22.144904 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:22.147295 (+ 2391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:22.147876 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:22.148032 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:22.152945 (+ 4913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:22.152952 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:22.152956 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:22.152997 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:22.156648 (+ 3651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:22.157571 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:22.157576 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:22.157579 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:22.157745 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:22.158315 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:22.158320 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:22.158323 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:22.158683 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:22.158827 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:22.162302 (+ 3475us) server_negotiation.cc:299] Negotiation successful
0808 11:34:22.162532 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18735,"thread_start_us":18589,"threads_started":1}
I20260808 11:34:22.164841 7650 heartbeater.cc:347] Connected to a master server at 127.26.66.190:45939
I20260808 11:34:22.165184 7650 heartbeater.cc:464] Registering TS with master...
I20260808 11:34:22.166119 7650 heartbeater.cc:511] Master 127.26.66.190:45939 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.26.66.131@KRBTEST.COM; defaulting to no policy
I20260808 11:34:22.167900 7281 ts_manager.cc:194] Registered new tserver with Master: 1544eedf181447ad90af00ba2e567206 (127.26.66.130:42693)
I20260808 11:34:22.168835 7281 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.130@KRBTEST.COM'} at 127.26.66.130:50953
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
I20260808 11:34:22.205216 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.66.148:51621/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:0
--local_ip_for_outbound_sockets=127.26.66.131
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45939
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:45613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 11:34:22.395994 7502 heartbeater.cc:503] Master 127.26.66.190:45939 was elected leader, sending a full tablet report...
W20260808 11:34:22.545558 7656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:34:22.545856 7656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:34:22.546027 7656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:34:22.553442 7656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:34:22.553581 7656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:34:22.553761 7656 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:34:22.563364 7656 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.26.66.148:51621/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45939
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:34:22.564626 7656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:34:22.565887 7656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:34:22.578680 7661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:22.578727 7662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:22.578905 7664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:22.579375 7656 server_base.cc:1034] running on GCE node
I20260808 11:34:22.580036 7656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:34:22.580983 7656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:34:22.582206 7656 hybrid_clock.cc:648] HybridClock initialized: now 1786188862582173 us; error 41 us; skew 500 ppm
I20260808 11:34:22.582547 7656 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:34:22 dist-test-slave-zkpd krb5kdc[6784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188862, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:34:22.585635 7656 init.cc:377] Logged in from keytab as kudu/127.26.66.131@KRBTEST.COM (short username kudu)
I20260808 11:34:22.586941 7656 webserver.cc:460] Webserver started at http://127.26.66.131:44139/ using document root <none> and password file <none>
I20260808 11:34:22.587623 7656 fs_manager.cc:359] Metadata directory not provided
I20260808 11:34:22.587787 7656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:34:22.588153 7656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 11:34:22 dist-test-slave-zkpd krb5kdc[6784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188862, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for HTTP/127.26.66.148@KRBTEST.COM
I20260808 11:34:22.604485 7656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/data/instance:
uuid: "a8250d0067644d9cab8f8f2bdf509feb"
format_stamp: "Formatted at 2026-08-08 11:34:22 on dist-test-slave-zkpd"
server_key: "f453357a0e8864559bd2cfa1a0807335"
server_key_iv: "bb316ec134c97a0cbd50fd3a427ca943"
server_key_version: "kuduclusterkey@0"
I20260808 11:34:22.605381 7656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance:
uuid: "a8250d0067644d9cab8f8f2bdf509feb"
format_stamp: "Formatted at 2026-08-08 11:34:22 on dist-test-slave-zkpd"
server_key: "f453357a0e8864559bd2cfa1a0807335"
server_key_iv: "bb316ec134c97a0cbd50fd3a427ca943"
server_key_version: "kuduclusterkey@0"
I20260808 11:34:22.610954 7656 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260808 11:34:22.628690 7671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:22.630306 7656 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:34:22.630447 7656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "a8250d0067644d9cab8f8f2bdf509feb"
format_stamp: "Formatted at 2026-08-08 11:34:22 on dist-test-slave-zkpd"
server_key: "f453357a0e8864559bd2cfa1a0807335"
server_key_iv: "bb316ec134c97a0cbd50fd3a427ca943"
server_key_version: "kuduclusterkey@0"
I20260808 11:34:22.630633 7656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:34:22.661661 7656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:34:22.665741 7656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:34:22.666044 7656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:34:22.666968 7656 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:34:22.668473 7656 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:34:22.668550 7656 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:22.668684 7656 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:34:22.668740 7656 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:22.700307 7656 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:40619
I20260808 11:34:22.700346 7785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:40619 every 8 connection(s)
I20260808 11:34:22.701622 7656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:34:22.705564 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 7656
I20260808 11:34:22.705754 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance
I20260808 11:34:22.706403 26890 external_mini_cluster.cc:1428] Setting key de791f5024a24e7fb1f8e58b8aaa591f
Aug 08 11:34:22 dist-test-slave-zkpd krb5kdc[6784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188862, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:34:22.722344 7789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:22.704343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:53539 (local address 127.26.66.190:45939)
0808 11:34:22.704958 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:22.704965 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:22.706037 (+ 1072us) server_negotiation.cc:407] Connection header received
0808 11:34:22.708232 (+ 2195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:22.708237 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:22.708333 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:22.708451 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:22.710117 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:22.710830 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:22.712458 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:22.712878 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:22.713014 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:22.716321 (+ 3307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:22.716326 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:22.716330 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:22.716360 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:22.718885 (+ 2525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:22.719591 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:22.719602 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:22.719604 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:22.719731 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:22.720307 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:22.720323 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:22.720325 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:22.720649 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:22.720808 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:22.721729 (+ 921us) server_negotiation.cc:299] Negotiation successful
0808 11:34:22.721970 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":278,"threads_started":1}
I20260808 11:34:22.723387 7790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:22.704963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45939 (local address 127.26.66.131:53539)
0808 11:34:22.705865 (+ 902us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:22.705917 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:22.707974 (+ 2057us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:22.708725 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:22.708739 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:22.709326 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:34:22.709947 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:22.709966 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:22.710999 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:22.711003 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:22.712312 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:22.712326 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:22.713115 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:22.713124 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:22.713361 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:22.714034 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:34:22.714056 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:34:22.716103 (+ 2047us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:34:22.719024 (+ 2921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:22.719032 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:22.719047 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:22.719458 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:22.719854 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:22.719859 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:22.719863 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:22.720178 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:22.720823 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:34:22.720835 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:34:22.721258 (+ 423us) client_negotiation.cc:769] Sending connection context
0808 11:34:22.721609 (+ 351us) client_negotiation.cc:240] Negotiation successful
0808 11:34:22.722092 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":385,"threads_started":1}
I20260808 11:34:22.724774 7786 heartbeater.cc:347] Connected to a master server at 127.26.66.190:45939
I20260808 11:34:22.725090 7786 heartbeater.cc:464] Registering TS with master...
I20260808 11:34:22.725826 7786 heartbeater.cc:511] Master 127.26.66.190:45939 requested a full tablet report, sending...
I20260808 11:34:22.727339 7281 ts_manager.cc:194] Registered new tserver with Master: a8250d0067644d9cab8f8f2bdf509feb (127.26.66.131:40619)
I20260808 11:34:22.728283 7281 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.131@KRBTEST.COM'} at 127.26.66.131:53539
I20260808 11:34:22.734493 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 11:34:22.736307 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 7362
Aug 08 11:34:22 dist-test-slave-zkpd krb5kdc[6784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188858, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.129@KRBTEST.COM
I20260808 11:34:22.752735 7792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:22.737110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37238 (local address 127.26.66.129:41813)
0808 11:34:22.737693 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:22.737699 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:22.737724 (+ 25us) server_negotiation.cc:407] Connection header received
0808 11:34:22.737783 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:22.737789 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:22.737994 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:22.738115 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:22.739559 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:22.740617 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:22.742091 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:22.742733 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:22.742852 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:22.747127 (+ 4275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:22.747137 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:22.747149 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:22.747180 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:22.750025 (+ 2845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:22.750682 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:22.750688 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:22.750690 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:22.750839 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:22.751183 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:22.751188 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:22.751190 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:22.751513 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:22.751771 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:22.752082 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 11:34:22.752391 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":285,"threads_started":1}
I20260808 11:34:22.753976 7496 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:34:22.836946 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 7362
I20260808 11:34:22.856045 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 7509
Aug 08 11:34:22 dist-test-slave-zkpd krb5kdc[6784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188858, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.130@KRBTEST.COM
I20260808 11:34:22.872025 7794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:22.856955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35220 (local address 127.26.66.130:42693)
0808 11:34:22.857534 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:22.857542 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:22.857567 (+ 25us) server_negotiation.cc:407] Connection header received
0808 11:34:22.857629 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:22.857636 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:22.857850 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:22.857979 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:22.859132 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:22.860192 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:22.861587 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:22.862130 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:22.862226 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:22.866554 (+ 4328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:22.866567 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:22.866580 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:22.866623 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:22.869520 (+ 2897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:22.870186 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:22.870193 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:22.870196 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:22.870324 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:22.870635 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:22.870638 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:22.870640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:22.870974 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:22.871232 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:22.871472 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 11:34:22.871669 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":306,"threads_started":1}
I20260808 11:34:22.873261 7645 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:34:22.955118 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 7509
I20260808 11:34:22.974033 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 7656
Aug 08 11:34:22 dist-test-slave-zkpd krb5kdc[6784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188858, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.131@KRBTEST.COM
I20260808 11:34:22.991216 7796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:22.975051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47294 (local address 127.26.66.131:40619)
0808 11:34:22.975686 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:22.975693 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:22.975723 (+ 30us) server_negotiation.cc:407] Connection header received
0808 11:34:22.975785 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:22.975793 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:22.976079 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:22.976254 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:22.977585 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:22.978601 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:22.980108 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:22.980772 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:22.980916 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:22.985456 (+ 4540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:22.985467 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:22.985480 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:22.985516 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:22.988322 (+ 2806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:22.989001 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:22.989009 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:22.989011 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:22.989206 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:22.989576 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:22.989582 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:22.989585 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:22.989926 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:22.990262 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:22.990578 (+ 316us) server_negotiation.cc:299] Negotiation successful
0808 11:34:22.990858 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":491,"thread_start_us":314,"threads_started":1}
I20260808 11:34:22.992619 7781 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:34:23.076473 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 7656
I20260808 11:34:23.095103 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 7249
I20260808 11:34:23.096446 7312 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:34:23.204809 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 7249
I20260808 11:34:23.232350 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:45939
--webserver_interface=127.26.66.190
--webserver_port=41569
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:45613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:45939
--ranger_config_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.66.148:51621/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.66.148:51621/kms with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:34:23.575358 7799 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:34:23.575629 7799 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:34:23.575718 7799 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:34:23.582719 7799 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:34:23.582820 7799 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:34:23.582891 7799 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:34:23.582942 7799 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:34:23.582983 7799 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:34:23.592902 7799 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.66.148:51621/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:45939
--ranger_config_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:45939
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=41569
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:34:23.594179 7799 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:34:23.595463 7799 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:34:23.607328 7804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:23.607283 7807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:23.607362 7805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:23.608299 7799 server_base.cc:1034] running on GCE node
I20260808 11:34:23.609040 7799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:34:23.610441 7799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:34:23.611685 7799 hybrid_clock.cc:648] HybridClock initialized: now 1786188863611639 us; error 52 us; skew 500 ppm
I20260808 11:34:23.612104 7799 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:34:23 dist-test-slave-zkpd krb5kdc[6784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188863, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:34:23.615213 7799 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:34:23.616633 7799 webserver.cc:460] Webserver started at http://127.26.66.190:41569/ using document root <none> and password file <none>
I20260808 11:34:23.617228 7799 fs_manager.cc:359] Metadata directory not provided
I20260808 11:34:23.617333 7799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 11:34:23 dist-test-slave-zkpd krb5kdc[6784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188863, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for HTTP/127.26.66.148@KRBTEST.COM
I20260808 11:34:23.668000 7799 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.001s
I20260808 11:34:23.671689 7815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:23.673411 7799 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 11:34:23.673602 7799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "2df8f423c5424fd7b3d9496ad0b9b274"
format_stamp: "Formatted at 2026-08-08 11:34:19 on dist-test-slave-zkpd"
server_key: "0fb79e8d7f345b6eed8321081b6206c2"
server_key_iv: "359f9f60ddeaf56ad586d45652f88df3"
server_key_version: "kuduclusterkey@0"
I20260808 11:34:23.674979 7799 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:34:23.708926 7799 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:34:23.712503 7799 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:34:23.712747 7799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:34:23.731603 7799 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:45939
I20260808 11:34:23.731622 7870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:45939 every 8 connection(s)
I20260808 11:34:23.733161 7799 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:34:23.740033 7871 sys_catalog.cc:263] Verifying existing consensus state
I20260808 11:34:23.743428 7871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274: Bootstrap starting.
I20260808 11:34:23.743821 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 7799
I20260808 11:34:23.745023 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.66.148:51621/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:41813
--local_ip_for_outbound_sockets=127.26.66.129
--tserver_master_addrs=127.26.66.190:45939
--webserver_port=35343
--webserver_interface=127.26.66.129
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:45613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.66.148:51621/kms with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 11:34:23.766160 7871 log.cc:824] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274: Log is configured to *not* fsync() on all Append() calls
I20260808 11:34:23.775130 7871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 11:34:23.775677 7871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274: Bootstrap complete.
I20260808 11:34:23.785161 7871 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2df8f423c5424fd7b3d9496ad0b9b274" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45939 } }
I20260808 11:34:23.786060 7871 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df8f423c5424fd7b3d9496ad0b9b274, State: Initialized, Role: FOLLOWER
I20260808 11:34:23.786636 7871 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2df8f423c5424fd7b3d9496ad0b9b274" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45939 } }
I20260808 11:34:23.786898 7871 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:34:23.787029 7871 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:34:23.787207 7871 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [term 1 FOLLOWER]: Advancing to term 2
I20260808 11:34:23.791069 7871 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2df8f423c5424fd7b3d9496ad0b9b274" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45939 } }
I20260808 11:34:23.791548 7871 leader_election.cc:302] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2df8f423c5424fd7b3d9496ad0b9b274; no voters:
I20260808 11:34:23.792219 7871 leader_election.cc:288] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 11:34:23.792382 7875 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 11:34:23.793560 7875 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [term 2 LEADER]: Becoming Leader. State: Replica: 2df8f423c5424fd7b3d9496ad0b9b274, State: Running, Role: LEADER
I20260808 11:34:23.794160 7875 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2df8f423c5424fd7b3d9496ad0b9b274" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45939 } }
I20260808 11:34:23.794431 7871 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:34:23.796669 7877 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2df8f423c5424fd7b3d9496ad0b9b274. Latest consensus state: current_term: 2 leader_uuid: "2df8f423c5424fd7b3d9496ad0b9b274" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2df8f423c5424fd7b3d9496ad0b9b274" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45939 } } }
I20260808 11:34:23.797076 7877 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [sys.catalog]: This master's current role is: LEADER
I20260808 11:34:23.797709 7876 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "2df8f423c5424fd7b3d9496ad0b9b274" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2df8f423c5424fd7b3d9496ad0b9b274" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45939 } } }
I20260808 11:34:23.798002 7876 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274 [sys.catalog]: This master's current role is: LEADER
I20260808 11:34:23.808506 7881 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:34:23.815440 7881 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:34:23.816887 7881 catalog_manager.cc:1259] Loaded cluster ID: 7fb83346da67488680b63df16ba0aa80
I20260808 11:34:23.817049 7881 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:34:23.820987 7881 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:34:23.822436 7881 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274: Loaded TSK: 0
I20260808 11:34:23.824419 7881 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:34:23.829033 7871 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260808 11:34:24.203651 7873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:34:24.204232 7873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:34:24.204478 7873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:34:24.217362 7873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:34:24.217593 7873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:34:24.217885 7873 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:34:24.235394 7873 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.66.148:51621/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:41813
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=35343
--tserver_master_addrs=127.26.66.190:45939
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:34:24.237380 7873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:34:24.239395 7873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:34:24.262691 7908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:24.263834 7909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:24.268482 7873 server_base.cc:1034] running on GCE node
W20260808 11:34:24.268985 7912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:24.269949 7873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:34:24.272146 7873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:34:24.273718 7873 hybrid_clock.cc:648] HybridClock initialized: now 1786188864273642 us; error 40 us; skew 500 ppm
I20260808 11:34:24.274245 7873 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:34:24 dist-test-slave-zkpd krb5kdc[6784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188864, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:34:24.280233 7873 init.cc:377] Logged in from keytab as kudu/127.26.66.129@KRBTEST.COM (short username kudu)
I20260808 11:34:24.282939 7873 webserver.cc:460] Webserver started at http://127.26.66.129:35343/ using document root <none> and password file <none>
I20260808 11:34:24.284132 7873 fs_manager.cc:359] Metadata directory not provided
I20260808 11:34:24.284386 7873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 11:34:24 dist-test-slave-zkpd krb5kdc[6784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188864, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for HTTP/127.26.66.148@KRBTEST.COM
I20260808 11:34:24.316963 7873 fs_manager.cc:709] Time spent opening directory manager: real 0.008s user 0.006s sys 0.000s
I20260808 11:34:24.320849 7919 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:24.322764 7873 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 11:34:24.322971 7873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "86754aeedb784497b0d3c349f79c802e"
format_stamp: "Formatted at 2026-08-08 11:34:21 on dist-test-slave-zkpd"
server_key: "3f32f3408ef817edffd1a73ce85bf236"
server_key_iv: "068197d56705d5d7ef48ea99f79a845b"
server_key_version: "kuduclusterkey@0"
I20260808 11:34:24.324506 7873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:34:24.359779 7873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:34:24.365458 7873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:34:24.365834 7873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:34:24.367547 7873 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:34:24.376685 7873 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:34:24.376880 7873 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260808 11:34:24.377053 7873 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:34:24.377141 7873 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:24.428864 7873 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:41813
I20260808 11:34:24.428892 8033 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:41813 every 8 connection(s)
I20260808 11:34:24.430760 7873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:34:24.434171 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 7873
I20260808 11:34:24.435266 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.66.148:51621/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:42693
--local_ip_for_outbound_sockets=127.26.66.130
--tserver_master_addrs=127.26.66.190:45939
--webserver_port=42455
--webserver_interface=127.26.66.130
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:45613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.66.148:51621/kms with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 11:34:24 dist-test-slave-zkpd krb5kdc[6784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188864, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:34:24.464071 8037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:24.434220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45939 (local address 127.26.66.129:34623)
0808 11:34:24.437011 (+ 2791us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:24.437066 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:24.438949 (+ 1883us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:24.441314 (+ 2365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:24.441324 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:24.441917 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:34:24.442644 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:24.442669 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:24.445192 (+ 2523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:24.445198 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:24.447257 (+ 2059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:24.447273 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:24.449090 (+ 1817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:24.449097 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:24.449382 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:24.450190 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:34:24.450222 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:34:24.453416 (+ 3194us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:34:24.458123 (+ 4707us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:24.458137 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:24.458156 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:24.458800 (+ 644us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:24.459373 (+ 573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:24.459381 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:24.459387 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:24.459646 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:24.460954 (+ 1308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:34:24.460964 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:34:24.461387 (+ 423us) client_negotiation.cc:769] Sending connection context
0808 11:34:24.461846 (+ 459us) client_negotiation.cc:240] Negotiation successful
0808 11:34:24.462469 (+ 623us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2510,"thread_start_us":2309,"threads_started":1}
I20260808 11:34:24.467293 8036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:24.434146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:34623 (local address 127.26.66.190:45939)
0808 11:34:24.437847 (+ 3701us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:24.437865 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:24.437919 (+ 54us) server_negotiation.cc:407] Connection header received
0808 11:34:24.439599 (+ 1680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:24.439620 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:24.440152 (+ 532us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:24.440584 (+ 432us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:24.442924 (+ 2340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:24.444957 (+ 2033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:24.447437 (+ 2480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:24.448526 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:24.448709 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:24.453762 (+ 5053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:24.453775 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:24.453797 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:24.453858 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:24.457896 (+ 4038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:24.458983 (+ 1087us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:24.458995 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:24.459004 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:24.459214 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:24.459791 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:24.459799 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:24.459805 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:24.460660 (+ 855us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:24.460857 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:24.465017 (+ 4160us) server_negotiation.cc:299] Negotiation successful
0808 11:34:24.465512 (+ 495us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3423,"thread_start_us":3179,"threads_started":1}
I20260808 11:34:24.472121 8034 heartbeater.cc:347] Connected to a master server at 127.26.66.190:45939
I20260808 11:34:24.472488 8034 heartbeater.cc:464] Registering TS with master...
I20260808 11:34:24.473457 8034 heartbeater.cc:511] Master 127.26.66.190:45939 requested a full tablet report, sending...
W20260808 11:34:24.479033 8034 heartbeater.cc:644] Failed to heartbeat to 127.26.66.190:45939 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 11:34:24.479250 8034 heartbeater.cc:464] Registering TS with master...
I20260808 11:34:24.479524 8034 heartbeater.cc:511] Master 127.26.66.190:45939 requested a full tablet report, sending...
I20260808 11:34:24.480892 8034 heartbeater.cc:464] Registering TS with master...
I20260808 11:34:24.481196 8034 heartbeater.cc:511] Master 127.26.66.190:45939 requested a full tablet report, sending...
W20260808 11:34:24.482353 8034 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 11:34:24.867776 8039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:34:24.868183 8039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:34:24.868347 8039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:34:24.877045 8039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:34:24.877264 8039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:34:24.877470 8039 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:34:24.891340 8039 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.66.148:51621/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:42693
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=42455
--tserver_master_addrs=127.26.66.190:45939
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:34:24.892859 8039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:34:24.894276 8039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:34:24.909544 8054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:24.909909 8052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:24.910111 8051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:24.911692 8039 server_base.cc:1034] running on GCE node
I20260808 11:34:24.912422 8039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:34:24.913574 8039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:34:24.914888 8039 hybrid_clock.cc:648] HybridClock initialized: now 1786188864914807 us; error 57 us; skew 500 ppm
I20260808 11:34:24.915258 8039 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:34:24 dist-test-slave-zkpd krb5kdc[6784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188864, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:34:24.919675 8039 init.cc:377] Logged in from keytab as kudu/127.26.66.130@KRBTEST.COM (short username kudu)
I20260808 11:34:24.927803 8039 webserver.cc:460] Webserver started at http://127.26.66.130:42455/ using document root <none> and password file <none>
I20260808 11:34:24.928596 8039 fs_manager.cc:359] Metadata directory not provided
I20260808 11:34:24.928776 8039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 11:34:24 dist-test-slave-zkpd krb5kdc[6784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188864, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for HTTP/127.26.66.148@KRBTEST.COM
I20260808 11:34:24.951241 8039 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 11:34:24.954321 8065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:24.955861 8039 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 11:34:24.956106 8039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "1544eedf181447ad90af00ba2e567206"
format_stamp: "Formatted at 2026-08-08 11:34:21 on dist-test-slave-zkpd"
server_key: "b815261af90a9458afcd647bd37467e0"
server_key_iv: "b9f27b3aa60344d999cbeec0a5c31b4e"
server_key_version: "kuduclusterkey@0"
I20260808 11:34:24.957126 8039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:34:24.984862 8039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:34:24.989260 8039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:34:24.989549 8039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:34:25.004953 8039 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:34:25.013330 8039 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:34:25.013530 8039 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260808 11:34:25.013726 8039 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:34:25.013864 8039 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:25.088148 8039 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:42693
I20260808 11:34:25.088248 8182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:42693 every 8 connection(s)
I20260808 11:34:25.089989 8039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:34:25.097710 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 8039
I20260808 11:34:25.098543 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.66.148:51621/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:40619
--local_ip_for_outbound_sockets=127.26.66.131
--tserver_master_addrs=127.26.66.190:45939
--webserver_port=44139
--webserver_interface=127.26.66.131
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:45613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.66.148:51621/kms with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 11:34:25 dist-test-slave-zkpd krb5kdc[6784](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786188865, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 08 11:34:25 dist-test-slave-zkpd krb5kdc[6784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188864, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:34:25.131160 8186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:25.093712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45939 (local address 127.26.66.130:43977)
0808 11:34:25.106556 (+ 12844us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:25.106608 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:25.109797 (+ 3189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:25.110983 (+ 1186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:25.110997 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:25.111693 (+ 696us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:34:25.112612 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:25.112642 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:25.114288 (+ 1646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:25.114294 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:25.116381 (+ 2087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:25.116397 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:25.117528 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:25.117536 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:25.117846 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:25.118658 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:34:25.118688 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:34:25.121557 (+ 2869us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:34:25.125940 (+ 4383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:25.125950 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:25.125970 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:25.126601 (+ 631us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:25.127072 (+ 471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:25.127077 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:25.127081 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:25.127416 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:25.128219 (+ 803us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:34:25.128228 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:34:25.128676 (+ 448us) client_negotiation.cc:769] Sending connection context
0808 11:34:25.129005 (+ 329us) client_negotiation.cc:240] Negotiation successful
0808 11:34:25.129654 (+ 649us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12498,"thread_start_us":14283,"threads_started":1}
I20260808 11:34:25.132388 8185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:25.093104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:43977 (local address 127.26.66.190:45939)
0808 11:34:25.108271 (+ 15167us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:25.108278 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:25.108306 (+ 28us) server_negotiation.cc:407] Connection header received
0808 11:34:25.110163 (+ 1857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:25.110170 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:25.110278 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:25.110374 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:25.112860 (+ 2486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:25.114088 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:25.116564 (+ 2476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:25.117237 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:25.117395 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:25.121821 (+ 4426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:25.121828 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:25.121833 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:25.121892 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:25.125765 (+ 3873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:25.126760 (+ 995us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:25.126766 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:25.126770 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:25.126927 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:25.127577 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:25.127583 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:25.127586 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:25.127989 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:25.128131 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:25.131702 (+ 3571us) server_negotiation.cc:299] Negotiation successful
0808 11:34:25.131976 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15009,"thread_start_us":15166,"threads_started":1}
I20260808 11:34:25.134820 8183 heartbeater.cc:347] Connected to a master server at 127.26.66.190:45939
I20260808 11:34:25.135156 8183 heartbeater.cc:464] Registering TS with master...
I20260808 11:34:25.136106 8183 heartbeater.cc:511] Master 127.26.66.190:45939 requested a full tablet report, sending...
I20260808 11:34:25.138330 7836 ts_manager.cc:194] Registered new tserver with Master: 1544eedf181447ad90af00ba2e567206 (127.26.66.130:42693)
I20260808 11:34:25.140597 7836 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.130@KRBTEST.COM'} at 127.26.66.130:43977
I20260808 11:34:25.482534 8034 heartbeater.cc:464] Registering TS with master...
I20260808 11:34:25.483017 8034 heartbeater.cc:511] Master 127.26.66.190:45939 requested a full tablet report, sending...
I20260808 11:34:25.484462 7836 ts_manager.cc:194] Registered new tserver with Master: 86754aeedb784497b0d3c349f79c802e (127.26.66.129:41813)
I20260808 11:34:25.485728 7836 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.129@KRBTEST.COM'} at 127.26.66.129:34623
W20260808 11:34:25.568185 8187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:34:25.568504 8187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:34:25.568689 8187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:34:25.578052 8187 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:34:25.578204 8187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:34:25.578387 8187 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:34:25.592290 8187 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.66.148:51621/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:40619
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=44139
--tserver_master_addrs=127.26.66.190:45939
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:34:25.593752 8187 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:34:25.595490 8187 file_cache.cc:493] Constructed file cache file cache with capacity 419430
Aug 08 11:34:25 dist-test-slave-zkpd krb5kdc[6784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188865, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for HTTP/127.26.66.148@KRBTEST.COM
W20260808 11:34:25.611151 8193 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:25.623458 8194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:25.661238 8187 server_base.cc:1034] running on GCE node
W20260808 11:34:25.662051 8196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:25.663002 8187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:34:25.676234 8187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:34:25.682296 8187 hybrid_clock.cc:648] HybridClock initialized: now 1786188865682185 us; error 92 us; skew 500 ppm
I20260808 11:34:25.682847 8187 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:34:25 dist-test-slave-zkpd krb5kdc[6784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188865, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:34:25.687489 8187 init.cc:377] Logged in from keytab as kudu/127.26.66.131@KRBTEST.COM (short username kudu)
I20260808 11:34:25.720419 8187 webserver.cc:460] Webserver started at http://127.26.66.131:44139/ using document root <none> and password file <none>
I20260808 11:34:25.721642 8187 fs_manager.cc:359] Metadata directory not provided
I20260808 11:34:25.721902 8187 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 11:34:25 dist-test-slave-zkpd krb5kdc[6784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188865, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for HTTP/127.26.66.148@KRBTEST.COM
I20260808 11:34:25.782701 8187 fs_manager.cc:709] Time spent opening directory manager: real 0.010s user 0.001s sys 0.008s
I20260808 11:34:25.786705 8204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:25.788967 8187 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 11:34:25.789276 8187 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "a8250d0067644d9cab8f8f2bdf509feb"
format_stamp: "Formatted at 2026-08-08 11:34:22 on dist-test-slave-zkpd"
server_key: "f453357a0e8864559bd2cfa1a0807335"
server_key_iv: "bb316ec134c97a0cbd50fd3a427ca943"
server_key_version: "kuduclusterkey@0"
I20260808 11:34:25.790738 8187 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:34:25.825639 8187 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:34:25.831022 8187 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:34:25.831323 8187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:34:25.832579 8187 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:34:25.834549 8187 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:34:25.834671 8187 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:25.834790 8187 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:34:25.834882 8187 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:25.875952 8187 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:40619
I20260808 11:34:25.876006 8319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:40619 every 8 connection(s)
I20260808 11:34:25.877897 8187 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:34:25.879630 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 8187
I20260808 11:34:25.910802 8323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:25.880767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37240 (local address 127.26.66.190:45939)
0808 11:34:25.885158 (+ 4391us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:25.885168 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:25.885194 (+ 26us) server_negotiation.cc:407] Connection header received
0808 11:34:25.885290 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:25.885299 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:25.885427 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:25.885564 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:25.890507 (+ 4943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:25.891616 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:25.893994 (+ 2378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:25.894691 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:25.894815 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:25.900316 (+ 5501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:25.900323 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:25.900328 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:25.900380 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:25.904812 (+ 4432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:25.908220 (+ 3408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:25.908227 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:25.908231 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:25.908405 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:25.908891 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:25.908896 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:25.908899 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:25.909284 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:25.909577 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:25.910110 (+ 533us) server_negotiation.cc:299] Negotiation successful
0808 11:34:25.910367 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4234,"thread_start_us":4125,"threads_started":1}
Aug 08 11:34:25 dist-test-slave-zkpd krb5kdc[6784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188865, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:34:25.924401 8324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:25.884291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:53391 (local address 127.26.66.190:45939)
0808 11:34:25.890039 (+ 5748us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:25.890045 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:25.896327 (+ 6282us) server_negotiation.cc:407] Connection header received
0808 11:34:25.898688 (+ 2361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:25.898694 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:25.898779 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:25.898861 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:25.904998 (+ 6137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:25.906182 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:25.910732 (+ 4550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:25.911452 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:25.911548 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:25.918513 (+ 6965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:25.918518 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:25.918521 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:25.918551 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:25.921259 (+ 2708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:25.922007 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:25.922013 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:25.922016 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:25.922128 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:25.922614 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:25.922625 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:25.922628 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:25.922892 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:25.923062 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:25.923772 (+ 710us) server_negotiation.cc:299] Negotiation successful
0808 11:34:25.924010 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5611,"thread_start_us":5329,"threads_started":1}
I20260808 11:34:25.927050 8325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:25.885009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45939 (local address 127.26.66.131:53391)
0808 11:34:25.895687 (+ 10678us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:25.895753 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:25.898332 (+ 2579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:25.899501 (+ 1169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:25.899514 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:25.900170 (+ 656us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:34:25.903059 (+ 2889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:25.903087 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:25.906413 (+ 3326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:25.906419 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:25.909847 (+ 3428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:25.909863 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:25.915165 (+ 5302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:25.915170 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:25.915394 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:25.916143 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:34:25.916167 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:34:25.918246 (+ 2079us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:34:25.921401 (+ 3155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:25.921410 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:25.921428 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:25.921871 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:25.922264 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:25.922268 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:25.922272 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:25.922482 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:25.923030 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:34:25.923038 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:34:25.923399 (+ 361us) client_negotiation.cc:769] Sending connection context
0808 11:34:25.923666 (+ 267us) client_negotiation.cc:240] Negotiation successful
0808 11:34:25.924278 (+ 612us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10344,"thread_start_us":10132,"threads_started":1}
I20260808 11:34:25.928418 8320 heartbeater.cc:347] Connected to a master server at 127.26.66.190:45939
I20260808 11:34:25.928755 8320 heartbeater.cc:464] Registering TS with master...
I20260808 11:34:25.929536 8320 heartbeater.cc:511] Master 127.26.66.190:45939 requested a full tablet report, sending...
I20260808 11:34:25.931135 7836 ts_manager.cc:194] Registered new tserver with Master: a8250d0067644d9cab8f8f2bdf509feb (127.26.66.131:40619)
I20260808 11:34:25.932053 7836 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.131@KRBTEST.COM'} at 127.26.66.131:53391
I20260808 11:34:25.938612 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 11:34:25.971865 8324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:25.950033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37256 (local address 127.26.66.190:45939)
0808 11:34:25.950506 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:25.950513 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:25.952814 (+ 2301us) server_negotiation.cc:407] Connection header received
0808 11:34:25.953040 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:25.953045 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:25.953166 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:25.953275 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:25.955718 (+ 2443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:25.956975 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:25.959274 (+ 2299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:25.959946 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:25.960094 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:25.964512 (+ 4418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:25.964520 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:25.964525 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:25.964570 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:25.968329 (+ 3759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:25.969267 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:25.969272 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:25.969275 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:25.969417 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:25.969981 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:25.969987 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:25.969991 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:25.970425 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:25.970652 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:25.971316 (+ 664us) server_negotiation.cc:299] Negotiation successful
0808 11:34:25.971543 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340}
Aug 08 11:34:25 dist-test-slave-zkpd krb5kdc[6784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188865, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for HTTP/127.26.66.148@KRBTEST.COM
I20260808 11:34:25.979532 7836 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37256:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 11:34:25.996928 7836 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:34:26.115844 8340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:26.071607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37240 (local address 127.26.66.129:41813)
0808 11:34:26.103234 (+ 31627us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:26.103243 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:26.103270 (+ 27us) server_negotiation.cc:407] Connection header received
0808 11:34:26.103370 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:26.103378 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:26.103574 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:26.103762 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:34:26.107479 (+ 3717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.109500 (+ 2021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.112790 (+ 3290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.114230 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.114334 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:26.114536 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:26.115284 (+ 748us) server_negotiation.cc:299] Negotiation successful
0808 11:34:26.115461 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31459,"thread_start_us":31291,"threads_started":1}
I20260808 11:34:26.116175 8341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:26.083234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:40619 (local address 127.0.0.1:47306)
0808 11:34:26.101589 (+ 18355us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:26.101608 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:26.101742 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:26.104268 (+ 2526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:26.104277 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:26.104309 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:34:26.104693 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:26.104708 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.107455 (+ 2747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.107460 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:26.109984 (+ 2524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:26.110001 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.113918 (+ 3917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.113925 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:26.115445 (+ 1520us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:26.115480 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 11:34:26.115569 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 11:34:26.115771 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18221,"thread_start_us":18082,"threads_started":1}
I20260808 11:34:26.116969 8342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:26.083460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47306 (local address 127.26.66.131:40619)
0808 11:34:26.085223 (+ 1763us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:26.085233 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:26.101888 (+ 16655us) server_negotiation.cc:407] Connection header received
0808 11:34:26.102003 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:26.102012 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:26.102285 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:26.102483 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:34:26.104946 (+ 2463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.106642 (+ 1696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.111714 (+ 5072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.113296 (+ 1582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.113417 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:26.113661 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:26.116427 (+ 2766us) server_negotiation.cc:299] Negotiation successful
0808 11:34:26.116599 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1589,"thread_start_us":1435,"threads_started":1}
I20260808 11:34:26.116984 8339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:26.070978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:41813 (local address 127.0.0.1:37240)
0808 11:34:26.100669 (+ 29691us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:26.100720 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:26.100980 (+ 260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:26.106911 (+ 5931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:26.106916 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:26.106945 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:34:26.107279 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:26.107291 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.109748 (+ 2457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.109757 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:26.112379 (+ 2622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:26.112391 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.114785 (+ 2394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.114792 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:26.114993 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:26.115062 (+ 69us) client_negotiation.cc:769] Sending connection context
0808 11:34:26.116510 (+ 1448us) client_negotiation.cc:240] Negotiation successful
0808 11:34:26.116656 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29390,"thread_start_us":33022,"threads_started":1}
I20260808 11:34:26.120965 7967 tablet_service.cc:1467] Processing CreateTablet for tablet 9fb8db0890da464d95e0a5f0b38cd011 (DEFAULT_TABLE table=test-table [id=0649af706e23470f8eb14801dad62df6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:34:26.120983 8254 tablet_service.cc:1467] Processing CreateTablet for tablet 9fb8db0890da464d95e0a5f0b38cd011 (DEFAULT_TABLE table=test-table [id=0649af706e23470f8eb14801dad62df6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:34:26.122543 7967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fb8db0890da464d95e0a5f0b38cd011. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:34:26.122583 8254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fb8db0890da464d95e0a5f0b38cd011. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:34:26.132153 8343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:26.086534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:42693 (local address 127.0.0.1:35222)
0808 11:34:26.102446 (+ 15912us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:26.102464 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:26.102583 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:26.112121 (+ 9538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:26.112125 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:26.112150 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:34:26.112587 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:26.112599 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.114710 (+ 2111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.114717 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:26.117193 (+ 2476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:26.117208 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.131191 (+ 13983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.131198 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:26.131393 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:26.131428 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 11:34:26.131497 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 11:34:26.131631 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15788,"thread_start_us":15634,"threads_started":1}
I20260808 11:34:26.133627 8344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:26.092219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35222 (local address 127.26.66.130:42693)
0808 11:34:26.111571 (+ 19352us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:26.111579 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:26.111605 (+ 26us) server_negotiation.cc:407] Connection header received
0808 11:34:26.111693 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:26.111701 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:26.111915 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:26.112783 (+ 868us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:34:26.113021 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.114560 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.117406 (+ 2846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.130453 (+ 13047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.132824 (+ 2371us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:26.133058 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:26.133132 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 11:34:26.133309 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19185,"thread_start_us":20266,"threads_started":1}
I20260808 11:34:26.139755 8116 tablet_service.cc:1467] Processing CreateTablet for tablet 9fb8db0890da464d95e0a5f0b38cd011 (DEFAULT_TABLE table=test-table [id=0649af706e23470f8eb14801dad62df6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:34:26.141389 8116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fb8db0890da464d95e0a5f0b38cd011. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:34:26.145865 8183 heartbeater.cc:503] Master 127.26.66.190:45939 was elected leader, sending a full tablet report...
I20260808 11:34:26.165689 8345 tablet_bootstrap.cc:492] T 9fb8db0890da464d95e0a5f0b38cd011 P a8250d0067644d9cab8f8f2bdf509feb: Bootstrap starting.
I20260808 11:34:26.169534 8345 tablet_bootstrap.cc:654] T 9fb8db0890da464d95e0a5f0b38cd011 P a8250d0067644d9cab8f8f2bdf509feb: Neither blocks nor log segments found. Creating new log.
I20260808 11:34:26.171767 8347 tablet_bootstrap.cc:492] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206: Bootstrap starting.
I20260808 11:34:26.175537 8347 tablet_bootstrap.cc:654] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206: Neither blocks nor log segments found. Creating new log.
I20260808 11:34:26.177042 8347 log.cc:824] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206: Log is configured to *not* fsync() on all Append() calls
I20260808 11:34:26.179080 8346 tablet_bootstrap.cc:492] T 9fb8db0890da464d95e0a5f0b38cd011 P 86754aeedb784497b0d3c349f79c802e: Bootstrap starting.
I20260808 11:34:26.181234 8345 log.cc:824] T 9fb8db0890da464d95e0a5f0b38cd011 P a8250d0067644d9cab8f8f2bdf509feb: Log is configured to *not* fsync() on all Append() calls
I20260808 11:34:26.184756 8346 tablet_bootstrap.cc:654] T 9fb8db0890da464d95e0a5f0b38cd011 P 86754aeedb784497b0d3c349f79c802e: Neither blocks nor log segments found. Creating new log.
I20260808 11:34:26.186021 8346 log.cc:824] T 9fb8db0890da464d95e0a5f0b38cd011 P 86754aeedb784497b0d3c349f79c802e: Log is configured to *not* fsync() on all Append() calls
I20260808 11:34:26.188241 8347 tablet_bootstrap.cc:492] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206: No bootstrap required, opened a new log
I20260808 11:34:26.188597 8347 ts_tablet_manager.cc:1397] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206: Time spent bootstrapping tablet: real 0.017s user 0.014s sys 0.000s
I20260808 11:34:26.188938 8345 tablet_bootstrap.cc:492] T 9fb8db0890da464d95e0a5f0b38cd011 P a8250d0067644d9cab8f8f2bdf509feb: No bootstrap required, opened a new log
I20260808 11:34:26.189284 8345 ts_tablet_manager.cc:1397] T 9fb8db0890da464d95e0a5f0b38cd011 P a8250d0067644d9cab8f8f2bdf509feb: Time spent bootstrapping tablet: real 0.024s user 0.008s sys 0.000s
I20260808 11:34:26.199470 8347 raft_consensus.cc:348] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86754aeedb784497b0d3c349f79c802e" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 41813 } } peers { permanent_uuid: "a8250d0067644d9cab8f8f2bdf509feb" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 40619 } } peers { permanent_uuid: "1544eedf181447ad90af00ba2e567206" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 42693 } }
I20260808 11:34:26.200445 8347 raft_consensus.cc:374] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:34:26.200614 8347 raft_consensus.cc:729] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1544eedf181447ad90af00ba2e567206, State: Initialized, Role: FOLLOWER
I20260808 11:34:26.202090 8347 consensus_queue.cc:260] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86754aeedb784497b0d3c349f79c802e" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 41813 } } peers { permanent_uuid: "a8250d0067644d9cab8f8f2bdf509feb" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 40619 } } peers { permanent_uuid: "1544eedf181447ad90af00ba2e567206" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 42693 } }
I20260808 11:34:26.204645 8346 tablet_bootstrap.cc:492] T 9fb8db0890da464d95e0a5f0b38cd011 P 86754aeedb784497b0d3c349f79c802e: No bootstrap required, opened a new log
I20260808 11:34:26.204977 8346 ts_tablet_manager.cc:1397] T 9fb8db0890da464d95e0a5f0b38cd011 P 86754aeedb784497b0d3c349f79c802e: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.009s
I20260808 11:34:26.212365 8347 ts_tablet_manager.cc:1428] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206: Time spent starting tablet: real 0.024s user 0.007s sys 0.013s
I20260808 11:34:26.212548 8345 raft_consensus.cc:348] T 9fb8db0890da464d95e0a5f0b38cd011 P a8250d0067644d9cab8f8f2bdf509feb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86754aeedb784497b0d3c349f79c802e" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 41813 } } peers { permanent_uuid: "a8250d0067644d9cab8f8f2bdf509feb" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 40619 } } peers { permanent_uuid: "1544eedf181447ad90af00ba2e567206" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 42693 } }
I20260808 11:34:26.213090 8345 raft_consensus.cc:374] T 9fb8db0890da464d95e0a5f0b38cd011 P a8250d0067644d9cab8f8f2bdf509feb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:34:26.213228 8345 raft_consensus.cc:729] T 9fb8db0890da464d95e0a5f0b38cd011 P a8250d0067644d9cab8f8f2bdf509feb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8250d0067644d9cab8f8f2bdf509feb, State: Initialized, Role: FOLLOWER
I20260808 11:34:26.217664 8345 consensus_queue.cc:260] T 9fb8db0890da464d95e0a5f0b38cd011 P a8250d0067644d9cab8f8f2bdf509feb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86754aeedb784497b0d3c349f79c802e" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 41813 } } peers { permanent_uuid: "a8250d0067644d9cab8f8f2bdf509feb" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 40619 } } peers { permanent_uuid: "1544eedf181447ad90af00ba2e567206" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 42693 } }
I20260808 11:34:26.217864 8346 raft_consensus.cc:348] T 9fb8db0890da464d95e0a5f0b38cd011 P 86754aeedb784497b0d3c349f79c802e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86754aeedb784497b0d3c349f79c802e" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 41813 } } peers { permanent_uuid: "a8250d0067644d9cab8f8f2bdf509feb" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 40619 } } peers { permanent_uuid: "1544eedf181447ad90af00ba2e567206" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 42693 } }
I20260808 11:34:26.218448 8346 raft_consensus.cc:374] T 9fb8db0890da464d95e0a5f0b38cd011 P 86754aeedb784497b0d3c349f79c802e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:34:26.218606 8346 raft_consensus.cc:729] T 9fb8db0890da464d95e0a5f0b38cd011 P 86754aeedb784497b0d3c349f79c802e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86754aeedb784497b0d3c349f79c802e, State: Initialized, Role: FOLLOWER
I20260808 11:34:26.219657 8320 heartbeater.cc:503] Master 127.26.66.190:45939 was elected leader, sending a full tablet report...
I20260808 11:34:26.219460 8346 consensus_queue.cc:260] T 9fb8db0890da464d95e0a5f0b38cd011 P 86754aeedb784497b0d3c349f79c802e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86754aeedb784497b0d3c349f79c802e" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 41813 } } peers { permanent_uuid: "a8250d0067644d9cab8f8f2bdf509feb" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 40619 } } peers { permanent_uuid: "1544eedf181447ad90af00ba2e567206" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 42693 } }
I20260808 11:34:26.223943 8345 ts_tablet_manager.cc:1428] T 9fb8db0890da464d95e0a5f0b38cd011 P a8250d0067644d9cab8f8f2bdf509feb: Time spent starting tablet: real 0.034s user 0.014s sys 0.000s
I20260808 11:34:26.226862 8034 heartbeater.cc:503] Master 127.26.66.190:45939 was elected leader, sending a full tablet report...
I20260808 11:34:26.227540 8346 ts_tablet_manager.cc:1428] T 9fb8db0890da464d95e0a5f0b38cd011 P 86754aeedb784497b0d3c349f79c802e: Time spent starting tablet: real 0.022s user 0.011s sys 0.008s
W20260808 11:34:26.348654 8184 tablet.cc:2369] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:34:26.350864 8352 raft_consensus.cc:482] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:34:26.351137 8352 raft_consensus.cc:504] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86754aeedb784497b0d3c349f79c802e" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 41813 } } peers { permanent_uuid: "a8250d0067644d9cab8f8f2bdf509feb" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 40619 } } peers { permanent_uuid: "1544eedf181447ad90af00ba2e567206" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 42693 } }
I20260808 11:34:26.352993 8352 leader_election.cc:288] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86754aeedb784497b0d3c349f79c802e (127.26.66.129:41813), a8250d0067644d9cab8f8f2bdf509feb (127.26.66.131:40619)
I20260808 11:34:26.361876 8342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:26.353748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:48035 (local address 127.26.66.131:40619)
0808 11:34:26.353982 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:26.353988 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:26.354319 (+ 331us) server_negotiation.cc:407] Connection header received
0808 11:34:26.354430 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:26.354435 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:26.354512 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:26.354597 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:34:26.355393 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.356553 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.359718 (+ 3165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.360969 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.361123 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:26.361197 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:26.361482 (+ 285us) server_negotiation.cc:299] Negotiation successful
0808 11:34:26.361614 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 11:34:26.361908 8364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:26.353308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:40619 (local address 127.26.66.130:48035)
0808 11:34:26.354205 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:26.354222 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:26.354329 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:26.354616 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:26.354621 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:26.354749 (+ 128us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:34:26.355193 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:26.355207 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.356717 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.356721 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:26.359456 (+ 2735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:26.359488 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.361165 (+ 1677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.361170 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:26.361319 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:26.361348 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 11:34:26.361424 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 11:34:26.361511 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":787,"mutex_wait_us":183,"spinlock_wait_cycles":21760,"thread_start_us":629,"threads_started":1}
I20260808 11:34:26.362257 8363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:26.353152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:41813 (local address 127.26.66.130:43685)
0808 11:34:26.353880 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:26.353906 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:26.354137 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:26.354616 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:26.354621 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:26.354650 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:34:26.355264 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:26.355277 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.356716 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.356721 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:26.359456 (+ 2735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:26.359488 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.361366 (+ 1878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.361371 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:26.361557 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:26.361591 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 11:34:26.361696 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 11:34:26.361817 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"mutex_wait_us":125,"thread_start_us":467,"threads_started":1}
I20260808 11:34:26.362301 8340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:26.353359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:43685 (local address 127.26.66.129:41813)
0808 11:34:26.353606 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:26.353614 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:26.353999 (+ 385us) server_negotiation.cc:407] Connection header received
0808 11:34:26.354372 (+ 373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:26.354379 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:26.354462 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:26.354566 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:34:26.355395 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.356552 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.359720 (+ 3168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.360962 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.361123 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:26.361197 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:26.361813 (+ 616us) server_negotiation.cc:299] Negotiation successful
0808 11:34:26.362002 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 11:34:26.363045 8274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fb8db0890da464d95e0a5f0b38cd011" candidate_uuid: "1544eedf181447ad90af00ba2e567206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8250d0067644d9cab8f8f2bdf509feb" is_pre_election: true
I20260808 11:34:26.363346 7989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fb8db0890da464d95e0a5f0b38cd011" candidate_uuid: "1544eedf181447ad90af00ba2e567206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86754aeedb784497b0d3c349f79c802e" is_pre_election: true
I20260808 11:34:26.363559 8274 raft_consensus.cc:2454] T 9fb8db0890da464d95e0a5f0b38cd011 P a8250d0067644d9cab8f8f2bdf509feb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1544eedf181447ad90af00ba2e567206 in term 0.
I20260808 11:34:26.363834 7989 raft_consensus.cc:2454] T 9fb8db0890da464d95e0a5f0b38cd011 P 86754aeedb784497b0d3c349f79c802e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1544eedf181447ad90af00ba2e567206 in term 0.
I20260808 11:34:26.364326 8069 leader_election.cc:302] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1544eedf181447ad90af00ba2e567206, a8250d0067644d9cab8f8f2bdf509feb; no voters:
I20260808 11:34:26.364760 8352 raft_consensus.cc:2781] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:34:26.364915 8352 raft_consensus.cc:482] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:34:26.365020 8352 raft_consensus.cc:3037] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:34:26.367184 8352 raft_consensus.cc:504] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86754aeedb784497b0d3c349f79c802e" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 41813 } } peers { permanent_uuid: "a8250d0067644d9cab8f8f2bdf509feb" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 40619 } } peers { permanent_uuid: "1544eedf181447ad90af00ba2e567206" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 42693 } }
I20260808 11:34:26.367740 8352 leader_election.cc:288] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206 [CANDIDATE]: Term 1 election: Requested vote from peers 86754aeedb784497b0d3c349f79c802e (127.26.66.129:41813), a8250d0067644d9cab8f8f2bdf509feb (127.26.66.131:40619)
I20260808 11:34:26.368176 7989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fb8db0890da464d95e0a5f0b38cd011" candidate_uuid: "1544eedf181447ad90af00ba2e567206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86754aeedb784497b0d3c349f79c802e"
I20260808 11:34:26.368263 8274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fb8db0890da464d95e0a5f0b38cd011" candidate_uuid: "1544eedf181447ad90af00ba2e567206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8250d0067644d9cab8f8f2bdf509feb"
I20260808 11:34:26.368381 7989 raft_consensus.cc:3037] T 9fb8db0890da464d95e0a5f0b38cd011 P 86754aeedb784497b0d3c349f79c802e [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:34:26.368497 8274 raft_consensus.cc:3037] T 9fb8db0890da464d95e0a5f0b38cd011 P a8250d0067644d9cab8f8f2bdf509feb [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:34:26.370666 7989 raft_consensus.cc:2454] T 9fb8db0890da464d95e0a5f0b38cd011 P 86754aeedb784497b0d3c349f79c802e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1544eedf181447ad90af00ba2e567206 in term 1.
I20260808 11:34:26.370719 8274 raft_consensus.cc:2454] T 9fb8db0890da464d95e0a5f0b38cd011 P a8250d0067644d9cab8f8f2bdf509feb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1544eedf181447ad90af00ba2e567206 in term 1.
I20260808 11:34:26.371079 8067 leader_election.cc:302] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1544eedf181447ad90af00ba2e567206, 86754aeedb784497b0d3c349f79c802e; no voters:
I20260808 11:34:26.371435 8352 raft_consensus.cc:2781] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:34:26.371866 8352 raft_consensus.cc:686] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206 [term 1 LEADER]: Becoming Leader. State: Replica: 1544eedf181447ad90af00ba2e567206, State: Running, Role: LEADER
I20260808 11:34:26.372421 8352 consensus_queue.cc:237] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86754aeedb784497b0d3c349f79c802e" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 41813 } } peers { permanent_uuid: "a8250d0067644d9cab8f8f2bdf509feb" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 40619 } } peers { permanent_uuid: "1544eedf181447ad90af00ba2e567206" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 42693 } }
I20260808 11:34:26.376876 7833 catalog_manager.cc:5495] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1544eedf181447ad90af00ba2e567206 (127.26.66.130). New cstate: current_term: 1 leader_uuid: "1544eedf181447ad90af00ba2e567206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86754aeedb784497b0d3c349f79c802e" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 41813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8250d0067644d9cab8f8f2bdf509feb" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 40619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1544eedf181447ad90af00ba2e567206" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 42693 } health_report { overall_health: HEALTHY } } }
W20260808 11:34:26.389853 8321 tablet.cc:2369] T 9fb8db0890da464d95e0a5f0b38cd011 P a8250d0067644d9cab8f8f2bdf509feb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:34:26.413389 8344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:26.407509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35232 (local address 127.26.66.130:42693)
0808 11:34:26.407722 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:26.407727 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:26.407750 (+ 23us) server_negotiation.cc:407] Connection header received
0808 11:34:26.408041 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:26.408045 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:26.408133 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:26.408256 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:34:26.408590 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.409324 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.410974 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.411447 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.411558 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:26.412254 (+ 696us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:34:26.412770 (+ 516us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:34:26.412893 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:26.413028 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 11:34:26.413090 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 11:34:26.422109 7989 raft_consensus.cc:1261] T 9fb8db0890da464d95e0a5f0b38cd011 P 86754aeedb784497b0d3c349f79c802e [term 1 FOLLOWER]: Refusing update from remote peer 1544eedf181447ad90af00ba2e567206: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:34:26.422106 8274 raft_consensus.cc:1261] T 9fb8db0890da464d95e0a5f0b38cd011 P a8250d0067644d9cab8f8f2bdf509feb [term 1 FOLLOWER]: Refusing update from remote peer 1544eedf181447ad90af00ba2e567206: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:34:26.423117 8365 consensus_queue.cc:1035] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8250d0067644d9cab8f8f2bdf509feb" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 40619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:34:26.423488 8352 consensus_queue.cc:1035] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86754aeedb784497b0d3c349f79c802e" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 41813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 11:34:26.433876 8035 tablet.cc:2369] T 9fb8db0890da464d95e0a5f0b38cd011 P 86754aeedb784497b0d3c349f79c802e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:34:26.440614 8368 mvcc.cc:205] Tried to move back new op lower bound from 7316229596854087680 to 7316229596665356288. Current Snapshot: MvccSnapshot[applied={T|T < 7316229596854087680}]
I20260808 11:34:26.445832 8369 mvcc.cc:205] Tried to move back new op lower bound from 7316229596854087680 to 7316229596665356288. Current Snapshot: MvccSnapshot[applied={T|T < 7316229596854087680}]
I20260808 11:34:26.465852 7836 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:34:26.466432 7836 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:34:26.470429 7836 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2df8f423c5424fd7b3d9496ad0b9b274: Sending DeleteTablet for 3 replicas of tablet 9fb8db0890da464d95e0a5f0b38cd011
I20260808 11:34:26.471495 7967 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fb8db0890da464d95e0a5f0b38cd011 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:34:26 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:37240
I20260808 11:34:26.471632 8116 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fb8db0890da464d95e0a5f0b38cd011 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:34:26 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:35222
I20260808 11:34:26.471858 8254 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fb8db0890da464d95e0a5f0b38cd011 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:34:26 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:47306
I20260808 11:34:26.474079 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 7873
I20260808 11:34:26.482497 8378 tablet_replica.cc:330] T 9fb8db0890da464d95e0a5f0b38cd011 P 86754aeedb784497b0d3c349f79c802e: stopping tablet replica
I20260808 11:34:26.482632 8380 tablet_replica.cc:330] T 9fb8db0890da464d95e0a5f0b38cd011 P a8250d0067644d9cab8f8f2bdf509feb: stopping tablet replica
I20260808 11:34:26.482952 8378 raft_consensus.cc:2229] T 9fb8db0890da464d95e0a5f0b38cd011 P 86754aeedb784497b0d3c349f79c802e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:34:26.482959 8380 raft_consensus.cc:2229] T 9fb8db0890da464d95e0a5f0b38cd011 P a8250d0067644d9cab8f8f2bdf509feb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:34:26.483465 8380 raft_consensus.cc:2258] T 9fb8db0890da464d95e0a5f0b38cd011 P a8250d0067644d9cab8f8f2bdf509feb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:34:26.483464 8378 raft_consensus.cc:2258] T 9fb8db0890da464d95e0a5f0b38cd011 P 86754aeedb784497b0d3c349f79c802e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:34:26.484568 8379 tablet_replica.cc:330] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206: stopping tablet replica
I20260808 11:34:26.484983 8379 raft_consensus.cc:2229] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206 [term 1 LEADER]: Raft consensus shutting down.
I20260808 11:34:26.485774 8379 raft_consensus.cc:2258] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:34:26.486218 8378 ts_tablet_manager.cc:1905] T 9fb8db0890da464d95e0a5f0b38cd011 P 86754aeedb784497b0d3c349f79c802e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:34:26.486980 8380 ts_tablet_manager.cc:1905] T 9fb8db0890da464d95e0a5f0b38cd011 P a8250d0067644d9cab8f8f2bdf509feb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:34:26.487811 8379 ts_tablet_manager.cc:1905] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:34:26.493477 8378 ts_tablet_manager.cc:1918] T 9fb8db0890da464d95e0a5f0b38cd011 P 86754aeedb784497b0d3c349f79c802e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:34:26.493738 8378 log.cc:1196] T 9fb8db0890da464d95e0a5f0b38cd011 P 86754aeedb784497b0d3c349f79c802e: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-0/wal/wals/9fb8db0890da464d95e0a5f0b38cd011
I20260808 11:34:26.494432 8378 ts_tablet_manager.cc:1939] T 9fb8db0890da464d95e0a5f0b38cd011 P 86754aeedb784497b0d3c349f79c802e: Deleting consensus metadata
I20260808 11:34:26.495484 8379 ts_tablet_manager.cc:1918] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:34:26.495728 8379 log.cc:1196] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-1/wal/wals/9fb8db0890da464d95e0a5f0b38cd011
I20260808 11:34:26.496356 8379 ts_tablet_manager.cc:1939] T 9fb8db0890da464d95e0a5f0b38cd011 P 1544eedf181447ad90af00ba2e567206: Deleting consensus metadata
I20260808 11:34:26.496616 7817 catalog_manager.cc:4841] TS 86754aeedb784497b0d3c349f79c802e (127.26.66.129:41813): tablet 9fb8db0890da464d95e0a5f0b38cd011 (table test-table [id=0649af706e23470f8eb14801dad62df6]) successfully deleted
I20260808 11:34:26.498142 7816 catalog_manager.cc:4841] TS 1544eedf181447ad90af00ba2e567206 (127.26.66.130:42693): tablet 9fb8db0890da464d95e0a5f0b38cd011 (table test-table [id=0649af706e23470f8eb14801dad62df6]) successfully deleted
I20260808 11:34:26.501816 8380 ts_tablet_manager.cc:1918] T 9fb8db0890da464d95e0a5f0b38cd011 P a8250d0067644d9cab8f8f2bdf509feb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:34:26.502008 8380 log.cc:1196] T 9fb8db0890da464d95e0a5f0b38cd011 P a8250d0067644d9cab8f8f2bdf509feb: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786188664137852-26890-0/minicluster-data/ts-2/wal/wals/9fb8db0890da464d95e0a5f0b38cd011
I20260808 11:34:26.502579 8380 ts_tablet_manager.cc:1939] T 9fb8db0890da464d95e0a5f0b38cd011 P a8250d0067644d9cab8f8f2bdf509feb: Deleting consensus metadata
I20260808 11:34:26.504344 7819 catalog_manager.cc:4841] TS a8250d0067644d9cab8f8f2bdf509feb (127.26.66.131:40619): tablet 9fb8db0890da464d95e0a5f0b38cd011 (table test-table [id=0649af706e23470f8eb14801dad62df6]) successfully deleted
I20260808 11:34:26.514510 8340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:26.475474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37254 (local address 127.26.66.129:41813)
0808 11:34:26.475645 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:26.475651 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:26.492762 (+ 17111us) server_negotiation.cc:407] Connection header received
0808 11:34:26.494483 (+ 1721us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:26.494489 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:26.494583 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:26.494664 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:26.497923 (+ 3259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.499045 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.500455 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.500873 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.501011 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:26.508339 (+ 7328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:26.508350 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:26.508364 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:26.508405 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:26.511488 (+ 3083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:26.512304 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:26.512311 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:26.512313 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:26.512459 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:26.512882 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:26.512886 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:26.512888 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:26.513243 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:26.513575 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:26.513928 (+ 353us) server_negotiation.cc:299] Negotiation successful
0808 11:34:26.514154 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 11:34:26.515303 8029 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:34:26.604924 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 7873
I20260808 11:34:26.626355 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 8039
I20260808 11:34:26.641551 8344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:26.627171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35246 (local address 127.26.66.130:42693)
0808 11:34:26.627396 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:26.627401 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:26.627422 (+ 21us) server_negotiation.cc:407] Connection header received
0808 11:34:26.627685 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:26.627694 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:26.627815 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:26.627964 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:26.629385 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.630328 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.631630 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.632203 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.632354 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:26.635107 (+ 2753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:26.635126 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:26.635142 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:26.635179 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:26.638357 (+ 3178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:26.639106 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:26.639115 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:26.639117 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:26.639282 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:26.639680 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:26.639686 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:26.639689 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:26.640298 (+ 609us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:26.640638 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:26.640937 (+ 299us) server_negotiation.cc:299] Negotiation successful
0808 11:34:26.641184 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 11:34:26.642333 8178 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:34:26.767874 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 8039
I20260808 11:34:26.789785 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 8187
I20260808 11:34:26.803495 8342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:26.790671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47316 (local address 127.26.66.131:40619)
0808 11:34:26.790899 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:26.790904 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:26.790925 (+ 21us) server_negotiation.cc:407] Connection header received
0808 11:34:26.791051 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:26.791055 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:26.791120 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:26.791224 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:26.792639 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.793365 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.794698 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:26.795199 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:26.795311 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:26.798254 (+ 2943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:26.798268 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:26.798286 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:26.798318 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:26.801037 (+ 2719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:26.801663 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:26.801670 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:26.801672 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:26.801796 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:26.802145 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:26.802147 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:26.802149 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:26.802565 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:26.802802 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:26.803063 (+ 261us) server_negotiation.cc:299] Negotiation successful
0808 11:34:26.803220 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
I20260808 11:34:26.804177 8315 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:34:26.892887 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 8187
I20260808 11:34:26.912773 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 7799
I20260808 11:34:26.913964 7866 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:34:27.029173 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 7799
I20260808 11:34:27.055244 26890 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 11:34:27.400892 26890 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 11:34:27.401098 26890 mini_ranger.cc:66] Stopping Ranger...
I20260808 11:34:27.756011 26890 mini_ranger.cc:68] Stopped Ranger
2026-08-08 11:34:27.756 UTC [6815] LOG: received smart shutdown request
2026-08-08 11:34:27.759 UTC [6815] LOG: background worker "logical replication launcher" (PID 6824) exited with exit code 1
2026-08-08 11:34:27.759 UTC [6819] LOG: shutting down
2026-08-08 11:34:27.912 UTC [6815] LOG: database system is shut down
2026-08-08T11:34:27Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (52444 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:34:28 dist-test-slave-zkpd krb5kdc[8395](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:34:28 dist-test-slave-zkpd krb5kdc[8395](info): set up 2 sockets
Aug 08 11:34:28 dist-test-slave-zkpd krb5kdc[8395](info): commencing operation
krb5kdc: starting...
W20260808 11:34:29.206291 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:34:29 dist-test-slave-zkpd krb5kdc[8395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:34:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:34:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:34:29.501484 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:45113
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:40869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:45113,127.26.66.189:34281,127.26.66.188:38899
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:34:29.837687 8408 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:34:29.837972 8408 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:34:29.838160 8408 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:34:29.845362 8408 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:34:29.845484 8408 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:34:29.845566 8408 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:34:29.845665 8408 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:34:29.845758 8408 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:34:29.855435 8408 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:40869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:45113,127.26.66.189:34281,127.26.66.188:38899
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:45113
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:34:29.856774 8408 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:34:29.858057 8408 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:34:29.869767 8413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:29.869823 8416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:29.869886 8414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:29.870709 8408 server_base.cc:1034] running on GCE node
I20260808 11:34:29.871522 8408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:34:29.872938 8408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:34:29.874142 8408 hybrid_clock.cc:648] HybridClock initialized: now 1786188869874094 us; error 37 us; skew 500 ppm
I20260808 11:34:29.874516 8408 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:34:29 dist-test-slave-zkpd krb5kdc[8395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188869, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:34:29.877774 8408 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:34:29.879297 8408 webserver.cc:460] Webserver started at http://127.26.66.190:34395/ using document root <none> and password file <none>
I20260808 11:34:29.880077 8408 fs_manager.cc:359] Metadata directory not provided
I20260808 11:34:29.880246 8408 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:34:29.880558 8408 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:34:29.883565 8408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "6734bb3604d14acfaf8ec3717f90d6a6"
format_stamp: "Formatted at 2026-08-08 11:34:29 on dist-test-slave-zkpd"
server_key: "dcdeaa9a4df477bd0d440f9e876c3145"
server_key_iv: "01f58e8cce9041b63a91ea93a07ab72c"
server_key_version: "encryptionkey@0"
I20260808 11:34:29.884425 8408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "6734bb3604d14acfaf8ec3717f90d6a6"
format_stamp: "Formatted at 2026-08-08 11:34:29 on dist-test-slave-zkpd"
server_key: "dcdeaa9a4df477bd0d440f9e876c3145"
server_key_iv: "01f58e8cce9041b63a91ea93a07ab72c"
server_key_version: "encryptionkey@0"
I20260808 11:34:29.889518 8408 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 11:34:29.892899 8423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:29.894218 8408 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 11:34:29.894415 8408 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "6734bb3604d14acfaf8ec3717f90d6a6"
format_stamp: "Formatted at 2026-08-08 11:34:29 on dist-test-slave-zkpd"
server_key: "dcdeaa9a4df477bd0d440f9e876c3145"
server_key_iv: "01f58e8cce9041b63a91ea93a07ab72c"
server_key_version: "encryptionkey@0"
I20260808 11:34:29.894613 8408 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:34:29.918861 8408 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:34:29.922876 8408 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:34:29.923183 8408 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:34:29.942327 8408 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:45113
I20260808 11:34:29.942368 8477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:45113 every 8 connection(s)
I20260808 11:34:29.943678 8408 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:34:29.946115 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 8408
I20260808 11:34:29.946360 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:34:29.947213 26890 external_mini_cluster.cc:1428] Setting key f6f480b067de5d97276e25b4ad461b6f
I20260808 11:34:29.948096 8478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:34:29.958134 8478 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45113 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 11:34:29 dist-test-slave-zkpd krb5kdc[8395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188869, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.66.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.189@KRBTEST.COM" created.
I20260808 11:34:29.982223 8481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:29.962173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45113 (local address 127.0.0.1:58138)
0808 11:34:29.963079 (+ 906us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:29.963117 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:29.965317 (+ 2200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:29.966193 (+ 876us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:29.966209 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:29.966915 (+ 706us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:34:29.967260 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:29.967278 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:29.968942 (+ 1664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:29.968952 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:29.969999 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:29.970011 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:29.970906 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:29.970912 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:29.971167 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:29.971871 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:34:29.972119 (+ 248us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:34:29.974764 (+ 2645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:34:29.978000 (+ 3236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:29.978012 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:29.978023 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:29.978397 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:29.978827 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:29.978833 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:29.978836 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:29.978999 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:29.979818 (+ 819us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:34:29.979825 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:34:29.980091 (+ 266us) client_negotiation.cc:769] Sending connection context
0808 11:34:29.980375 (+ 284us) client_negotiation.cc:240] Negotiation successful
0808 11:34:29.980927 (+ 552us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"mutex_wait_us":151,"thread_start_us":341,"threads_started":1}
I20260808 11:34:29.982242 8482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:29.963656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58138 (local address 127.26.66.190:45113)
0808 11:34:29.964458 (+ 802us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:29.964466 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:29.964517 (+ 51us) server_negotiation.cc:407] Connection header received
0808 11:34:29.965685 (+ 1168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:29.965690 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:29.965951 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:29.966177 (+ 226us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:29.967471 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:29.968775 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:29.970139 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:29.970660 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:29.970875 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:29.974986 (+ 4111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:29.974993 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:29.975004 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:29.975037 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:29.977876 (+ 2839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:29.978558 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:29.978572 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:29.978574 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:29.978715 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:29.979110 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:29.979116 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:29.979119 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:29.979685 (+ 566us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:29.979868 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:29.980504 (+ 636us) server_negotiation.cc:299] Negotiation successful
0808 11:34:29.980808 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":63,"server-negotiator.queue_time_us":572,"thread_start_us":375,"threads_started":1}
I20260808 11:34:29.985306 8478 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 } has no permanent_uuid. Determining permanent_uuid...
I20260808 11:34:29.986414 8481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:29.986053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:34281 (local address 127.0.0.1:57026)
0808 11:34:29.986206 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:29.986307 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:34281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260808 11:34:29.986696 8424 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.66.189:34281: connect: Connection refused (error 111)
I20260808 11:34:29.988497 8481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:29.988051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:34281 (local address 127.0.0.1:57034)
0808 11:34:29.988228 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:29.988320 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:34281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260808 11:34:29.988795 8478 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.189:34281: Network error: Client connection negotiation failed: client connection to 127.26.66.189:34281: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.189.keytab.
Entry for principal kudu/127.26.66.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.189.keytab.
I20260808 11:34:30.013170 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.189:34281
--webserver_interface=127.26.66.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.189.keytab
--principal=kudu/127.26.66.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:40869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:45113,127.26.66.189:34281,127.26.66.188:38899
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 11:34:30.038138 8478 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 } attempt: 1
I20260808 11:34:30.039433 8481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.038960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:34281 (local address 127.0.0.1:57050)
0808 11:34:30.039165 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.039272 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:34281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260808 11:34:30.040627 8481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.040287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:34281 (local address 127.0.0.1:57058)
0808 11:34:30.040432 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.040499 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:34281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260808 11:34:30.040930 8478 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.189:34281: Network error: Client connection negotiation failed: client connection to 127.26.66.189:34281: connect: Connection refused (error 111)
I20260808 11:34:30.109226 8478 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 } attempt: 2
I20260808 11:34:30.110509 8481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.110008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:34281 (local address 127.0.0.1:57064)
0808 11:34:30.110253 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.110361 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:34281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260808 11:34:30.111629 8481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.111289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:34281 (local address 127.0.0.1:57066)
0808 11:34:30.111428 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.111507 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:34281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 11:34:30.111937 8478 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.189:34281: Network error: Client connection negotiation failed: client connection to 127.26.66.189:34281: connect: Connection refused (error 111)
I20260808 11:34:30.203208 8478 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 } attempt: 3
I20260808 11:34:30.204542 8481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.204074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:34281 (local address 127.0.0.1:57068)
0808 11:34:30.204278 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.204400 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:34281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260808 11:34:30.205716 8481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.205368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:34281 (local address 127.0.0.1:57084)
0808 11:34:30.205521 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.205587 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:34281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260808 11:34:30.205966 8478 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.189:34281: Network error: Client connection negotiation failed: client connection to 127.26.66.189:34281: connect: Connection refused (error 111)
I20260808 11:34:30.349251 8478 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 } attempt: 4
I20260808 11:34:30.350464 8481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.349936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:34281 (local address 127.0.0.1:57092)
0808 11:34:30.350247 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.350334 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:34281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177}
I20260808 11:34:30.351485 8481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.351166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:34281 (local address 127.0.0.1:57102)
0808 11:34:30.351290 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.351375 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:34281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 11:34:30.351754 8478 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.189:34281: Network error: Client connection negotiation failed: client connection to 127.26.66.189:34281: connect: Connection refused (error 111)
W20260808 11:34:30.359776 8486 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:34:30.360183 8486 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:34:30.360361 8486 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:34:30.367704 8486 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:34:30.367839 8486 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:34:30.367990 8486 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:34:30.368090 8486 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:34:30.368158 8486 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:34:30.378198 8486 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:40869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:45113,127.26.66.189:34281,127.26.66.188:38899
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.189.keytab
--principal=kudu/127.26.66.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.189:34281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.66.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:34:30.379565 8486 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:34:30.380887 8486 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:34:30.393047 8491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:30.392975 8492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:30.393105 8494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:30.393661 8486 server_base.cc:1034] running on GCE node
I20260808 11:34:30.394474 8486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:34:30.395867 8486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:34:30.397135 8486 hybrid_clock.cc:648] HybridClock initialized: now 1786188870397084 us; error 43 us; skew 500 ppm
I20260808 11:34:30.397501 8486 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:34:30 dist-test-slave-zkpd krb5kdc[8395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188870, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:34:30.400880 8486 init.cc:377] Logged in from keytab as kudu/127.26.66.189@KRBTEST.COM (short username kudu)
I20260808 11:34:30.402335 8486 webserver.cc:460] Webserver started at http://127.26.66.189:45447/ using document root <none> and password file <none>
I20260808 11:34:30.403024 8486 fs_manager.cc:359] Metadata directory not provided
I20260808 11:34:30.403177 8486 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:34:30.403494 8486 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:34:30.406512 8486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-1/data/instance:
uuid: "3e39d5ef20634ee3a4ad90bc7702d99b"
format_stamp: "Formatted at 2026-08-08 11:34:30 on dist-test-slave-zkpd"
server_key: "fad3845efd605d953b3697c841807fca"
server_key_iv: "fd4fa56d7f56f62a291e847296152458"
server_key_version: "encryptionkey@0"
I20260808 11:34:30.407389 8486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-1/wal/instance:
uuid: "3e39d5ef20634ee3a4ad90bc7702d99b"
format_stamp: "Formatted at 2026-08-08 11:34:30 on dist-test-slave-zkpd"
server_key: "fad3845efd605d953b3697c841807fca"
server_key_iv: "fd4fa56d7f56f62a291e847296152458"
server_key_version: "encryptionkey@0"
I20260808 11:34:30.412598 8486 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260808 11:34:30.415977 8502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:30.417193 8486 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:34:30.417397 8486 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-1/wal
uuid: "3e39d5ef20634ee3a4ad90bc7702d99b"
format_stamp: "Formatted at 2026-08-08 11:34:30 on dist-test-slave-zkpd"
server_key: "fad3845efd605d953b3697c841807fca"
server_key_iv: "fd4fa56d7f56f62a291e847296152458"
server_key_version: "encryptionkey@0"
I20260808 11:34:30.417600 8486 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:34:30.444176 8486 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:34:30.448663 8486 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:34:30.448962 8486 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:34:30.467415 8486 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.189:34281
I20260808 11:34:30.467454 8554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.189:34281 every 8 connection(s)
I20260808 11:34:30.468834 8486 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-1/data/info.pb
I20260808 11:34:30.470757 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 8486
I20260808 11:34:30.470956 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-1/wal/instance
I20260808 11:34:30.471606 26890 external_mini_cluster.cc:1428] Setting key d0f9ae74d74a77bf111cbde26baa55e0
I20260808 11:34:30.473201 8555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:34:30.483228 8555 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45113 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 11:34:30 dist-test-slave-zkpd krb5kdc[8395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188870, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.189@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.66.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.188@KRBTEST.COM" created.
I20260808 11:34:30.508383 8558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.486547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44420 (local address 127.26.66.190:45113)
0808 11:34:30.487151 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:30.487158 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:30.488189 (+ 1031us) server_negotiation.cc:407] Connection header received
0808 11:34:30.491144 (+ 2955us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:30.491149 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:30.491219 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:30.491319 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:30.493590 (+ 2271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:30.494387 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:30.496957 (+ 2570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:30.497368 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:30.497462 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:30.501929 (+ 4467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:30.501933 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:30.501937 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:30.501975 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:30.504971 (+ 2996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:30.505808 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:30.505822 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:30.505824 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:30.505940 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:30.506390 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:30.506397 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:30.506405 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:30.506739 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:30.506913 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:30.507736 (+ 823us) server_negotiation.cc:299] Negotiation successful
0808 11:34:30.507998 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":313,"threads_started":1}
I20260808 11:34:30.509393 8559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.487119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45113 (local address 127.0.0.1:44420)
0808 11:34:30.488002 (+ 883us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.488054 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:30.490842 (+ 2788us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:30.491588 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:30.491602 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:30.492454 (+ 852us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:34:30.493375 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:30.493406 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:30.494575 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:30.494584 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:30.496808 (+ 2224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:30.496826 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:30.497615 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:30.497626 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:30.498019 (+ 393us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:30.498834 (+ 815us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:34:30.498870 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:34:30.501666 (+ 2796us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:34:30.505129 (+ 3463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:30.505138 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:30.505154 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:30.505669 (+ 515us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:30.506070 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:30.506075 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:30.506079 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:30.506256 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:30.506897 (+ 641us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:34:30.506905 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:34:30.507320 (+ 415us) client_negotiation.cc:769] Sending connection context
0808 11:34:30.507638 (+ 318us) client_negotiation.cc:240] Negotiation successful
0808 11:34:30.508182 (+ 544us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":313,"threads_started":1}
I20260808 11:34:30.511165 8555 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 11:34:30 dist-test-slave-zkpd krb5kdc[8395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188870, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.189@KRBTEST.COM for kudu/127.26.66.189@KRBTEST.COM
I20260808 11:34:30.525449 8559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.511990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:34281 (local address 127.0.0.1:52314)
0808 11:34:30.512186 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.512205 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:30.512300 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:30.513143 (+ 843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:30.513147 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:30.513607 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:34:30.513754 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:30.513763 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:30.515104 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:30.515110 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:30.516007 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:30.516019 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:30.516848 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:30.516854 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:30.517057 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:30.517664 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:34:30.517681 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:34:30.519632 (+ 1951us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:34:30.522958 (+ 3326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:30.522966 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:30.522972 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:30.523342 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:30.523722 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:30.523728 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:30.523732 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:30.523874 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:30.524495 (+ 621us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:34:30.524502 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:34:30.524647 (+ 145us) client_negotiation.cc:769] Sending connection context
0808 11:34:30.524797 (+ 150us) client_negotiation.cc:240] Negotiation successful
0808 11:34:30.525058 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 11:34:30.525528 8560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.512157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52314 (local address 127.26.66.189:34281)
0808 11:34:30.512743 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:30.512748 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:30.512772 (+ 24us) server_negotiation.cc:407] Connection header received
0808 11:34:30.512814 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:30.512820 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:30.512994 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:30.513149 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:30.513915 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:30.514962 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:30.516146 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:30.516671 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:30.516816 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:30.519847 (+ 3031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:30.519859 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:30.519871 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:30.519953 (+ 82us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:30.522767 (+ 2814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:30.523477 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:30.523484 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:30.523488 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:30.523605 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:30.524021 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:30.524027 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:30.524030 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:30.524364 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:30.524593 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:30.524960 (+ 367us) server_negotiation.cc:299] Negotiation successful
0808 11:34:30.525159 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":305,"threads_started":1}
I20260808 11:34:30.528064 8555 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } has no permanent_uuid. Determining permanent_uuid...
I20260808 11:34:30.529496 8559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.528904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:38899 (local address 127.0.0.1:55162)
0808 11:34:30.529123 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.529288 (+ 165us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260808 11:34:30.529795 8505 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
I20260808 11:34:30.531574 8559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.531097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:38899 (local address 127.0.0.1:55166)
0808 11:34:30.531294 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.531420 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260808 11:34:30.531809 8555 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.188:38899: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.188.keytab.
Entry for principal kudu/127.26.66.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.188.keytab.
I20260808 11:34:30.544997 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.188:38899
--webserver_interface=127.26.66.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.188.keytab
--principal=kudu/127.26.66.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:40869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:45113,127.26.66.189:34281,127.26.66.188:38899
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 11:34:30.581215 8555 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } attempt: 1
I20260808 11:34:30.582477 8559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.581962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:38899 (local address 127.0.0.1:55180)
0808 11:34:30.582186 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.582306 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260808 11:34:30.583495 8559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.583172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:38899 (local address 127.0.0.1:55194)
0808 11:34:30.583324 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.583390 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 11:34:30.583745 8555 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.188:38899: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
I20260808 11:34:30.651049 8478 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 } attempt: 5
I20260808 11:34:30.652160 8555 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } attempt: 2
I20260808 11:34:30.653205 8559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.652671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:38899 (local address 127.0.0.1:55206)
0808 11:34:30.652919 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.653014 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155}
I20260808 11:34:30.654771 8559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.653898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:38899 (local address 127.0.0.1:55220)
0808 11:34:30.654474 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.654558 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":294,"threads_started":1}
W20260808 11:34:30.654949 8555 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.188:38899: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
Aug 08 11:34:30 dist-test-slave-zkpd krb5kdc[8395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188869, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for kudu/127.26.66.189@KRBTEST.COM
I20260808 11:34:30.665642 8481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.651828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:34281 (local address 127.0.0.1:52318)
0808 11:34:30.652068 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.652091 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:30.652251 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:30.652717 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:30.652721 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:30.653173 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:34:30.653431 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:30.653446 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:30.654725 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:30.654734 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:30.655795 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:30.655808 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:30.656655 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:30.656661 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:30.656865 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:30.657546 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:34:30.657564 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:34:30.659619 (+ 2055us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:34:30.662683 (+ 3064us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:30.662689 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:30.662694 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:30.663072 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:30.663514 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:30.663520 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:30.663523 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:30.663700 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:30.664582 (+ 882us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:34:30.664588 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:34:30.664814 (+ 226us) client_negotiation.cc:769] Sending connection context
0808 11:34:30.664979 (+ 165us) client_negotiation.cc:240] Negotiation successful
0808 11:34:30.665301 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103}
I20260808 11:34:30.666853 8560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.652026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52318 (local address 127.26.66.189:34281)
0808 11:34:30.652242 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:30.652248 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:30.652272 (+ 24us) server_negotiation.cc:407] Connection header received
0808 11:34:30.652466 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:30.652471 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:30.652563 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:30.652681 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:30.653620 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:30.654582 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:30.656017 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:30.656501 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:30.656645 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:30.659819 (+ 3174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:30.659824 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:30.659828 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:30.659858 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:30.662532 (+ 2674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:30.663208 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:30.663213 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:30.663217 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:30.663349 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:30.663816 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:30.663821 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:30.663824 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:30.664382 (+ 558us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:30.664531 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:30.666236 (+ 1705us) server_negotiation.cc:299] Negotiation successful
0808 11:34:30.666505 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260808 11:34:30.667804 8478 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } has no permanent_uuid. Determining permanent_uuid...
I20260808 11:34:30.669075 8481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.668629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:38899 (local address 127.0.0.1:55224)
0808 11:34:30.668870 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.668945 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260808 11:34:30.670105 8481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.669795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:38899 (local address 127.0.0.1:55238)
0808 11:34:30.669932 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.670011 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260808 11:34:30.670374 8478 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.188:38899: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
I20260808 11:34:30.721623 8478 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } attempt: 1
I20260808 11:34:30.722940 8481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.722430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:38899 (local address 127.0.0.1:55250)
0808 11:34:30.722643 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.722753 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260808 11:34:30.724038 8481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.723620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:38899 (local address 127.0.0.1:55254)
0808 11:34:30.723773 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.723855 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 11:34:30.724253 8478 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.188:38899: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
I20260808 11:34:30.746208 8555 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } attempt: 3
I20260808 11:34:30.747571 8559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.746943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:38899 (local address 127.0.0.1:55258)
0808 11:34:30.747202 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.747335 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260808 11:34:30.748899 8559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.748307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:38899 (local address 127.0.0.1:55264)
0808 11:34:30.748594 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.748698 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146}
W20260808 11:34:30.749138 8555 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.188:38899: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
I20260808 11:34:30.792486 8478 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } attempt: 2
I20260808 11:34:30.793715 8481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.793178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:38899 (local address 127.0.0.1:55280)
0808 11:34:30.793427 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.793526 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260808 11:34:30.794755 8481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.794411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:38899 (local address 127.0.0.1:55294)
0808 11:34:30.794562 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.794641 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 11:34:30.794991 8478 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.188:38899: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
W20260808 11:34:30.892056 8563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:34:30.892382 8563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
I20260808 11:34:30.892379 8555 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } attempt: 4
W20260808 11:34:30.892529 8563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 11:34:30.893564 8559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.893024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:38899 (local address 127.0.0.1:55300)
0808 11:34:30.893255 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.893362 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260808 11:34:30.894619 8559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.894253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:38899 (local address 127.0.0.1:55308)
0808 11:34:30.894411 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.894494 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 11:34:30.894840 8555 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.188:38899: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
W20260808 11:34:30.900699 8563 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:34:30.900853 8563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:34:30.900957 8563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:34:30.901059 8563 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:34:30.901144 8563 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:34:30.901242 8478 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } attempt: 3
I20260808 11:34:30.902252 8481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.901808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:38899 (local address 127.0.0.1:55310)
0808 11:34:30.901992 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.902096 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260808 11:34:30.903280 8481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.902902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:38899 (local address 127.0.0.1:55326)
0808 11:34:30.903087 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:30.903169 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
W20260808 11:34:30.903491 8478 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.188:38899: Network error: Client connection negotiation failed: client connection to 127.26.66.188:38899: connect: Connection refused (error 111)
I20260808 11:34:30.911242 8563 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:40869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:45113,127.26.66.189:34281,127.26.66.188:38899
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.188.keytab
--principal=kudu/127.26.66.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.188:38899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.66.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:34:30.912886 8563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:34:30.914211 8563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:34:30.926457 8571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:30.926517 8570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:30.926857 8573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:30.927309 8563 server_base.cc:1034] running on GCE node
I20260808 11:34:30.928094 8563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:34:30.929452 8563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:34:30.930667 8563 hybrid_clock.cc:648] HybridClock initialized: now 1786188870930609 us; error 42 us; skew 500 ppm
I20260808 11:34:30.931051 8563 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:34:30 dist-test-slave-zkpd krb5kdc[8395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188870, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:34:30.934188 8563 init.cc:377] Logged in from keytab as kudu/127.26.66.188@KRBTEST.COM (short username kudu)
I20260808 11:34:30.935663 8563 webserver.cc:460] Webserver started at http://127.26.66.188:35963/ using document root <none> and password file <none>
I20260808 11:34:30.936411 8563 fs_manager.cc:359] Metadata directory not provided
I20260808 11:34:30.936545 8563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:34:30.936858 8563 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:34:30.939945 8563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-2/data/instance:
uuid: "053d61233a6f4d178e78a9d5a01a1a96"
format_stamp: "Formatted at 2026-08-08 11:34:30 on dist-test-slave-zkpd"
server_key: "a7f87cfb2e3b3824b3e4e8d7799002ea"
server_key_iv: "d8a75665fbfcd5868615d36dcbf6fdc6"
server_key_version: "encryptionkey@0"
I20260808 11:34:30.940812 8563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-2/wal/instance:
uuid: "053d61233a6f4d178e78a9d5a01a1a96"
format_stamp: "Formatted at 2026-08-08 11:34:30 on dist-test-slave-zkpd"
server_key: "a7f87cfb2e3b3824b3e4e8d7799002ea"
server_key_iv: "d8a75665fbfcd5868615d36dcbf6fdc6"
server_key_version: "encryptionkey@0"
I20260808 11:34:30.946151 8563 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 11:34:30.949930 8581 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:30.951267 8563 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 11:34:30.951411 8563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-2/wal
uuid: "053d61233a6f4d178e78a9d5a01a1a96"
format_stamp: "Formatted at 2026-08-08 11:34:30 on dist-test-slave-zkpd"
server_key: "a7f87cfb2e3b3824b3e4e8d7799002ea"
server_key_iv: "d8a75665fbfcd5868615d36dcbf6fdc6"
server_key_version: "encryptionkey@0"
I20260808 11:34:30.951561 8563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:34:30.966747 8563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:34:30.970590 8563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:34:30.970816 8563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:34:30.989917 8563 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.188:38899
I20260808 11:34:30.989951 8637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.188:38899 every 8 connection(s)
I20260808 11:34:30.991238 8563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-2/data/info.pb
I20260808 11:34:30.994277 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 8563
I20260808 11:34:30.994496 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786188664137852-26890-0/minicluster-data/master-2/wal/instance
I20260808 11:34:30.995107 26890 external_mini_cluster.cc:1428] Setting key 8dd256d10411120e99cec2fd53ba28c0
I20260808 11:34:30.995396 8638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:34:31.005451 8638 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45113 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 11:34:31 dist-test-slave-zkpd krb5kdc[8395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.188@KRBTEST.COM
Aug 08 11:34:31 dist-test-slave-zkpd krb5kdc[8395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188870, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.188@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:34:31.019713 8641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:30.997066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55332 (local address 127.26.66.188:38899)
0808 11:34:30.997889 (+ 823us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:30.997900 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:30.997940 (+ 40us) server_negotiation.cc:407] Connection header received
0808 11:34:31.000396 (+ 2456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:31.000417 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:31.000783 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:31.001117 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:31.002916 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.004325 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.006251 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.006976 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.007106 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:31.012292 (+ 5186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:31.012301 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:31.012311 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:31.012345 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:31.015589 (+ 3244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:31.016406 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:31.016415 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:31.016422 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:31.016607 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:31.017027 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:31.017032 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:31.017035 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:31.017522 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:31.017833 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:31.018271 (+ 438us) server_negotiation.cc:299] Negotiation successful
0808 11:34:31.018703 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":618,"thread_start_us":390,"threads_started":1}
I20260808 11:34:31.023205 8558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:31.008506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44422 (local address 127.26.66.190:45113)
0808 11:34:31.008719 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:31.008727 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:31.009433 (+ 706us) server_negotiation.cc:407] Connection header received
0808 11:34:31.009620 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:31.009627 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:31.009741 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:31.009878 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:31.011053 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.011792 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.013252 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.013686 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.013870 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:31.017131 (+ 3261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:31.017136 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:31.017139 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:31.017169 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:31.020056 (+ 2887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:31.020785 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:31.020793 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:31.020799 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:31.020984 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:31.021461 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:31.021466 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:31.021469 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:31.021741 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:31.021933 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:31.022551 (+ 618us) server_negotiation.cc:299] Negotiation successful
0808 11:34:31.022775 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 11:34:31.023236 8642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:31.008483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45113 (local address 127.0.0.1:44422)
0808 11:34:31.009268 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:31.009319 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:31.009473 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:31.009912 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:31.009917 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:31.010502 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:34:31.010881 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:31.010896 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.012004 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.012010 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:31.013095 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:31.013108 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.013902 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.013909 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:31.014088 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:31.014705 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:34:31.014721 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:34:31.016933 (+ 2212us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:34:31.020205 (+ 3272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:31.020216 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:31.020223 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:31.020654 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:31.021143 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:31.021148 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:31.021151 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:31.021324 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:31.021988 (+ 664us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:34:31.021995 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:34:31.022166 (+ 171us) client_negotiation.cc:769] Sending connection context
0808 11:34:31.022372 (+ 206us) client_negotiation.cc:240] Negotiation successful
0808 11:34:31.022724 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":407,"threads_started":1}
I20260808 11:34:31.024788 8638 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 11:34:31 dist-test-slave-zkpd krb5kdc[8395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188870, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.188@KRBTEST.COM for kudu/127.26.66.189@KRBTEST.COM
Aug 08 11:34:31 dist-test-slave-zkpd krb5kdc[8395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:34:31.039868 8642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:31.025616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:34281 (local address 127.0.0.1:52322)
0808 11:34:31.025792 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:31.025812 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:31.025904 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:31.026196 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:31.026201 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:31.026646 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:34:31.026819 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:31.026833 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.028238 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.028241 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:31.029531 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:31.029543 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.030466 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.030470 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:31.030614 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:31.031173 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:34:31.031188 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:34:31.033357 (+ 2169us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:34:31.036967 (+ 3610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:31.036973 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:31.036978 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:31.037525 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:31.038020 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:31.038037 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:31.038043 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:31.038245 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:31.038960 (+ 715us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:34:31.038965 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:34:31.039154 (+ 189us) client_negotiation.cc:769] Sending connection context
0808 11:34:31.039323 (+ 169us) client_negotiation.cc:240] Negotiation successful
0808 11:34:31.039614 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 11:34:31.040149 8560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:31.025747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52322 (local address 127.26.66.189:34281)
0808 11:34:31.025908 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:31.025912 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:31.025928 (+ 16us) server_negotiation.cc:407] Connection header received
0808 11:34:31.025999 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:31.026003 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:31.026057 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:31.026133 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:31.027004 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.028089 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.029682 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.030309 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.030439 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:31.033562 (+ 3123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:31.033570 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:31.033575 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:31.033627 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:31.036816 (+ 3189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:31.037681 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:31.037685 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:31.037688 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:31.037885 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:31.038373 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:31.038381 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:31.038384 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:31.038743 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:31.038915 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:31.039454 (+ 539us) server_negotiation.cc:299] Negotiation successful
0808 11:34:31.039696 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 11:34:31.041162 8643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:31.022639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44438 (local address 127.26.66.190:45113)
0808 11:34:31.023342 (+ 703us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:31.023348 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:31.023674 (+ 326us) server_negotiation.cc:407] Connection header received
0808 11:34:31.023871 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:31.023876 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:31.023968 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:31.024075 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:31.025614 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.026877 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.028586 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.029221 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.029364 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:31.034603 (+ 5239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:31.034612 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:31.034618 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:31.034663 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:31.037988 (+ 3325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:31.038870 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:31.038875 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:31.038878 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:31.039023 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:31.039475 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:31.039479 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:31.039482 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:31.039848 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:31.040177 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:31.040587 (+ 410us) server_negotiation.cc:299] Negotiation successful
0808 11:34:31.040785 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":515,"thread_start_us":281,"threads_started":1}
I20260808 11:34:31.041465 8638 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 11:34:31 dist-test-slave-zkpd krb5kdc[8395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188870, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.188@KRBTEST.COM for kudu/127.26.66.188@KRBTEST.COM
Aug 08 11:34:31 dist-test-slave-zkpd krb5kdc[8395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.189@KRBTEST.COM
I20260808 11:34:31.056747 8642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:31.042554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:38899 (local address 127.0.0.1:55344)
0808 11:34:31.042857 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:31.042877 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:31.042985 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:31.043390 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:31.043396 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:31.043858 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:34:31.044074 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:31.044083 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.045493 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.045499 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:31.046779 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:31.046791 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.047711 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.047715 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:31.047861 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:31.048486 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:34:31.048509 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:34:31.050619 (+ 2110us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:34:31.054048 (+ 3429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:31.054054 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:31.054058 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:31.054552 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:31.054999 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:31.055005 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:31.055008 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:31.055134 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:31.055640 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:34:31.055645 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:34:31.055806 (+ 161us) client_negotiation.cc:769] Sending connection context
0808 11:34:31.056007 (+ 201us) client_negotiation.cc:240] Negotiation successful
0808 11:34:31.056318 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186}
I20260808 11:34:31.056825 8641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:31.042535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55344 (local address 127.26.66.188:38899)
0808 11:34:31.042739 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:31.042744 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:31.042960 (+ 216us) server_negotiation.cc:407] Connection header received
0808 11:34:31.043125 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:31.043131 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:31.043202 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:31.043302 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:31.044222 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.045366 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.046915 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.047555 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.047685 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:31.050803 (+ 3118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:31.050811 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:31.050816 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:31.050872 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:31.053918 (+ 3046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:31.054710 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:31.054715 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:31.054719 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:31.054889 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:31.055243 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:31.055250 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:31.055253 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:31.055524 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:31.055675 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:31.056103 (+ 428us) server_negotiation.cc:299] Negotiation successful
0808 11:34:31.056471 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":146,"server-negotiator.queue_time_us":67}
I20260808 11:34:31.060004 8560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:31.043214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52338 (local address 127.26.66.189:34281)
0808 11:34:31.043381 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:31.043387 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:31.043404 (+ 17us) server_negotiation.cc:407] Connection header received
0808 11:34:31.043447 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:31.043454 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:31.043521 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:31.043625 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:31.045259 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.046351 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.048085 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.048721 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.048867 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:31.053850 (+ 4983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:31.053855 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:31.053858 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:31.053887 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:31.057080 (+ 3193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:31.057857 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:31.057862 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:31.057864 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:31.058030 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:31.058419 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:31.058424 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:31.058427 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:31.058800 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:31.059103 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:31.059390 (+ 287us) server_negotiation.cc:299] Negotiation successful
0808 11:34:31.059600 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 11:34:31.063194 8638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 053d61233a6f4d178e78a9d5a01a1a96: Bootstrap starting.
I20260808 11:34:31.064913 26890 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 11:34:31.066943 8638 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 053d61233a6f4d178e78a9d5a01a1a96: Neither blocks nor log segments found. Creating new log.
I20260808 11:34:31.068125 8638 log.cc:824] T 00000000000000000000000000000000 P 053d61233a6f4d178e78a9d5a01a1a96: Log is configured to *not* fsync() on all Append() calls
I20260808 11:34:31.071275 8638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 053d61233a6f4d178e78a9d5a01a1a96: No bootstrap required, opened a new log
I20260808 11:34:31.080737 8478 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } attempt: 4
I20260808 11:34:31.080757 8638 raft_consensus.cc:348] T 00000000000000000000000000000000 P 053d61233a6f4d178e78a9d5a01a1a96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45113 } } peers { permanent_uuid: "3e39d5ef20634ee3a4ad90bc7702d99b" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 } } peers { permanent_uuid: "053d61233a6f4d178e78a9d5a01a1a96" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } }
I20260808 11:34:31.081223 8638 raft_consensus.cc:374] T 00000000000000000000000000000000 P 053d61233a6f4d178e78a9d5a01a1a96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:34:31.081373 8638 raft_consensus.cc:729] T 00000000000000000000000000000000 P 053d61233a6f4d178e78a9d5a01a1a96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 053d61233a6f4d178e78a9d5a01a1a96, State: Initialized, Role: FOLLOWER
I20260808 11:34:31.082176 8638 consensus_queue.cc:260] T 00000000000000000000000000000000 P 053d61233a6f4d178e78a9d5a01a1a96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45113 } } peers { permanent_uuid: "3e39d5ef20634ee3a4ad90bc7702d99b" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 } } peers { permanent_uuid: "053d61233a6f4d178e78a9d5a01a1a96" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } }
I20260808 11:34:31.089697 8654 sys_catalog.cc:455] T 00000000000000000000000000000000 P 053d61233a6f4d178e78a9d5a01a1a96 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45113 } } peers { permanent_uuid: "3e39d5ef20634ee3a4ad90bc7702d99b" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 } } peers { permanent_uuid: "053d61233a6f4d178e78a9d5a01a1a96" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } } }
I20260808 11:34:31.090091 8654 sys_catalog.cc:458] T 00000000000000000000000000000000 P 053d61233a6f4d178e78a9d5a01a1a96 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 11:34:31.092113 8638 sys_catalog.cc:564] T 00000000000000000000000000000000 P 053d61233a6f4d178e78a9d5a01a1a96 [sys.catalog]: configured and running, proceeding with master startup.
Aug 08 11:34:31 dist-test-slave-zkpd krb5kdc[8395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188869, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for kudu/127.26.66.188@KRBTEST.COM
I20260808 11:34:31.100113 8560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:31.070263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52354 (local address 127.26.66.189:34281)
0808 11:34:31.070616 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:31.070625 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:31.080178 (+ 9553us) server_negotiation.cc:407] Connection header received
0808 11:34:31.080380 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:31.080388 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:31.080521 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:31.080636 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:31.083420 (+ 2784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.084860 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.087396 (+ 2536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.088086 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.088199 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:31.092371 (+ 4172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:31.092380 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:31.092385 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:31.092429 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:31.096289 (+ 3860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:31.097322 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:31.097328 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:31.097331 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:31.097547 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:31.098052 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:31.098059 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:31.098064 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:31.098476 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:31.098733 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:31.099393 (+ 660us) server_negotiation.cc:299] Negotiation successful
0808 11:34:31.099652 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235}
I20260808 11:34:31.101781 8643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:31.070455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44446 (local address 127.26.66.190:45113)
0808 11:34:31.070711 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:31.070721 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:31.076599 (+ 5878us) server_negotiation.cc:407] Connection header received
0808 11:34:31.076864 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:31.076871 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:31.076954 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:31.077027 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:31.079763 (+ 2736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.080867 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.083302 (+ 2435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.084169 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.084284 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:31.089765 (+ 5481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:31.089773 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:31.089779 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:31.089836 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:31.096082 (+ 6246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:31.098410 (+ 2328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:31.098418 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:31.098425 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:31.098622 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:31.099303 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:31.099312 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:31.099317 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:31.099718 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:31.100042 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:31.101208 (+ 1166us) server_negotiation.cc:299] Negotiation successful
0808 11:34:31.101444 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 11:34:31.108534 8641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:31.070262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55354 (local address 127.26.66.188:38899)
0808 11:34:31.070465 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:31.070471 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:31.086763 (+ 16292us) server_negotiation.cc:407] Connection header received
0808 11:34:31.087239 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:31.087245 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:31.087317 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:31.087385 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:31.090729 (+ 3344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.091909 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.096570 (+ 4661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.097342 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.097472 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:31.101365 (+ 3893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:31.101371 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:31.101376 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:31.101415 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:31.105267 (+ 3852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:31.106138 (+ 871us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:31.106147 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:31.106153 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:31.106332 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:31.106880 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:31.106884 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:31.106887 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:31.107245 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:31.107515 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:31.107944 (+ 429us) server_negotiation.cc:299] Negotiation successful
0808 11:34:31.108246 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 11:34:31.110268 8481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:31.081333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:38899 (local address 127.0.0.1:55370)
0808 11:34:31.081847 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:31.081868 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:31.081982 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:31.085488 (+ 3506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:31.085494 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:31.086047 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:34:31.086270 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:31.086281 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.088310 (+ 2029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.088319 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:31.090035 (+ 1716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:31.090053 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.091214 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.091220 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:31.091451 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:31.092044 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:34:31.092066 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:34:31.095527 (+ 3461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:34:31.107056 (+ 11529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:31.107063 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:31.107081 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:31.107740 (+ 659us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:31.108332 (+ 592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:31.108339 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:31.108345 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:31.108519 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:31.109235 (+ 716us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:34:31.109244 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:34:31.109421 (+ 177us) client_negotiation.cc:769] Sending connection context
0808 11:34:31.109590 (+ 169us) client_negotiation.cc:240] Negotiation successful
0808 11:34:31.109906 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":372}
I20260808 11:34:31.110670 8653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:31.082202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55370 (local address 127.26.66.188:38899)
0808 11:34:31.084417 (+ 2215us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:31.084425 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:31.084449 (+ 24us) server_negotiation.cc:407] Connection header received
0808 11:34:31.084502 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:31.084507 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:31.084578 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:31.086456 (+ 1878us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:31.086805 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.088118 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.090346 (+ 2228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.091024 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.091739 (+ 715us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:31.097089 (+ 5350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:31.097099 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:31.097111 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:31.097173 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:31.106889 (+ 9716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:31.107942 (+ 1053us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:31.107950 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:31.107956 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:31.108172 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:31.108665 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:31.108670 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:31.108673 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:31.109045 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:31.109220 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:31.109761 (+ 541us) server_negotiation.cc:299] Negotiation successful
0808 11:34:31.110047 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":2088,"thread_start_us":1871,"threads_started":1}
I20260808 11:34:31.117869 8478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6: Bootstrap starting.
I20260808 11:34:31.121799 8478 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6: Neither blocks nor log segments found. Creating new log.
W20260808 11:34:31.122308 8666 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 053d61233a6f4d178e78a9d5a01a1a96: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 11:34:31.122505 8666 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 11:34:31.123296 8478 log.cc:824] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6: Log is configured to *not* fsync() on all Append() calls
I20260808 11:34:31.130313 8478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6: No bootstrap required, opened a new log
I20260808 11:34:31.119329 8563 master_runner.cc:186] Error getting master registration for 127.26.66.190:45113: OK, instance_id { permanent_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" instance_seqno: 1786188869937051 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 11:34:31.132546 8563 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 11:34:31.141510 8478 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45113 } } peers { permanent_uuid: "3e39d5ef20634ee3a4ad90bc7702d99b" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 } } peers { permanent_uuid: "053d61233a6f4d178e78a9d5a01a1a96" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } }
I20260808 11:34:31.141894 8478 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:34:31.142030 8478 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6734bb3604d14acfaf8ec3717f90d6a6, State: Initialized, Role: FOLLOWER
I20260808 11:34:31.142668 8478 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45113 } } peers { permanent_uuid: "3e39d5ef20634ee3a4ad90bc7702d99b" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 } } peers { permanent_uuid: "053d61233a6f4d178e78a9d5a01a1a96" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } }
I20260808 11:34:31.143558 8669 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45113 } } peers { permanent_uuid: "3e39d5ef20634ee3a4ad90bc7702d99b" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 } } peers { permanent_uuid: "053d61233a6f4d178e78a9d5a01a1a96" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } } }
I20260808 11:34:31.143927 8669 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 11:34:31.145015 8478 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 11:34:31.162658 8680 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 11:34:31.162839 8680 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 11:34:31.155807 8408 master_runner.cc:186] Error getting master registration for 127.26.66.189:34281: OK, instance_id { permanent_uuid: "3e39d5ef20634ee3a4ad90bc7702d99b" instance_seqno: 1786188870462155 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 11:34:31.165530 8408 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 11:34:31.175992 8430 tablet.cc:2369] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:34:31.194065 8555 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } attempt: 5
Aug 08 11:34:31 dist-test-slave-zkpd krb5kdc[8395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188870, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.189@KRBTEST.COM for kudu/127.26.66.188@KRBTEST.COM
I20260808 11:34:31.209519 8559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:31.194679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:38899 (local address 127.0.0.1:55374)
0808 11:34:31.194934 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:31.194955 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:31.195086 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:31.195440 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:31.195445 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:31.195981 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:34:31.196149 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:31.196159 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.197356 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.197363 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:31.198697 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:31.198714 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.200121 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.200127 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:31.200327 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:31.201013 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:34:31.201031 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:34:31.203193 (+ 2162us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:34:31.206589 (+ 3396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:31.206594 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:31.206598 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:31.207005 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:31.207408 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:31.207413 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:31.207417 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:31.207557 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:31.208422 (+ 865us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:34:31.208426 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:34:31.208610 (+ 184us) client_negotiation.cc:769] Sending connection context
0808 11:34:31.208784 (+ 174us) client_negotiation.cc:240] Negotiation successful
0808 11:34:31.209106 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145}
I20260808 11:34:31.209602 8653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:31.194723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55374 (local address 127.26.66.188:38899)
0808 11:34:31.194952 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:31.194959 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:31.195013 (+ 54us) server_negotiation.cc:407] Connection header received
0808 11:34:31.195224 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:31.195234 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:31.195293 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:31.195409 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:31.196323 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.197168 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.199061 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:31.199759 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:31.199917 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:31.203415 (+ 3498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:31.203420 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:31.203424 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:31.203453 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:31.206439 (+ 2986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:31.207134 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:31.207140 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:31.207143 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:31.207281 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:31.207673 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:31.207679 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:31.207682 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:31.208110 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:31.208351 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:31.208887 (+ 536us) server_negotiation.cc:299] Negotiation successful
0808 11:34:31.209150 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 11:34:31.215482 8555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e39d5ef20634ee3a4ad90bc7702d99b: Bootstrap starting.
I20260808 11:34:31.218729 8555 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e39d5ef20634ee3a4ad90bc7702d99b: Neither blocks nor log segments found. Creating new log.
I20260808 11:34:31.220646 8555 log.cc:824] T 00000000000000000000000000000000 P 3e39d5ef20634ee3a4ad90bc7702d99b: Log is configured to *not* fsync() on all Append() calls
W20260808 11:34:31.222851 8587 tablet.cc:2369] T 00000000000000000000000000000000 P 053d61233a6f4d178e78a9d5a01a1a96: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:34:31.224133 8555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e39d5ef20634ee3a4ad90bc7702d99b: No bootstrap required, opened a new log
I20260808 11:34:31.231122 8555 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3e39d5ef20634ee3a4ad90bc7702d99b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45113 } } peers { permanent_uuid: "3e39d5ef20634ee3a4ad90bc7702d99b" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 } } peers { permanent_uuid: "053d61233a6f4d178e78a9d5a01a1a96" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } }
I20260808 11:34:31.231480 8555 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3e39d5ef20634ee3a4ad90bc7702d99b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:34:31.231628 8555 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3e39d5ef20634ee3a4ad90bc7702d99b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e39d5ef20634ee3a4ad90bc7702d99b, State: Initialized, Role: FOLLOWER
I20260808 11:34:31.232364 8555 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e39d5ef20634ee3a4ad90bc7702d99b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45113 } } peers { permanent_uuid: "3e39d5ef20634ee3a4ad90bc7702d99b" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 } } peers { permanent_uuid: "053d61233a6f4d178e78a9d5a01a1a96" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } }
I20260808 11:34:31.236431 8555 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3e39d5ef20634ee3a4ad90bc7702d99b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:34:31.236158 8683 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e39d5ef20634ee3a4ad90bc7702d99b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45113 } } peers { permanent_uuid: "3e39d5ef20634ee3a4ad90bc7702d99b" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 } } peers { permanent_uuid: "053d61233a6f4d178e78a9d5a01a1a96" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } } }
I20260808 11:34:31.236691 8683 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e39d5ef20634ee3a4ad90bc7702d99b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 11:34:31.246212 8669 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:34:31.246598 8669 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45113 } } peers { permanent_uuid: "3e39d5ef20634ee3a4ad90bc7702d99b" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 } } peers { permanent_uuid: "053d61233a6f4d178e78a9d5a01a1a96" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } }
I20260808 11:34:31.248553 8669 leader_election.cc:288] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e39d5ef20634ee3a4ad90bc7702d99b (127.26.66.189:34281), 053d61233a6f4d178e78a9d5a01a1a96 (127.26.66.188:38899)
I20260808 11:34:31.251178 8608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "053d61233a6f4d178e78a9d5a01a1a96" is_pre_election: true
I20260808 11:34:31.252002 8608 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 053d61233a6f4d178e78a9d5a01a1a96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6734bb3604d14acfaf8ec3717f90d6a6 in term 0.
I20260808 11:34:31.253125 8427 leader_election.cc:302] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 053d61233a6f4d178e78a9d5a01a1a96, 6734bb3604d14acfaf8ec3717f90d6a6; no voters:
I20260808 11:34:31.256143 8530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e39d5ef20634ee3a4ad90bc7702d99b" is_pre_election: true
I20260808 11:34:31.256704 8530 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3e39d5ef20634ee3a4ad90bc7702d99b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6734bb3604d14acfaf8ec3717f90d6a6 in term 0.
I20260808 11:34:31.257860 8669 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260808 11:34:31.257980 8694 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3e39d5ef20634ee3a4ad90bc7702d99b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260808 11:34:31.258033 8669 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260808 11:34:31.258096 8694 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 11:34:31.258167 8669 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:34:31.264019 8486 master_runner.cc:263] No leader master found from master 3e39d5ef20634ee3a4ad90bc7702d99b
I20260808 11:34:31.264158 8486 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 11:34:31.265235 8669 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45113 } } peers { permanent_uuid: "3e39d5ef20634ee3a4ad90bc7702d99b" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 } } peers { permanent_uuid: "053d61233a6f4d178e78a9d5a01a1a96" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } }
I20260808 11:34:31.266512 8530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e39d5ef20634ee3a4ad90bc7702d99b"
I20260808 11:34:31.266726 8530 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3e39d5ef20634ee3a4ad90bc7702d99b [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:34:31.270228 8530 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3e39d5ef20634ee3a4ad90bc7702d99b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6734bb3604d14acfaf8ec3717f90d6a6 in term 1.
I20260808 11:34:31.272876 8424 leader_election.cc:302] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e39d5ef20634ee3a4ad90bc7702d99b, 6734bb3604d14acfaf8ec3717f90d6a6; no voters:
I20260808 11:34:31.276360 8696 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:34:31.277222 8608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "053d61233a6f4d178e78a9d5a01a1a96"
I20260808 11:34:31.277455 8608 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 053d61233a6f4d178e78a9d5a01a1a96 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:34:31.281095 8608 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 053d61233a6f4d178e78a9d5a01a1a96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6734bb3604d14acfaf8ec3717f90d6a6 in term 1.
I20260808 11:34:31.281610 8669 leader_election.cc:288] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [CANDIDATE]: Term 1 election: Requested vote from peers 3e39d5ef20634ee3a4ad90bc7702d99b (127.26.66.189:34281), 053d61233a6f4d178e78a9d5a01a1a96 (127.26.66.188:38899)
I20260808 11:34:31.284337 8696 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [term 1 LEADER]: Becoming Leader. State: Replica: 6734bb3604d14acfaf8ec3717f90d6a6, State: Running, Role: LEADER
I20260808 11:34:31.285120 8696 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45113 } } peers { permanent_uuid: "3e39d5ef20634ee3a4ad90bc7702d99b" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 } } peers { permanent_uuid: "053d61233a6f4d178e78a9d5a01a1a96" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } }
I20260808 11:34:31.306074 8669 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6734bb3604d14acfaf8ec3717f90d6a6. Latest consensus state: current_term: 1 leader_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45113 } } peers { permanent_uuid: "3e39d5ef20634ee3a4ad90bc7702d99b" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 } } peers { permanent_uuid: "053d61233a6f4d178e78a9d5a01a1a96" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } } }
I20260808 11:34:31.306407 8669 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [sys.catalog]: This master's current role is: LEADER
I20260808 11:34:31.320518 8699 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:34:31.322793 8699 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:34:31.341643 8608 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 053d61233a6f4d178e78a9d5a01a1a96 [term 1 FOLLOWER]: Refusing update from remote peer 6734bb3604d14acfaf8ec3717f90d6a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:34:31.342803 8669 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053d61233a6f4d178e78a9d5a01a1a96" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:34:31.351766 8530 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3e39d5ef20634ee3a4ad90bc7702d99b [term 1 FOLLOWER]: Refusing update from remote peer 6734bb3604d14acfaf8ec3717f90d6a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:34:31.353221 8669 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e39d5ef20634ee3a4ad90bc7702d99b" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:34:31.380138 8683 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e39d5ef20634ee3a4ad90bc7702d99b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6734bb3604d14acfaf8ec3717f90d6a6. Latest consensus state: current_term: 1 leader_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45113 } } peers { permanent_uuid: "3e39d5ef20634ee3a4ad90bc7702d99b" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 } } peers { permanent_uuid: "053d61233a6f4d178e78a9d5a01a1a96" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } } }
I20260808 11:34:31.380499 8683 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e39d5ef20634ee3a4ad90bc7702d99b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 11:34:31.382683 8700 mvcc.cc:205] Tried to move back new op lower bound from 7316229617002565632 to 7316229616789794816. Current Snapshot: MvccSnapshot[applied={T|T < 7316229617002565632}]
I20260808 11:34:31.383606 8702 mvcc.cc:205] Tried to move back new op lower bound from 7316229617002565632 to 7316229616789794816. Current Snapshot: MvccSnapshot[applied={T|T < 7316229617002565632}]
I20260808 11:34:31.387710 8654 sys_catalog.cc:455] T 00000000000000000000000000000000 P 053d61233a6f4d178e78a9d5a01a1a96 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6734bb3604d14acfaf8ec3717f90d6a6. Latest consensus state: current_term: 1 leader_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45113 } } peers { permanent_uuid: "3e39d5ef20634ee3a4ad90bc7702d99b" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 } } peers { permanent_uuid: "053d61233a6f4d178e78a9d5a01a1a96" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } } }
I20260808 11:34:31.388543 8654 sys_catalog.cc:458] T 00000000000000000000000000000000 P 053d61233a6f4d178e78a9d5a01a1a96 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 11:34:31.392437 8669 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45113 } } peers { permanent_uuid: "3e39d5ef20634ee3a4ad90bc7702d99b" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 } } peers { permanent_uuid: "053d61233a6f4d178e78a9d5a01a1a96" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } } }
I20260808 11:34:31.392712 8669 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [sys.catalog]: This master's current role is: LEADER
I20260808 11:34:31.394200 8669 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45113 } } peers { permanent_uuid: "3e39d5ef20634ee3a4ad90bc7702d99b" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 } } peers { permanent_uuid: "053d61233a6f4d178e78a9d5a01a1a96" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } } }
I20260808 11:34:31.394461 8669 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6 [sys.catalog]: This master's current role is: LEADER
I20260808 11:34:31.395134 8699 catalog_manager.cc:1347] Generated new cluster ID: b425055a8a5e432eb85b384eec1950b8
I20260808 11:34:31.395241 8699 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:34:31.398573 8701 mvcc.cc:205] Tried to move back new op lower bound from 7316229617002565632 to 7316229616789794816. Current Snapshot: MvccSnapshot[applied={T|T < 7316229617002565632}]
I20260808 11:34:31.402225 8654 sys_catalog.cc:455] T 00000000000000000000000000000000 P 053d61233a6f4d178e78a9d5a01a1a96 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45113 } } peers { permanent_uuid: "3e39d5ef20634ee3a4ad90bc7702d99b" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 } } peers { permanent_uuid: "053d61233a6f4d178e78a9d5a01a1a96" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } } }
I20260808 11:34:31.402498 8654 sys_catalog.cc:458] T 00000000000000000000000000000000 P 053d61233a6f4d178e78a9d5a01a1a96 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 11:34:31.416381 8683 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e39d5ef20634ee3a4ad90bc7702d99b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6734bb3604d14acfaf8ec3717f90d6a6" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45113 } } peers { permanent_uuid: "3e39d5ef20634ee3a4ad90bc7702d99b" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 34281 } } peers { permanent_uuid: "053d61233a6f4d178e78a9d5a01a1a96" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 38899 } } }
I20260808 11:34:31.416667 8683 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e39d5ef20634ee3a4ad90bc7702d99b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 11:34:31.435593 8699 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:34:31.437813 8699 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:34:31.456163 8699 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6734bb3604d14acfaf8ec3717f90d6a6: Generated new TSK 0
I20260808 11:34:31.457194 8699 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:34:32.124662 8666 catalog_manager.cc:1259] Loaded cluster ID: b425055a8a5e432eb85b384eec1950b8
I20260808 11:34:32.124778 8666 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 053d61233a6f4d178e78a9d5a01a1a96: loading cluster ID for follower catalog manager: success
I20260808 11:34:32.127398 8666 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 053d61233a6f4d178e78a9d5a01a1a96: acquiring CA information for follower catalog manager: success
I20260808 11:34:32.129257 8666 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 053d61233a6f4d178e78a9d5a01a1a96: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 11:34:32.260149 8694 catalog_manager.cc:1259] Loaded cluster ID: b425055a8a5e432eb85b384eec1950b8
I20260808 11:34:32.260246 8694 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3e39d5ef20634ee3a4ad90bc7702d99b: loading cluster ID for follower catalog manager: success
I20260808 11:34:32.262740 8694 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3e39d5ef20634ee3a4ad90bc7702d99b: acquiring CA information for follower catalog manager: success
I20260808 11:34:32.264632 8694 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3e39d5ef20634ee3a4ad90bc7702d99b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 11:34:32.653342 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 8408
I20260808 11:34:32.654489 8473 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:34:32.769706 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 8408
I20260808 11:34:32.796307 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 8486
I20260808 11:34:32.797492 8550 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:34:32.906889 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 8486
I20260808 11:34:32.931146 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 8563
I20260808 11:34:32.932386 8632 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:34:33.042513 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 8563
2026-08-08T11:34:33Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5001 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:34:33 dist-test-slave-zkpd krb5kdc[8720](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:34:33 dist-test-slave-zkpd krb5kdc[8720](info): set up 2 sockets
Aug 08 11:34:33 dist-test-slave-zkpd krb5kdc[8720](info): commencing operation
krb5kdc: starting...
W20260808 11:34:34.213979 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.001s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:34:34 dist-test-slave-zkpd krb5kdc[8720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:34:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:34:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:34:34.523988 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:33261
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:45355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:33261
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:34:34.864892 8733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:34:34.865249 8733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:34:34.865437 8733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:34:34.872608 8733 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:34:34.872763 8733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:34:34.872891 8733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:34:34.873005 8733 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:34:34.873102 8733 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:34:34.882850 8733 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:33261
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:33261
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:34:34.884202 8733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:34:34.885565 8733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:34:34.897842 8739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:34.897907 8740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:34.897910 8742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:34.898742 8733 server_base.cc:1034] running on GCE node
I20260808 11:34:34.899479 8733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:34:34.900959 8733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:34:34.902194 8733 hybrid_clock.cc:648] HybridClock initialized: now 1786188874902145 us; error 30 us; skew 500 ppm
I20260808 11:34:34.902561 8733 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:34:34 dist-test-slave-zkpd krb5kdc[8720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188874, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:34:34.905722 8733 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:34:34.907251 8733 webserver.cc:460] Webserver started at http://127.26.66.190:36715/ using document root <none> and password file <none>
I20260808 11:34:34.908032 8733 fs_manager.cc:359] Metadata directory not provided
I20260808 11:34:34.908205 8733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:34:34.908555 8733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:34:34.911598 8733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "d06571f7390d4b0d88ca74010935594b"
format_stamp: "Formatted at 2026-08-08 11:34:34 on dist-test-slave-zkpd"
server_key: "207a66a94c58ec1826f3cfd0012ce877"
server_key_iv: "b5e09fb5358cb0daa1763dd24b915dc6"
server_key_version: "encryptionkey@0"
I20260808 11:34:34.912415 8733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "d06571f7390d4b0d88ca74010935594b"
format_stamp: "Formatted at 2026-08-08 11:34:34 on dist-test-slave-zkpd"
server_key: "207a66a94c58ec1826f3cfd0012ce877"
server_key_iv: "b5e09fb5358cb0daa1763dd24b915dc6"
server_key_version: "encryptionkey@0"
I20260808 11:34:34.917554 8733 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 11:34:34.920922 8749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:34.922260 8733 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:34:34.922456 8733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "d06571f7390d4b0d88ca74010935594b"
format_stamp: "Formatted at 2026-08-08 11:34:34 on dist-test-slave-zkpd"
server_key: "207a66a94c58ec1826f3cfd0012ce877"
server_key_iv: "b5e09fb5358cb0daa1763dd24b915dc6"
server_key_version: "encryptionkey@0"
I20260808 11:34:34.922659 8733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:34:34.937552 8733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:34:34.941680 8733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:34:34.941978 8733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:34:34.959792 8733 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:33261
I20260808 11:34:34.959831 8803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:33261 every 8 connection(s)
I20260808 11:34:34.961302 8733 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:34:34.965152 8804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:34:34.971199 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 8733
I20260808 11:34:34.971442 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:34:34.972206 26890 external_mini_cluster.cc:1428] Setting key 0a504c836672c6320cd9e5fa2b06c25d
I20260808 11:34:34.977007 8804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d06571f7390d4b0d88ca74010935594b: Bootstrap starting.
I20260808 11:34:34.980973 8804 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d06571f7390d4b0d88ca74010935594b: Neither blocks nor log segments found. Creating new log.
I20260808 11:34:34.982265 8804 log.cc:824] T 00000000000000000000000000000000 P d06571f7390d4b0d88ca74010935594b: Log is configured to *not* fsync() on all Append() calls
I20260808 11:34:34.985589 8804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d06571f7390d4b0d88ca74010935594b: No bootstrap required, opened a new log
Aug 08 11:34:34 dist-test-slave-zkpd krb5kdc[8720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:34:34.996358 8804 raft_consensus.cc:348] T 00000000000000000000000000000000 P d06571f7390d4b0d88ca74010935594b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d06571f7390d4b0d88ca74010935594b" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 33261 } }
I20260808 11:34:34.996886 8804 raft_consensus.cc:374] T 00000000000000000000000000000000 P d06571f7390d4b0d88ca74010935594b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:34:34.996994 8804 raft_consensus.cc:729] T 00000000000000000000000000000000 P d06571f7390d4b0d88ca74010935594b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d06571f7390d4b0d88ca74010935594b, State: Initialized, Role: FOLLOWER
I20260808 11:34:34.997737 8804 consensus_queue.cc:260] T 00000000000000000000000000000000 P d06571f7390d4b0d88ca74010935594b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d06571f7390d4b0d88ca74010935594b" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 33261 } }
I20260808 11:34:34.998028 8804 raft_consensus.cc:388] T 00000000000000000000000000000000 P d06571f7390d4b0d88ca74010935594b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:34:34.998188 8804 raft_consensus.cc:482] T 00000000000000000000000000000000 P d06571f7390d4b0d88ca74010935594b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:34:34.998386 8804 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d06571f7390d4b0d88ca74010935594b [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:34:34.998958 8807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:34.974251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51072 (local address 127.26.66.190:33261)
0808 11:34:34.975119 (+ 868us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:34.975134 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:34.975182 (+ 48us) server_negotiation.cc:407] Connection header received
0808 11:34:34.977617 (+ 2435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:34.977644 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:34.978119 (+ 475us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:34.978576 (+ 457us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:34.980000 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:34.982026 (+ 2026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:34.983844 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:34.984905 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:34.985092 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:34.990040 (+ 4948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:34.990050 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:34.990068 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:34.990111 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:34.994200 (+ 4089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:34.994938 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:34.994947 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:34.994960 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:34.995179 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:34.995678 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:34.995683 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:34.995686 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:34.996415 (+ 729us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:34.996746 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:34.997343 (+ 597us) server_negotiation.cc:299] Negotiation successful
0808 11:34:34.997746 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":361,"threads_started":1}
I20260808 11:34:35.001436 8804 raft_consensus.cc:504] T 00000000000000000000000000000000 P d06571f7390d4b0d88ca74010935594b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d06571f7390d4b0d88ca74010935594b" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 33261 } }
I20260808 11:34:35.001953 8804 leader_election.cc:302] T 00000000000000000000000000000000 P d06571f7390d4b0d88ca74010935594b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d06571f7390d4b0d88ca74010935594b; no voters:
I20260808 11:34:35.002660 8804 leader_election.cc:288] T 00000000000000000000000000000000 P d06571f7390d4b0d88ca74010935594b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:34:35.002785 8809 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d06571f7390d4b0d88ca74010935594b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:34:35.003046 26890 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 11:34:35.005357 8804 sys_catalog.cc:564] T 00000000000000000000000000000000 P d06571f7390d4b0d88ca74010935594b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:34:35.005801 8809 raft_consensus.cc:686] T 00000000000000000000000000000000 P d06571f7390d4b0d88ca74010935594b [term 1 LEADER]: Becoming Leader. State: Replica: d06571f7390d4b0d88ca74010935594b, State: Running, Role: LEADER
I20260808 11:34:35.006496 8809 consensus_queue.cc:237] T 00000000000000000000000000000000 P d06571f7390d4b0d88ca74010935594b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d06571f7390d4b0d88ca74010935594b" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 33261 } }
I20260808 11:34:35.009932 8811 sys_catalog.cc:455] T 00000000000000000000000000000000 P d06571f7390d4b0d88ca74010935594b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d06571f7390d4b0d88ca74010935594b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d06571f7390d4b0d88ca74010935594b" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 33261 } } }
I20260808 11:34:35.009984 8810 sys_catalog.cc:455] T 00000000000000000000000000000000 P d06571f7390d4b0d88ca74010935594b [sys.catalog]: SysCatalogTable state changed. Reason: New leader d06571f7390d4b0d88ca74010935594b. Latest consensus state: current_term: 1 leader_uuid: "d06571f7390d4b0d88ca74010935594b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d06571f7390d4b0d88ca74010935594b" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 33261 } } }
I20260808 11:34:35.010321 8811 sys_catalog.cc:458] T 00000000000000000000000000000000 P d06571f7390d4b0d88ca74010935594b [sys.catalog]: This master's current role is: LEADER
I20260808 11:34:35.010376 8810 sys_catalog.cc:458] T 00000000000000000000000000000000 P d06571f7390d4b0d88ca74010935594b [sys.catalog]: This master's current role is: LEADER
I20260808 11:34:35.016850 8821 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:34:35.021180 8821 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:34:35.030398 8821 catalog_manager.cc:1347] Generated new cluster ID: 72ff2342d6c740aba867497459d44e2f
I20260808 11:34:35.030536 8821 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:34:35.046612 8821 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:34:35.048599 8821 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:34:35.067472 8821 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d06571f7390d4b0d88ca74010935594b: Generated new TSK 0
I20260808 11:34:35.068596 8821 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:34:35.116073 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 8733
I20260808 11:34:35.117455 8799 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:34:35.217783 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 8733
2026-08-08T11:34:35Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2170 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:34:35 dist-test-slave-zkpd krb5kdc[8833](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:34:35 dist-test-slave-zkpd krb5kdc[8833](info): set up 2 sockets
Aug 08 11:34:35 dist-test-slave-zkpd krb5kdc[8833](info): commencing operation
krb5kdc: starting...
W20260808 11:34:36.381743 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.000s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:34:36 dist-test-slave-zkpd krb5kdc[8833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:34:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:34:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:34:36.679595 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:38927
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:45365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:38927
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:34:37.021958 8846 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:34:37.022224 8846 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:34:37.022413 8846 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:34:37.029680 8846 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:34:37.029781 8846 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:34:37.029879 8846 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:34:37.029989 8846 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:34:37.030081 8846 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:34:37.039785 8846 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:38927
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:38927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:34:37.041150 8846 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:34:37.042497 8846 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:34:37.054442 8852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:37.054548 8853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:37.054522 8855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:37.055672 8846 server_base.cc:1034] running on GCE node
I20260808 11:34:37.056687 8846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:34:37.058089 8846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:34:37.059303 8846 hybrid_clock.cc:648] HybridClock initialized: now 1786188877059263 us; error 27 us; skew 500 ppm
I20260808 11:34:37.059621 8846 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:34:37 dist-test-slave-zkpd krb5kdc[8833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188877, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:34:37.063076 8846 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:34:37.064702 8846 webserver.cc:460] Webserver started at http://127.26.66.190:34899/ using document root <none> and password file <none>
I20260808 11:34:37.065429 8846 fs_manager.cc:359] Metadata directory not provided
I20260808 11:34:37.065541 8846 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:34:37.065805 8846 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:34:37.069147 8846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "4c13ccee25ef462cbadc4201df8f7b24"
format_stamp: "Formatted at 2026-08-08 11:34:37 on dist-test-slave-zkpd"
server_key: "632573bae73682bde0ba99419233c243"
server_key_iv: "27989c41dc8e9e012fd0e2ec4827dbd2"
server_key_version: "encryptionkey@0"
I20260808 11:34:37.069911 8846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "4c13ccee25ef462cbadc4201df8f7b24"
format_stamp: "Formatted at 2026-08-08 11:34:37 on dist-test-slave-zkpd"
server_key: "632573bae73682bde0ba99419233c243"
server_key_iv: "27989c41dc8e9e012fd0e2ec4827dbd2"
server_key_version: "encryptionkey@0"
I20260808 11:34:37.075469 8846 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 11:34:37.078960 8862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:37.080349 8846 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:34:37.080539 8846 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "4c13ccee25ef462cbadc4201df8f7b24"
format_stamp: "Formatted at 2026-08-08 11:34:37 on dist-test-slave-zkpd"
server_key: "632573bae73682bde0ba99419233c243"
server_key_iv: "27989c41dc8e9e012fd0e2ec4827dbd2"
server_key_version: "encryptionkey@0"
I20260808 11:34:37.080731 8846 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:34:37.106977 8846 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:34:37.111261 8846 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:34:37.111581 8846 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:34:37.132089 8846 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:38927
I20260808 11:34:37.132083 8920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:38927 every 8 connection(s)
I20260808 11:34:37.133575 8846 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:34:37.137322 8921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:34:37.138931 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 8846
I20260808 11:34:37.139207 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:34:37.140177 26890 external_mini_cluster.cc:1428] Setting key 490f5990cd1ca897ca90b36bb819e869
I20260808 11:34:37.150734 8921 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24: Bootstrap starting.
I20260808 11:34:37.153998 8921 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24: Neither blocks nor log segments found. Creating new log.
I20260808 11:34:37.154990 8921 log.cc:824] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24: Log is configured to *not* fsync() on all Append() calls
Aug 08 11:34:37 dist-test-slave-zkpd krb5kdc[8833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:34:37.158313 8921 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24: No bootstrap required, opened a new log
I20260808 11:34:37.165026 8924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:37.142467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54326 (local address 127.26.66.190:38927)
0808 11:34:37.143361 (+ 894us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:37.143373 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:37.143414 (+ 41us) server_negotiation.cc:407] Connection header received
0808 11:34:37.145230 (+ 1816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:37.145253 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:37.145650 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:37.146041 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:37.147716 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:37.149320 (+ 1604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:37.150801 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:37.151582 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:37.151808 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:37.156800 (+ 4992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:37.156809 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:37.156823 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:37.156869 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:37.160503 (+ 3634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:37.161256 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:37.161269 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:37.161275 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:37.161451 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:37.161918 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:37.161924 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:37.161927 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:37.162518 (+ 591us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:37.162903 (+ 385us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:37.163426 (+ 523us) server_negotiation.cc:299] Negotiation successful
0808 11:34:37.163883 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":625,"thread_start_us":385,"threads_started":1}
I20260808 11:34:37.166786 8921 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c13ccee25ef462cbadc4201df8f7b24" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38927 } }
I20260808 11:34:37.167166 8921 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:34:37.167304 8921 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c13ccee25ef462cbadc4201df8f7b24, State: Initialized, Role: FOLLOWER
I20260808 11:34:37.168006 8921 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c13ccee25ef462cbadc4201df8f7b24" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38927 } }
I20260808 11:34:37.168309 8921 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:34:37.168506 8921 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:34:37.168708 8921 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:34:37.170858 8921 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c13ccee25ef462cbadc4201df8f7b24" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38927 } }
I20260808 11:34:37.171347 8921 leader_election.cc:302] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c13ccee25ef462cbadc4201df8f7b24; no voters:
I20260808 11:34:37.172031 8921 leader_election.cc:288] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:34:37.172135 8926 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:34:37.172940 8926 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [term 1 LEADER]: Becoming Leader. State: Replica: 4c13ccee25ef462cbadc4201df8f7b24, State: Running, Role: LEADER
I20260808 11:34:37.173501 8926 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c13ccee25ef462cbadc4201df8f7b24" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38927 } }
I20260808 11:34:37.174211 8921 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:34:37.176446 8927 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c13ccee25ef462cbadc4201df8f7b24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c13ccee25ef462cbadc4201df8f7b24" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38927 } } }
I20260808 11:34:37.176745 8929 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c13ccee25ef462cbadc4201df8f7b24. Latest consensus state: current_term: 1 leader_uuid: "4c13ccee25ef462cbadc4201df8f7b24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c13ccee25ef462cbadc4201df8f7b24" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38927 } } }
I20260808 11:34:37.176985 8927 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [sys.catalog]: This master's current role is: LEADER
I20260808 11:34:37.177055 8929 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [sys.catalog]: This master's current role is: LEADER
I20260808 11:34:37.178975 8935 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:34:37.184093 8935 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:34:37.192095 8935 catalog_manager.cc:1347] Generated new cluster ID: cf2de7a7d08c4e978ec487e638a701c1
I20260808 11:34:37.192260 8935 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:34:37.199244 8935 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:34:37.200826 8935 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:34:37.209627 8935 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24: Generated new TSK 0
I20260808 11:34:37.210592 8935 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.66.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
I20260808 11:34:37.292353 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:0
--local_ip_for_outbound_sockets=127.26.66.129
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:38927
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:45365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:34:37.636301 8948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:34:37.636619 8948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:34:37.636796 8948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:34:37.644556 8948 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:34:37.644701 8948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:34:37.644886 8948 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:34:37.654845 8948 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:38927
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:34:37.656213 8948 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:34:37.657725 8948 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:34:37.671007 8953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:37.670910 8956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:37.670974 8954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:37.671531 8948 server_base.cc:1034] running on GCE node
I20260808 11:34:37.672221 8948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:34:37.673040 8948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:34:37.674242 8948 hybrid_clock.cc:648] HybridClock initialized: now 1786188877674195 us; error 36 us; skew 500 ppm
I20260808 11:34:37.674606 8948 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:34:37 dist-test-slave-zkpd krb5kdc[8833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188877, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:34:37.678414 8948 init.cc:377] Logged in from keytab as kudu/127.26.66.129@KRBTEST.COM (short username kudu)
I20260808 11:34:37.680032 8948 webserver.cc:460] Webserver started at http://127.26.66.129:37711/ using document root <none> and password file <none>
I20260808 11:34:37.680735 8948 fs_manager.cc:359] Metadata directory not provided
I20260808 11:34:37.680878 8948 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:34:37.681205 8948 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:34:37.684227 8948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/data/instance:
uuid: "83de2e6f8f694a97954dd42fcf151df0"
format_stamp: "Formatted at 2026-08-08 11:34:37 on dist-test-slave-zkpd"
server_key: "fbd51893f19dfc59fed4522570c1ff22"
server_key_iv: "ec079e6729a22eb9d54ec1c6e032c620"
server_key_version: "encryptionkey@0"
I20260808 11:34:37.685024 8948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance:
uuid: "83de2e6f8f694a97954dd42fcf151df0"
format_stamp: "Formatted at 2026-08-08 11:34:37 on dist-test-slave-zkpd"
server_key: "fbd51893f19dfc59fed4522570c1ff22"
server_key_iv: "ec079e6729a22eb9d54ec1c6e032c620"
server_key_version: "encryptionkey@0"
I20260808 11:34:37.690034 8948 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260808 11:34:37.693475 8963 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:37.694787 8948 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260808 11:34:37.694962 8948 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "83de2e6f8f694a97954dd42fcf151df0"
format_stamp: "Formatted at 2026-08-08 11:34:37 on dist-test-slave-zkpd"
server_key: "fbd51893f19dfc59fed4522570c1ff22"
server_key_iv: "ec079e6729a22eb9d54ec1c6e032c620"
server_key_version: "encryptionkey@0"
I20260808 11:34:37.695150 8948 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:34:37.710345 8948 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:34:37.714203 8948 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:34:37.714491 8948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:34:37.715400 8948 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:34:37.716778 8948 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:34:37.716854 8948 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:37.717021 8948 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:34:37.717094 8948 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:37.751044 8948 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:34541
I20260808 11:34:37.751091 9082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:34541 every 8 connection(s)
I20260808 11:34:37.752346 8948 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:34:37.752753 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 8948
I20260808 11:34:37.752985 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance
I20260808 11:34:37.753928 26890 external_mini_cluster.cc:1428] Setting key d1ff32b9dbb7d673d4fe780f5aebd508
Aug 08 11:34:37 dist-test-slave-zkpd krb5kdc[8833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188877, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:34:37.774442 9086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:37.755076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:45459 (local address 127.26.66.190:38927)
0808 11:34:37.755593 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:37.755597 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:37.756796 (+ 1199us) server_negotiation.cc:407] Connection header received
0808 11:34:37.758724 (+ 1928us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:37.758732 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:37.758846 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:37.758964 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:37.760484 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:37.761639 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:37.763207 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:37.763952 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:37.764122 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:37.767668 (+ 3546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:37.767677 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:37.767685 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:37.767732 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:37.770879 (+ 3147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:37.771734 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:37.771742 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:37.771749 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:37.771931 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:37.772386 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:37.772393 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:37.772400 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:37.772777 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:37.772926 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:37.773622 (+ 696us) server_negotiation.cc:299] Negotiation successful
0808 11:34:37.773920 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":281,"threads_started":1}
I20260808 11:34:37.775115 9087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:37.755705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.129:45459)
0808 11:34:37.756614 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:37.756667 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:37.758454 (+ 1787us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:37.759159 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:37.759166 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:37.759641 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:34:37.760295 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:37.760313 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:37.761830 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:37.761834 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:37.763036 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:37.763049 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:37.764174 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:37.764179 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:37.764379 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:37.765064 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:34:37.765087 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:34:37.767421 (+ 2334us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:34:37.771043 (+ 3622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:37.771050 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:37.771091 (+ 41us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:37.771583 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:37.772057 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:37.772061 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:37.772064 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:37.772249 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:37.772911 (+ 662us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:34:37.772916 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:34:37.773212 (+ 296us) client_negotiation.cc:769] Sending connection context
0808 11:34:37.773441 (+ 229us) client_negotiation.cc:240] Negotiation successful
0808 11:34:37.773882 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":626,"thread_start_us":406,"threads_started":1}
I20260808 11:34:37.776760 9083 heartbeater.cc:347] Connected to a master server at 127.26.66.190:38927
I20260808 11:34:37.777076 9083 heartbeater.cc:464] Registering TS with master...
I20260808 11:34:37.777829 9083 heartbeater.cc:511] Master 127.26.66.190:38927 requested a full tablet report, sending...
I20260808 11:34:37.780057 8880 ts_manager.cc:194] Registered new tserver with Master: 83de2e6f8f694a97954dd42fcf151df0 (127.26.66.129:34541)
I20260808 11:34:37.781548 8880 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.129@KRBTEST.COM'} at 127.26.66.129:45459
WARNING: no policy specified for kudu/127.26.66.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
I20260808 11:34:37.824612 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:0
--local_ip_for_outbound_sockets=127.26.66.130
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:38927
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:45365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:34:38.169633 9090 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:34:38.169984 9090 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:34:38.170166 9090 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:34:38.177819 9090 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:34:38.177984 9090 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:34:38.178151 9090 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:34:38.188309 9090 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:38927
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:34:38.189527 9090 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:34:38.190832 9090 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:34:38.204491 9099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:38.204614 9095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:38.204521 9096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:38.205399 9090 server_base.cc:1034] running on GCE node
I20260808 11:34:38.205947 9090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:34:38.206779 9090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:34:38.208010 9090 hybrid_clock.cc:648] HybridClock initialized: now 1786188878207941 us; error 56 us; skew 500 ppm
I20260808 11:34:38.208343 9090 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:34:38 dist-test-slave-zkpd krb5kdc[8833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188878, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:34:38.218432 9090 init.cc:377] Logged in from keytab as kudu/127.26.66.130@KRBTEST.COM (short username kudu)
I20260808 11:34:38.220070 9090 webserver.cc:460] Webserver started at http://127.26.66.130:40775/ using document root <none> and password file <none>
I20260808 11:34:38.220813 9090 fs_manager.cc:359] Metadata directory not provided
I20260808 11:34:38.220966 9090 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:34:38.221328 9090 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:34:38.224344 9090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/data/instance:
uuid: "935961690c244bf08f6f6353a4a5e28b"
format_stamp: "Formatted at 2026-08-08 11:34:38 on dist-test-slave-zkpd"
server_key: "cfcb4e5432c52784d5b9b7ab9da507f6"
server_key_iv: "38532d2eef477462868c6941040772e4"
server_key_version: "encryptionkey@0"
I20260808 11:34:38.225142 9090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance:
uuid: "935961690c244bf08f6f6353a4a5e28b"
format_stamp: "Formatted at 2026-08-08 11:34:38 on dist-test-slave-zkpd"
server_key: "cfcb4e5432c52784d5b9b7ab9da507f6"
server_key_iv: "38532d2eef477462868c6941040772e4"
server_key_version: "encryptionkey@0"
I20260808 11:34:38.230289 9090 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 11:34:38.233840 9106 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:38.235551 9090 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 11:34:38.235739 9090 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "935961690c244bf08f6f6353a4a5e28b"
format_stamp: "Formatted at 2026-08-08 11:34:38 on dist-test-slave-zkpd"
server_key: "cfcb4e5432c52784d5b9b7ab9da507f6"
server_key_iv: "38532d2eef477462868c6941040772e4"
server_key_version: "encryptionkey@0"
I20260808 11:34:38.236034 9090 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:34:38.253933 9090 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:34:38.258157 9090 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:34:38.258462 9090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:34:38.259553 9090 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:34:38.261013 9090 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:34:38.261086 9090 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:38.261253 9090 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:34:38.261307 9090 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:38.295771 9090 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:46433
I20260808 11:34:38.295863 9227 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:46433 every 8 connection(s)
I20260808 11:34:38.297102 9090 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:34:38.302979 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 9090
I20260808 11:34:38.303196 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance
I20260808 11:34:38.303879 26890 external_mini_cluster.cc:1428] Setting key e5e1647e18ef0daeff939d81b78f2ddc
Aug 08 11:34:38 dist-test-slave-zkpd krb5kdc[8833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188878, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:34:38.319519 9230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:38.299670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:55967 (local address 127.26.66.190:38927)
0808 11:34:38.300250 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:38.300257 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:38.301149 (+ 892us) server_negotiation.cc:407] Connection header received
0808 11:34:38.303247 (+ 2098us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:38.303253 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:38.303390 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:38.303491 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:38.305424 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:38.306362 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:38.308931 (+ 2569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:38.309343 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:38.309437 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:38.313636 (+ 4199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:38.313641 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:38.313644 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:38.313674 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:38.316465 (+ 2791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:38.317202 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:38.317207 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:38.317212 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:38.317337 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:38.317783 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:38.317794 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:38.317797 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:38.318052 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:38.318211 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:38.318932 (+ 721us) server_negotiation.cc:299] Negotiation successful
0808 11:34:38.319149 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":287,"threads_started":1}
I20260808 11:34:38.320578 9231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:38.300254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.130:55967)
0808 11:34:38.300993 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:38.301031 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:38.302887 (+ 1856us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:38.303783 (+ 896us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:38.303804 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:38.304557 (+ 753us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:34:38.305241 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:38.305258 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:38.306533 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:38.306539 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:38.308772 (+ 2233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:38.308800 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:38.309578 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:38.309588 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:38.309909 (+ 321us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:38.310646 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:34:38.310686 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:34:38.313390 (+ 2704us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:34:38.316634 (+ 3244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:38.316642 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:38.316657 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:38.317067 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:38.317456 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:38.317461 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:38.317465 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:38.317655 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:38.318199 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:34:38.318207 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:34:38.318526 (+ 319us) client_negotiation.cc:769] Sending connection context
0808 11:34:38.318813 (+ 287us) client_negotiation.cc:240] Negotiation successful
0808 11:34:38.319340 (+ 527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":328,"threads_started":1}
I20260808 11:34:38.322136 9228 heartbeater.cc:347] Connected to a master server at 127.26.66.190:38927
I20260808 11:34:38.322469 9228 heartbeater.cc:464] Registering TS with master...
I20260808 11:34:38.323236 9228 heartbeater.cc:511] Master 127.26.66.190:38927 requested a full tablet report, sending...
I20260808 11:34:38.324820 8880 ts_manager.cc:194] Registered new tserver with Master: 935961690c244bf08f6f6353a4a5e28b (127.26.66.130:46433)
I20260808 11:34:38.325644 8880 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.130@KRBTEST.COM'} at 127.26.66.130:55967
WARNING: no policy specified for kudu/127.26.66.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
I20260808 11:34:38.373638 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:0
--local_ip_for_outbound_sockets=127.26.66.131
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:38927
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:45365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:34:38.714025 9234 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:34:38.714284 9234 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:34:38.714388 9234 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:34:38.721860 9234 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:34:38.721956 9234 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:34:38.722070 9234 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:34:38.731437 9234 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:38927
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:34:38.732657 9234 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:34:38.733916 9234 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:34:38.747318 9239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:38.747231 9240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:38.747270 9242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:38.748247 9234 server_base.cc:1034] running on GCE node
I20260808 11:34:38.748944 9234 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:34:38.749898 9234 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:34:38.751101 9234 hybrid_clock.cc:648] HybridClock initialized: now 1786188878751053 us; error 48 us; skew 500 ppm
I20260808 11:34:38.751420 9234 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:34:38 dist-test-slave-zkpd krb5kdc[8833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188878, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:34:38.754918 9234 init.cc:377] Logged in from keytab as kudu/127.26.66.131@KRBTEST.COM (short username kudu)
I20260808 11:34:38.756484 9234 webserver.cc:460] Webserver started at http://127.26.66.131:34561/ using document root <none> and password file <none>
I20260808 11:34:38.757154 9234 fs_manager.cc:359] Metadata directory not provided
I20260808 11:34:38.757310 9234 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:34:38.757629 9234 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:34:38.760540 9234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/data/instance:
uuid: "685331d0e8d74734a0ab7ab09eb23fa2"
format_stamp: "Formatted at 2026-08-08 11:34:38 on dist-test-slave-zkpd"
server_key: "67ceb4d21772a6b4125d3d00d3c2ae98"
server_key_iv: "458cf4843d11294d1c615862ddc5f97d"
server_key_version: "encryptionkey@0"
I20260808 11:34:38.761322 9234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance:
uuid: "685331d0e8d74734a0ab7ab09eb23fa2"
format_stamp: "Formatted at 2026-08-08 11:34:38 on dist-test-slave-zkpd"
server_key: "67ceb4d21772a6b4125d3d00d3c2ae98"
server_key_iv: "458cf4843d11294d1c615862ddc5f97d"
server_key_version: "encryptionkey@0"
I20260808 11:34:38.766307 9234 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 11:34:38.769706 9249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:38.770956 9234 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 11:34:38.771138 9234 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "685331d0e8d74734a0ab7ab09eb23fa2"
format_stamp: "Formatted at 2026-08-08 11:34:38 on dist-test-slave-zkpd"
server_key: "67ceb4d21772a6b4125d3d00d3c2ae98"
server_key_iv: "458cf4843d11294d1c615862ddc5f97d"
server_key_version: "encryptionkey@0"
I20260808 11:34:38.771343 9234 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:34:38.784583 9083 heartbeater.cc:503] Master 127.26.66.190:38927 was elected leader, sending a full tablet report...
I20260808 11:34:38.792594 9234 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:34:38.797266 9234 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:34:38.797588 9234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:34:38.798709 9234 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:34:38.800338 9234 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:34:38.800420 9234 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:38.800601 9234 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:34:38.800662 9234 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:38.835050 9234 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:37891
I20260808 11:34:38.835099 9367 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:37891 every 8 connection(s)
I20260808 11:34:38.836452 9234 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:34:38.844065 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 9234
I20260808 11:34:38.844269 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance
I20260808 11:34:38.844718 26890 external_mini_cluster.cc:1428] Setting key 4de49ef83d588c9e3877172af9e884b2
Aug 08 11:34:38 dist-test-slave-zkpd krb5kdc[8833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188878, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:34:38.856994 9370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:38.839360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:45277 (local address 127.26.66.190:38927)
0808 11:34:38.840019 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:38.840024 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:38.840793 (+ 769us) server_negotiation.cc:407] Connection header received
0808 11:34:38.842623 (+ 1830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:38.842629 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:38.842721 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:38.842856 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:38.844547 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:38.845558 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:38.847118 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:38.847535 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:38.847678 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:38.851051 (+ 3373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:38.851063 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:38.851066 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:38.851100 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:38.853823 (+ 2723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:38.854557 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:38.854563 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:38.854566 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:38.854688 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:38.855156 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:38.855161 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:38.855164 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:38.855444 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:38.855618 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:38.856394 (+ 776us) server_negotiation.cc:299] Negotiation successful
0808 11:34:38.856610 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":284,"threads_started":1}
I20260808 11:34:38.857956 9371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:38.839883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.131:45277)
0808 11:34:38.840624 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:38.840668 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:38.842341 (+ 1673us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:38.843103 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:38.843111 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:38.843600 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:34:38.844336 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:38.844383 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:38.845718 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:38.845723 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:38.846944 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:38.846957 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:38.847776 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:38.847784 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:38.848093 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:38.848688 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:34:38.848713 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:34:38.850845 (+ 2132us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:34:38.853969 (+ 3124us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:38.853977 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:38.853993 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:38.854416 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:38.854809 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:38.854822 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:38.854826 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:38.855023 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:38.855586 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:34:38.855594 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:34:38.856006 (+ 412us) client_negotiation.cc:769] Sending connection context
0808 11:34:38.856281 (+ 275us) client_negotiation.cc:240] Negotiation successful
0808 11:34:38.856806 (+ 525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":267,"threads_started":1}
I20260808 11:34:38.859457 9368 heartbeater.cc:347] Connected to a master server at 127.26.66.190:38927
I20260808 11:34:38.859781 9368 heartbeater.cc:464] Registering TS with master...
I20260808 11:34:38.860684 9368 heartbeater.cc:511] Master 127.26.66.190:38927 requested a full tablet report, sending...
I20260808 11:34:38.862161 8879 ts_manager.cc:194] Registered new tserver with Master: 685331d0e8d74734a0ab7ab09eb23fa2 (127.26.66.131:37891)
I20260808 11:34:38.863075 8879 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.131@KRBTEST.COM'} at 127.26.66.131:45277
I20260808 11:34:38.872582 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 11:34:38.890046 9370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:38.877474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54338 (local address 127.26.66.190:38927)
0808 11:34:38.877640 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:38.877644 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:38.878195 (+ 551us) server_negotiation.cc:407] Connection header received
0808 11:34:38.878338 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:38.878341 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:38.878402 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:38.878480 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:38.879996 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:38.880719 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:38.882014 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:38.882428 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:38.882520 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:38.885052 (+ 2532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:38.885056 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:38.885059 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:38.885091 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:38.887669 (+ 2578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:38.888384 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:38.888387 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:38.888389 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:38.888505 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:38.888856 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:38.888859 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:38.888861 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:38.889164 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:38.889349 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:38.889647 (+ 298us) server_negotiation.cc:299] Negotiation successful
0808 11:34:38.889814 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 11:34:38.894191 8879 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54338:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 11:34:38.901229 8879 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:34:38.924669 9385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:38.914014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40930 (local address 127.26.66.130:46433)
0808 11:34:38.914677 (+ 663us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:38.914689 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:38.916986 (+ 2297us) server_negotiation.cc:407] Connection header received
0808 11:34:38.917091 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:38.917102 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:38.917330 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:38.917513 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:34:38.918462 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:38.919694 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:38.922458 (+ 2764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:38.923419 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:38.923590 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:38.923808 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:38.924151 (+ 343us) server_negotiation.cc:299] Negotiation successful
0808 11:34:38.924341 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":301,"threads_started":1}
I20260808 11:34:38.924731 9387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:38.913683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:46433 (local address 127.0.0.1:40930)
0808 11:34:38.916676 (+ 2993us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:38.916690 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:38.916851 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:38.917755 (+ 904us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:38.917759 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:38.917783 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:34:38.918235 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:38.918246 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:38.919857 (+ 1611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:38.919864 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:38.922228 (+ 2364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:38.922243 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:38.923640 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:38.923646 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:38.923846 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:38.923931 (+ 85us) client_negotiation.cc:769] Sending connection context
0808 11:34:38.924071 (+ 140us) client_negotiation.cc:240] Negotiation successful
0808 11:34:38.924262 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2878,"mutex_wait_us":1177,"thread_start_us":1530,"threads_started":1}
I20260808 11:34:38.924861 9383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:38.913011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:37891 (local address 127.0.0.1:53166)
0808 11:34:38.915600 (+ 2589us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:38.915617 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:38.915732 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:38.916837 (+ 1105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:38.916844 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:38.916869 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:34:38.917292 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:38.917310 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:38.919476 (+ 2166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:38.919481 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:38.921741 (+ 2260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:38.921753 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:38.924001 (+ 2248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:38.924009 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:38.924186 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:38.924217 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 11:34:38.924308 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 11:34:38.924437 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2462,"mutex_wait_us":107,"thread_start_us":1658,"threads_started":1}
I20260808 11:34:38.925550 9382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:38.912969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:34541 (local address 127.0.0.1:60268)
0808 11:34:38.915069 (+ 2100us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:38.915127 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:38.915286 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:38.917085 (+ 1799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:38.917088 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:38.917112 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:34:38.917565 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:38.917578 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:38.919526 (+ 1948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:38.919529 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:38.922391 (+ 2862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:38.922406 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:38.924580 (+ 2174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:38.924589 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:38.924834 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:38.924885 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 11:34:38.924969 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 11:34:38.925090 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1833,"mutex_wait_us":258,"thread_start_us":421,"threads_started":1}
I20260808 11:34:38.925704 9386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:38.913989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53166 (local address 127.26.66.131:37891)
0808 11:34:38.916184 (+ 2195us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:38.916193 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:38.916229 (+ 36us) server_negotiation.cc:407] Connection header received
0808 11:34:38.916340 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:38.916349 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:38.916593 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:38.916797 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:34:38.917528 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:38.919315 (+ 1787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:38.921934 (+ 2619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:38.923484 (+ 1550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:38.923616 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:38.923850 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:38.925196 (+ 1346us) server_negotiation.cc:299] Negotiation successful
0808 11:34:38.925344 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2011,"thread_start_us":1826,"threads_started":1}
I20260808 11:34:38.926321 9384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:38.913200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60268 (local address 127.26.66.129:34541)
0808 11:34:38.916335 (+ 3135us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:38.916342 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:38.916364 (+ 22us) server_negotiation.cc:407] Connection header received
0808 11:34:38.916447 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:38.916454 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:38.916623 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:38.916805 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:34:38.917830 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:38.919359 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:38.922558 (+ 3199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:38.924067 (+ 1509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:38.924205 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:38.924419 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:38.925776 (+ 1357us) server_negotiation.cc:299] Negotiation successful
0808 11:34:38.925992 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2971,"thread_start_us":2841,"threads_started":1}
I20260808 11:34:38.929044 9156 tablet_service.cc:1467] Processing CreateTablet for tablet a5c52a40eaf443e89b31a66c418db53b (DEFAULT_TABLE table=test-table [id=69328f05046e4ccc8ed317351d7eda68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:34:38.929306 9299 tablet_service.cc:1467] Processing CreateTablet for tablet a5c52a40eaf443e89b31a66c418db53b (DEFAULT_TABLE table=test-table [id=69328f05046e4ccc8ed317351d7eda68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:34:38.929662 9015 tablet_service.cc:1467] Processing CreateTablet for tablet a5c52a40eaf443e89b31a66c418db53b (DEFAULT_TABLE table=test-table [id=69328f05046e4ccc8ed317351d7eda68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:34:38.930392 9156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5c52a40eaf443e89b31a66c418db53b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:34:38.930714 9299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5c52a40eaf443e89b31a66c418db53b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:34:38.930968 9015 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5c52a40eaf443e89b31a66c418db53b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:34:38.942456 9388 tablet_bootstrap.cc:492] T a5c52a40eaf443e89b31a66c418db53b P 935961690c244bf08f6f6353a4a5e28b: Bootstrap starting.
I20260808 11:34:38.946079 9388 tablet_bootstrap.cc:654] T a5c52a40eaf443e89b31a66c418db53b P 935961690c244bf08f6f6353a4a5e28b: Neither blocks nor log segments found. Creating new log.
I20260808 11:34:38.947145 9388 log.cc:824] T a5c52a40eaf443e89b31a66c418db53b P 935961690c244bf08f6f6353a4a5e28b: Log is configured to *not* fsync() on all Append() calls
I20260808 11:34:38.948660 9389 tablet_bootstrap.cc:492] T a5c52a40eaf443e89b31a66c418db53b P 685331d0e8d74734a0ab7ab09eb23fa2: Bootstrap starting.
I20260808 11:34:38.950466 9390 tablet_bootstrap.cc:492] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0: Bootstrap starting.
I20260808 11:34:38.950538 9388 tablet_bootstrap.cc:492] T a5c52a40eaf443e89b31a66c418db53b P 935961690c244bf08f6f6353a4a5e28b: No bootstrap required, opened a new log
I20260808 11:34:38.950943 9388 ts_tablet_manager.cc:1397] T a5c52a40eaf443e89b31a66c418db53b P 935961690c244bf08f6f6353a4a5e28b: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.006s
I20260808 11:34:38.952376 9389 tablet_bootstrap.cc:654] T a5c52a40eaf443e89b31a66c418db53b P 685331d0e8d74734a0ab7ab09eb23fa2: Neither blocks nor log segments found. Creating new log.
I20260808 11:34:38.953464 9390 tablet_bootstrap.cc:654] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0: Neither blocks nor log segments found. Creating new log.
I20260808 11:34:38.953646 9389 log.cc:824] T a5c52a40eaf443e89b31a66c418db53b P 685331d0e8d74734a0ab7ab09eb23fa2: Log is configured to *not* fsync() on all Append() calls
I20260808 11:34:38.954689 9390 log.cc:824] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0: Log is configured to *not* fsync() on all Append() calls
I20260808 11:34:38.957588 9389 tablet_bootstrap.cc:492] T a5c52a40eaf443e89b31a66c418db53b P 685331d0e8d74734a0ab7ab09eb23fa2: No bootstrap required, opened a new log
I20260808 11:34:38.957841 9390 tablet_bootstrap.cc:492] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0: No bootstrap required, opened a new log
I20260808 11:34:38.957880 9389 ts_tablet_manager.cc:1397] T a5c52a40eaf443e89b31a66c418db53b P 685331d0e8d74734a0ab7ab09eb23fa2: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260808 11:34:38.958099 9390 ts_tablet_manager.cc:1397] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.005s
I20260808 11:34:38.962177 9388 raft_consensus.cc:348] T a5c52a40eaf443e89b31a66c418db53b P 935961690c244bf08f6f6353a4a5e28b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83de2e6f8f694a97954dd42fcf151df0" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34541 } } peers { permanent_uuid: "685331d0e8d74734a0ab7ab09eb23fa2" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 37891 } } peers { permanent_uuid: "935961690c244bf08f6f6353a4a5e28b" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46433 } }
I20260808 11:34:38.962644 9388 raft_consensus.cc:374] T a5c52a40eaf443e89b31a66c418db53b P 935961690c244bf08f6f6353a4a5e28b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:34:38.962738 9388 raft_consensus.cc:729] T a5c52a40eaf443e89b31a66c418db53b P 935961690c244bf08f6f6353a4a5e28b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 935961690c244bf08f6f6353a4a5e28b, State: Initialized, Role: FOLLOWER
I20260808 11:34:38.963379 9388 consensus_queue.cc:260] T a5c52a40eaf443e89b31a66c418db53b P 935961690c244bf08f6f6353a4a5e28b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83de2e6f8f694a97954dd42fcf151df0" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34541 } } peers { permanent_uuid: "685331d0e8d74734a0ab7ab09eb23fa2" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 37891 } } peers { permanent_uuid: "935961690c244bf08f6f6353a4a5e28b" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46433 } }
I20260808 11:34:38.965760 9228 heartbeater.cc:503] Master 127.26.66.190:38927 was elected leader, sending a full tablet report...
I20260808 11:34:38.966467 9388 ts_tablet_manager.cc:1428] T a5c52a40eaf443e89b31a66c418db53b P 935961690c244bf08f6f6353a4a5e28b: Time spent starting tablet: real 0.015s user 0.009s sys 0.006s
I20260808 11:34:38.966367 9389 raft_consensus.cc:348] T a5c52a40eaf443e89b31a66c418db53b P 685331d0e8d74734a0ab7ab09eb23fa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83de2e6f8f694a97954dd42fcf151df0" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34541 } } peers { permanent_uuid: "685331d0e8d74734a0ab7ab09eb23fa2" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 37891 } } peers { permanent_uuid: "935961690c244bf08f6f6353a4a5e28b" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46433 } }
I20260808 11:34:38.966801 9389 raft_consensus.cc:374] T a5c52a40eaf443e89b31a66c418db53b P 685331d0e8d74734a0ab7ab09eb23fa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:34:38.966917 9389 raft_consensus.cc:729] T a5c52a40eaf443e89b31a66c418db53b P 685331d0e8d74734a0ab7ab09eb23fa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 685331d0e8d74734a0ab7ab09eb23fa2, State: Initialized, Role: FOLLOWER
I20260808 11:34:38.967533 9389 consensus_queue.cc:260] T a5c52a40eaf443e89b31a66c418db53b P 685331d0e8d74734a0ab7ab09eb23fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83de2e6f8f694a97954dd42fcf151df0" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34541 } } peers { permanent_uuid: "685331d0e8d74734a0ab7ab09eb23fa2" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 37891 } } peers { permanent_uuid: "935961690c244bf08f6f6353a4a5e28b" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46433 } }
I20260808 11:34:38.968711 9368 heartbeater.cc:503] Master 127.26.66.190:38927 was elected leader, sending a full tablet report...
I20260808 11:34:38.968941 9390 raft_consensus.cc:348] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83de2e6f8f694a97954dd42fcf151df0" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34541 } } peers { permanent_uuid: "685331d0e8d74734a0ab7ab09eb23fa2" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 37891 } } peers { permanent_uuid: "935961690c244bf08f6f6353a4a5e28b" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46433 } }
I20260808 11:34:38.969341 9390 raft_consensus.cc:374] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:34:38.969364 9389 ts_tablet_manager.cc:1428] T a5c52a40eaf443e89b31a66c418db53b P 685331d0e8d74734a0ab7ab09eb23fa2: Time spent starting tablet: real 0.011s user 0.008s sys 0.004s
I20260808 11:34:38.969452 9390 raft_consensus.cc:729] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83de2e6f8f694a97954dd42fcf151df0, State: Initialized, Role: FOLLOWER
I20260808 11:34:38.970065 9390 consensus_queue.cc:260] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83de2e6f8f694a97954dd42fcf151df0" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34541 } } peers { permanent_uuid: "685331d0e8d74734a0ab7ab09eb23fa2" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 37891 } } peers { permanent_uuid: "935961690c244bf08f6f6353a4a5e28b" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46433 } }
I20260808 11:34:38.971735 9390 ts_tablet_manager.cc:1428] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
W20260808 11:34:39.004905 9085 tablet.cc:2369] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 11:34:39.049288 9229 tablet.cc:2369] T a5c52a40eaf443e89b31a66c418db53b P 935961690c244bf08f6f6353a4a5e28b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:34:39.075693 9396 raft_consensus.cc:482] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:34:39.076081 9396 raft_consensus.cc:504] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83de2e6f8f694a97954dd42fcf151df0" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34541 } } peers { permanent_uuid: "685331d0e8d74734a0ab7ab09eb23fa2" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 37891 } } peers { permanent_uuid: "935961690c244bf08f6f6353a4a5e28b" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46433 } }
I20260808 11:34:39.077942 9396 leader_election.cc:288] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 685331d0e8d74734a0ab7ab09eb23fa2 (127.26.66.131:37891), 935961690c244bf08f6f6353a4a5e28b (127.26.66.130:46433)
I20260808 11:34:39.085600 9386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:39.078426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:59651 (local address 127.26.66.131:37891)
0808 11:34:39.078643 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:39.078651 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:39.079640 (+ 989us) server_negotiation.cc:407] Connection header received
0808 11:34:39.079921 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:39.079929 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:39.080025 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:39.080097 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:34:39.080789 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:39.081622 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:39.083552 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:39.084473 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:39.084662 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:39.084742 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:39.085188 (+ 446us) server_negotiation.cc:299] Negotiation successful
0808 11:34:39.085329 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 11:34:39.085660 9385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:39.078535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:39397 (local address 127.26.66.130:46433)
0808 11:34:39.078805 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:39.078826 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:39.079784 (+ 958us) server_negotiation.cc:407] Connection header received
0808 11:34:39.080001 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:39.080006 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:39.080105 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:39.080200 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:34:39.080854 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:39.081587 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:39.083601 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:39.084578 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:39.084763 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:39.084847 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:39.085258 (+ 411us) server_negotiation.cc:299] Negotiation successful
0808 11:34:39.085391 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260808 11:34:39.086067 9400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:39.078472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:46433 (local address 127.26.66.129:39397)
0808 11:34:39.079639 (+ 1167us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:39.079660 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:39.079856 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:39.080246 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:39.080251 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:39.080280 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:34:39.080644 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:39.080653 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:39.081764 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:39.081770 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:39.083386 (+ 1616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:39.083399 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:39.084848 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:39.084855 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:39.085062 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:39.085105 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 11:34:39.085226 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 11:34:39.085388 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1037,"mutex_wait_us":104,"thread_start_us":692,"threads_started":1}
I20260808 11:34:39.086123 9397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:39.078345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:37891 (local address 127.26.66.129:59651)
0808 11:34:39.079522 (+ 1177us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:39.079539 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:39.079664 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:39.080165 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:39.080171 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:39.080209 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:34:39.080627 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:39.080638 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:39.081758 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:39.081763 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:39.083357 (+ 1594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:39.083379 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:39.084692 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:39.084699 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:39.084914 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:39.084939 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 11:34:39.085157 (+ 218us) client_negotiation.cc:240] Negotiation successful
0808 11:34:39.085309 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1061,"mutex_wait_us":58,"thread_start_us":663,"threads_started":1}
I20260808 11:34:39.087076 9178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5c52a40eaf443e89b31a66c418db53b" candidate_uuid: "83de2e6f8f694a97954dd42fcf151df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "935961690c244bf08f6f6353a4a5e28b" is_pre_election: true
I20260808 11:34:39.087080 9320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5c52a40eaf443e89b31a66c418db53b" candidate_uuid: "83de2e6f8f694a97954dd42fcf151df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "685331d0e8d74734a0ab7ab09eb23fa2" is_pre_election: true
I20260808 11:34:39.087617 9178 raft_consensus.cc:2454] T a5c52a40eaf443e89b31a66c418db53b P 935961690c244bf08f6f6353a4a5e28b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83de2e6f8f694a97954dd42fcf151df0 in term 0.
I20260808 11:34:39.087632 9320 raft_consensus.cc:2454] T a5c52a40eaf443e89b31a66c418db53b P 685331d0e8d74734a0ab7ab09eb23fa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83de2e6f8f694a97954dd42fcf151df0 in term 0.
W20260808 11:34:39.088379 9369 tablet.cc:2369] T a5c52a40eaf443e89b31a66c418db53b P 685331d0e8d74734a0ab7ab09eb23fa2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:34:39.088335 8967 leader_election.cc:302] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83de2e6f8f694a97954dd42fcf151df0, 935961690c244bf08f6f6353a4a5e28b; no voters:
I20260808 11:34:39.088766 9396 raft_consensus.cc:2781] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:34:39.088927 9396 raft_consensus.cc:482] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:34:39.089035 9396 raft_consensus.cc:3037] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:34:39.091259 9396 raft_consensus.cc:504] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83de2e6f8f694a97954dd42fcf151df0" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34541 } } peers { permanent_uuid: "685331d0e8d74734a0ab7ab09eb23fa2" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 37891 } } peers { permanent_uuid: "935961690c244bf08f6f6353a4a5e28b" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46433 } }
I20260808 11:34:39.091921 9396 leader_election.cc:288] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0 [CANDIDATE]: Term 1 election: Requested vote from peers 685331d0e8d74734a0ab7ab09eb23fa2 (127.26.66.131:37891), 935961690c244bf08f6f6353a4a5e28b (127.26.66.130:46433)
I20260808 11:34:39.092392 9320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5c52a40eaf443e89b31a66c418db53b" candidate_uuid: "83de2e6f8f694a97954dd42fcf151df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "685331d0e8d74734a0ab7ab09eb23fa2"
I20260808 11:34:39.092433 9178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5c52a40eaf443e89b31a66c418db53b" candidate_uuid: "83de2e6f8f694a97954dd42fcf151df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "935961690c244bf08f6f6353a4a5e28b"
I20260808 11:34:39.092590 9320 raft_consensus.cc:3037] T a5c52a40eaf443e89b31a66c418db53b P 685331d0e8d74734a0ab7ab09eb23fa2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:34:39.092670 9178 raft_consensus.cc:3037] T a5c52a40eaf443e89b31a66c418db53b P 935961690c244bf08f6f6353a4a5e28b [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:34:39.094879 9320 raft_consensus.cc:2454] T a5c52a40eaf443e89b31a66c418db53b P 685331d0e8d74734a0ab7ab09eb23fa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83de2e6f8f694a97954dd42fcf151df0 in term 1.
I20260808 11:34:39.094993 9178 raft_consensus.cc:2454] T a5c52a40eaf443e89b31a66c418db53b P 935961690c244bf08f6f6353a4a5e28b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83de2e6f8f694a97954dd42fcf151df0 in term 1.
I20260808 11:34:39.095288 8964 leader_election.cc:302] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 685331d0e8d74734a0ab7ab09eb23fa2, 83de2e6f8f694a97954dd42fcf151df0; no voters:
I20260808 11:34:39.095613 9396 raft_consensus.cc:2781] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:34:39.096139 9396 raft_consensus.cc:686] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0 [term 1 LEADER]: Becoming Leader. State: Replica: 83de2e6f8f694a97954dd42fcf151df0, State: Running, Role: LEADER
I20260808 11:34:39.096621 9396 consensus_queue.cc:237] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83de2e6f8f694a97954dd42fcf151df0" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34541 } } peers { permanent_uuid: "685331d0e8d74734a0ab7ab09eb23fa2" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 37891 } } peers { permanent_uuid: "935961690c244bf08f6f6353a4a5e28b" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46433 } }
I20260808 11:34:39.101317 8879 catalog_manager.cc:5495] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83de2e6f8f694a97954dd42fcf151df0 (127.26.66.129). New cstate: current_term: 1 leader_uuid: "83de2e6f8f694a97954dd42fcf151df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83de2e6f8f694a97954dd42fcf151df0" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "685331d0e8d74734a0ab7ab09eb23fa2" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 37891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "935961690c244bf08f6f6353a4a5e28b" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46433 } health_report { overall_health: UNKNOWN } } }
I20260808 11:34:39.117265 9384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:39.111532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60284 (local address 127.26.66.129:34541)
0808 11:34:39.111747 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:39.111753 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:39.111833 (+ 80us) server_negotiation.cc:407] Connection header received
0808 11:34:39.112146 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:39.112151 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:39.112244 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:39.112405 (+ 161us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:34:39.112831 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:39.113556 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:39.115010 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:39.115422 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:39.115573 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:39.116156 (+ 583us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:34:39.116658 (+ 502us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:34:39.116847 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:39.116901 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 11:34:39.116985 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 11:34:39.125341 9178 raft_consensus.cc:1261] T a5c52a40eaf443e89b31a66c418db53b P 935961690c244bf08f6f6353a4a5e28b [term 1 FOLLOWER]: Refusing update from remote peer 83de2e6f8f694a97954dd42fcf151df0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:34:39.125422 9320 raft_consensus.cc:1261] T a5c52a40eaf443e89b31a66c418db53b P 685331d0e8d74734a0ab7ab09eb23fa2 [term 1 FOLLOWER]: Refusing update from remote peer 83de2e6f8f694a97954dd42fcf151df0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:34:39.126372 9401 consensus_queue.cc:1035] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "685331d0e8d74734a0ab7ab09eb23fa2" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 37891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:34:39.126736 9396 consensus_queue.cc:1035] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "935961690c244bf08f6f6353a4a5e28b" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:34:39.140683 9406 mvcc.cc:205] Tried to move back new op lower bound from 7316229648887250944 to 7316229648783781888. Current Snapshot: MvccSnapshot[applied={T|T < 7316229648887250944}]
I20260808 11:34:39.162638 8880 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54338:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:34:39.162945 8880 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54338:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:34:39.166810 8880 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24: Sending DeleteTablet for 3 replicas of tablet a5c52a40eaf443e89b31a66c418db53b
I20260808 11:34:39.168148 9299 tablet_service.cc:1514] Processing DeleteTablet for tablet a5c52a40eaf443e89b31a66c418db53b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:34:39 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:53166
I20260808 11:34:39.168175 9156 tablet_service.cc:1514] Processing DeleteTablet for tablet a5c52a40eaf443e89b31a66c418db53b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:34:39 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:40930
I20260808 11:34:39.168764 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 8948
I20260808 11:34:39.168882 9015 tablet_service.cc:1514] Processing DeleteTablet for tablet a5c52a40eaf443e89b31a66c418db53b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:34:39 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:60268
I20260808 11:34:39.182641 9416 tablet_replica.cc:330] T a5c52a40eaf443e89b31a66c418db53b P 935961690c244bf08f6f6353a4a5e28b: stopping tablet replica
I20260808 11:34:39.186506 9417 tablet_replica.cc:330] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0: stopping tablet replica
I20260808 11:34:39.183187 9416 raft_consensus.cc:2229] T a5c52a40eaf443e89b31a66c418db53b P 935961690c244bf08f6f6353a4a5e28b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:34:39.187376 9417 raft_consensus.cc:2229] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0 [term 1 LEADER]: Raft consensus shutting down.
I20260808 11:34:39.187551 9416 raft_consensus.cc:2258] T a5c52a40eaf443e89b31a66c418db53b P 935961690c244bf08f6f6353a4a5e28b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:34:39.188467 9417 raft_consensus.cc:2258] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:34:39.190157 9416 ts_tablet_manager.cc:1905] T a5c52a40eaf443e89b31a66c418db53b P 935961690c244bf08f6f6353a4a5e28b: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 11:34:39 dist-test-slave-zkpd krb5kdc[8833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.129@KRBTEST.COM
I20260808 11:34:39.196851 9414 tablet_replica.cc:330] T a5c52a40eaf443e89b31a66c418db53b P 685331d0e8d74734a0ab7ab09eb23fa2: stopping tablet replica
I20260808 11:34:39.197433 9414 raft_consensus.cc:2229] T a5c52a40eaf443e89b31a66c418db53b P 685331d0e8d74734a0ab7ab09eb23fa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:34:39.197629 9416 ts_tablet_manager.cc:1918] T a5c52a40eaf443e89b31a66c418db53b P 935961690c244bf08f6f6353a4a5e28b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:34:39.197805 9416 log.cc:1196] T a5c52a40eaf443e89b31a66c418db53b P 935961690c244bf08f6f6353a4a5e28b: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/wal/wals/a5c52a40eaf443e89b31a66c418db53b
I20260808 11:34:39.198197 9414 raft_consensus.cc:2258] T a5c52a40eaf443e89b31a66c418db53b P 685331d0e8d74734a0ab7ab09eb23fa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:34:39.198380 9416 ts_tablet_manager.cc:1939] T a5c52a40eaf443e89b31a66c418db53b P 935961690c244bf08f6f6353a4a5e28b: Deleting consensus metadata
I20260808 11:34:39.201052 9417 ts_tablet_manager.cc:1905] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:34:39.204283 9414 ts_tablet_manager.cc:1905] T a5c52a40eaf443e89b31a66c418db53b P 685331d0e8d74734a0ab7ab09eb23fa2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:34:39.205386 8867 catalog_manager.cc:4841] TS 935961690c244bf08f6f6353a4a5e28b (127.26.66.130:46433): tablet a5c52a40eaf443e89b31a66c418db53b (table test-table [id=69328f05046e4ccc8ed317351d7eda68]) successfully deleted
I20260808 11:34:39.205993 9384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:39.169920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60294 (local address 127.26.66.129:34541)
0808 11:34:39.170088 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:39.170095 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:39.179341 (+ 9246us) server_negotiation.cc:407] Connection header received
0808 11:34:39.179860 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:39.179868 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:39.180024 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:39.180114 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:39.183383 (+ 3269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:39.184735 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:39.189051 (+ 4316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:39.190053 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:39.190194 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:39.197941 (+ 7747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:39.197959 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:39.197976 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:39.198032 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:39.201932 (+ 3900us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:39.202926 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:39.202937 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:39.202943 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:39.203173 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:39.203702 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:39.203709 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:39.203715 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:39.204243 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:39.204617 (+ 374us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:39.205284 (+ 667us) server_negotiation.cc:299] Negotiation successful
0808 11:34:39.205605 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 11:34:39.207834 9078 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:34:39.211793 9414 ts_tablet_manager.cc:1918] T a5c52a40eaf443e89b31a66c418db53b P 685331d0e8d74734a0ab7ab09eb23fa2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:34:39.211980 9414 log.cc:1196] T a5c52a40eaf443e89b31a66c418db53b P 685331d0e8d74734a0ab7ab09eb23fa2: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/wal/wals/a5c52a40eaf443e89b31a66c418db53b
I20260808 11:34:39.212607 9414 ts_tablet_manager.cc:1939] T a5c52a40eaf443e89b31a66c418db53b P 685331d0e8d74734a0ab7ab09eb23fa2: Deleting consensus metadata
I20260808 11:34:39.214422 8863 catalog_manager.cc:4841] TS 685331d0e8d74734a0ab7ab09eb23fa2 (127.26.66.131:37891): tablet a5c52a40eaf443e89b31a66c418db53b (table test-table [id=69328f05046e4ccc8ed317351d7eda68]) successfully deleted
I20260808 11:34:39.311082 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 8948
W20260808 11:34:39.336370 8866 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.66.129:34541 (error 108)
I20260808 11:34:39.336516 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 9090
I20260808 11:34:39.338456 9382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:39.337967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:34541 (local address 127.0.0.1:60296)
0808 11:34:39.338200 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:39.338320 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:34541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
W20260808 11:34:39.338687 8866 catalog_manager.cc:4584] TS 83de2e6f8f694a97954dd42fcf151df0 (127.26.66.129:34541): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a5c52a40eaf443e89b31a66c418db53b: Network error: Client connection negotiation failed: client connection to 127.26.66.129:34541: connect: Connection refused (error 111)
Aug 08 11:34:39 dist-test-slave-zkpd krb5kdc[8833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.130@KRBTEST.COM
I20260808 11:34:39.352110 9385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:39.337351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40934 (local address 127.26.66.130:46433)
0808 11:34:39.337522 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:39.337526 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:39.337698 (+ 172us) server_negotiation.cc:407] Connection header received
0808 11:34:39.337900 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:39.337906 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:39.337990 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:39.338125 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:39.339768 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:39.340667 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:39.341969 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:39.342550 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:39.342646 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:39.346863 (+ 4217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:39.346875 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:39.346889 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:39.346929 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:39.349659 (+ 2730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:39.350270 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:39.350276 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:39.350278 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:39.350407 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:39.350727 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:39.350731 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:39.350733 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:39.351090 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:39.351309 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:39.351562 (+ 253us) server_negotiation.cc:299] Negotiation successful
0808 11:34:39.351718 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 11:34:39.352826 9223 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:34:39.392490 9382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:39.391968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:34541 (local address 127.0.0.1:60298)
0808 11:34:39.392184 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:39.392295 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:34541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260808 11:34:39.393606 9382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:39.393204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:34541 (local address 127.0.0.1:60304)
0808 11:34:39.393367 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:39.393469 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:34541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 11:34:39.445722 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 9090
I20260808 11:34:39.454254 9382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:39.453622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:34541 (local address 127.0.0.1:60306)
0808 11:34:39.453930 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:39.454047 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:34541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260808 11:34:39.455456 9382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:39.454985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:34541 (local address 127.0.0.1:60310)
0808 11:34:39.455179 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:39.455281 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:34541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 11:34:39.470342 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 9234
Aug 08 11:34:39 dist-test-slave-zkpd krb5kdc[8833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.131@KRBTEST.COM
I20260808 11:34:39.486228 9386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:39.471209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53182 (local address 127.26.66.131:37891)
0808 11:34:39.471408 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:39.471412 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:39.471432 (+ 20us) server_negotiation.cc:407] Connection header received
0808 11:34:39.471576 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:39.471581 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:39.471660 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:39.471749 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:39.473155 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:39.473897 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:39.475492 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:39.476042 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:39.476142 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:39.480797 (+ 4655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:39.480810 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:39.480830 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:39.480861 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:39.483471 (+ 2610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:39.484274 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:39.484286 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:39.484289 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:39.484509 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:39.484904 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:39.484911 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:39.484913 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:39.485286 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:39.485586 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:39.485809 (+ 223us) server_negotiation.cc:299] Negotiation successful
0808 11:34:39.485974 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 11:34:39.486909 9362 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:34:39.536355 9382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:39.535747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:34541 (local address 127.0.0.1:60322)
0808 11:34:39.536057 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:39.536158 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:34541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260808 11:34:39.537606 9382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:39.537162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:34541 (local address 127.0.0.1:60326)
0808 11:34:39.537403 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:39.537487 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:34541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130}
I20260808 11:34:39.577502 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 9234
I20260808 11:34:39.599680 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 8846
I20260808 11:34:39.600955 8916 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:34:39.718415 9382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:39.717841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:34541 (local address 127.0.0.1:60332)
0808 11:34:39.718087 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:39.718190 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:34541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260808 11:34:39.718554 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 8846
I20260808 11:34:39.744572 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:38927
--webserver_interface=127.26.66.190
--webserver_port=34899
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:45365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:38927
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:34:40.099434 9424 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:34:40.099727 9424 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:34:40.099826 9424 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:34:40.107748 9424 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:34:40.107870 9424 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:34:40.108006 9424 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:34:40.108072 9424 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:34:40.108116 9424 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:34:40.118296 9424 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:38927
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:38927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=34899
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:34:40.119577 9424 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:34:40.120923 9424 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:34:40.147482 9433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:40.147645 9430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:40.147619 9431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:40.148888 9424 server_base.cc:1034] running on GCE node
I20260808 11:34:40.149799 9424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:34:40.151458 9424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:34:40.152669 9424 hybrid_clock.cc:648] HybridClock initialized: now 1786188880152617 us; error 38 us; skew 500 ppm
I20260808 11:34:40.153052 9424 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:34:40 dist-test-slave-zkpd krb5kdc[8833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188880, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:34:40.157279 9424 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:34:40.159212 9424 webserver.cc:460] Webserver started at http://127.26.66.190:34899/ using document root <none> and password file <none>
I20260808 11:34:40.160163 9424 fs_manager.cc:359] Metadata directory not provided
I20260808 11:34:40.160347 9424 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:34:40.166751 9424 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 11:34:40.169795 9440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:40.171216 9424 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 11:34:40.171423 9424 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "4c13ccee25ef462cbadc4201df8f7b24"
format_stamp: "Formatted at 2026-08-08 11:34:37 on dist-test-slave-zkpd"
server_key: "632573bae73682bde0ba99419233c243"
server_key_iv: "27989c41dc8e9e012fd0e2ec4827dbd2"
server_key_version: "encryptionkey@0"
I20260808 11:34:40.172648 9424 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:34:40.195640 9424 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:34:40.200209 9424 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:34:40.200562 9424 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:34:40.222220 9424 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:38927
I20260808 11:34:40.222265 9496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:38927 every 8 connection(s)
I20260808 11:34:40.223963 9424 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:34:40.225203 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 9424
I20260808 11:34:40.226173 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:34541
--local_ip_for_outbound_sockets=127.26.66.129
--tserver_master_addrs=127.26.66.190:38927
--webserver_port=37711
--webserver_interface=127.26.66.129
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:45365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 11:34:40.231639 9497 sys_catalog.cc:263] Verifying existing consensus state
I20260808 11:34:40.235152 9497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24: Bootstrap starting.
I20260808 11:34:40.256114 9497 log.cc:824] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24: Log is configured to *not* fsync() on all Append() calls
I20260808 11:34:40.268577 9497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 11:34:40.269299 9497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24: Bootstrap complete.
I20260808 11:34:40.279531 9497 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c13ccee25ef462cbadc4201df8f7b24" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38927 } }
I20260808 11:34:40.280439 9497 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c13ccee25ef462cbadc4201df8f7b24, State: Initialized, Role: FOLLOWER
I20260808 11:34:40.281049 9497 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c13ccee25ef462cbadc4201df8f7b24" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38927 } }
I20260808 11:34:40.281316 9497 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:34:40.281458 9497 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:34:40.281659 9497 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [term 1 FOLLOWER]: Advancing to term 2
I20260808 11:34:40.285564 9497 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c13ccee25ef462cbadc4201df8f7b24" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38927 } }
I20260808 11:34:40.286130 9497 leader_election.cc:302] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c13ccee25ef462cbadc4201df8f7b24; no voters:
I20260808 11:34:40.286814 9497 leader_election.cc:288] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 11:34:40.287050 9501 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 11:34:40.288244 9501 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [term 2 LEADER]: Becoming Leader. State: Replica: 4c13ccee25ef462cbadc4201df8f7b24, State: Running, Role: LEADER
I20260808 11:34:40.289116 9497 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:34:40.288924 9501 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c13ccee25ef462cbadc4201df8f7b24" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38927 } }
I20260808 11:34:40.292300 9503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c13ccee25ef462cbadc4201df8f7b24. Latest consensus state: current_term: 2 leader_uuid: "4c13ccee25ef462cbadc4201df8f7b24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c13ccee25ef462cbadc4201df8f7b24" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38927 } } }
I20260808 11:34:40.292744 9503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [sys.catalog]: This master's current role is: LEADER
I20260808 11:34:40.293372 9502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4c13ccee25ef462cbadc4201df8f7b24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c13ccee25ef462cbadc4201df8f7b24" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38927 } } }
I20260808 11:34:40.293733 9502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [sys.catalog]: This master's current role is: LEADER
I20260808 11:34:40.302208 9508 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:34:40.310994 9508 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:34:40.312836 9508 catalog_manager.cc:1259] Loaded cluster ID: cf2de7a7d08c4e978ec487e638a701c1
I20260808 11:34:40.312961 9508 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:34:40.317239 9508 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 11:34:40.317668 9518 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 11:34:40.328742 9508 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 11:34:40.336333 9508 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:34:40.337693 9508 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24: Loaded TSK: 0
I20260808 11:34:40.338814 9508 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 11:34:40.622833 9499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:34:40.623111 9499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:34:40.623260 9499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:34:40.630607 9499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:34:40.630736 9499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:34:40.630944 9499 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:34:40.640950 9499 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:34541
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=37711
--tserver_master_addrs=127.26.66.190:38927
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:34:40.642292 9499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:34:40.643707 9499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:34:40.657799 9525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:40.658033 9524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:40.659013 9499 server_base.cc:1034] running on GCE node
W20260808 11:34:40.660163 9527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:40.660866 9499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:34:40.661901 9499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:34:40.663132 9499 hybrid_clock.cc:648] HybridClock initialized: now 1786188880663081 us; error 43 us; skew 500 ppm
I20260808 11:34:40.663570 9499 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:34:40 dist-test-slave-zkpd krb5kdc[8833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188880, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:34:40.667006 9499 init.cc:377] Logged in from keytab as kudu/127.26.66.129@KRBTEST.COM (short username kudu)
I20260808 11:34:40.668725 9499 webserver.cc:460] Webserver started at http://127.26.66.129:37711/ using document root <none> and password file <none>
I20260808 11:34:40.669570 9499 fs_manager.cc:359] Metadata directory not provided
I20260808 11:34:40.669739 9499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:34:40.675549 9499 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 11:34:40.678879 9534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:40.680469 9499 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 11:34:40.680639 9499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "83de2e6f8f694a97954dd42fcf151df0"
format_stamp: "Formatted at 2026-08-08 11:34:37 on dist-test-slave-zkpd"
server_key: "fbd51893f19dfc59fed4522570c1ff22"
server_key_iv: "ec079e6729a22eb9d54ec1c6e032c620"
server_key_version: "encryptionkey@0"
I20260808 11:34:40.681620 9499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:34:40.708410 9499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:34:40.713225 9499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:34:40.713551 9499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:34:40.714663 9499 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:34:40.716802 9541 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260808 11:34:40.722458 9541 ts_tablet_manager.cc:1852] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260808 11:34:40.723492 9541 ts_tablet_manager.cc:1905] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:34:40.730980 9541 ts_tablet_manager.cc:1918] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:34:40.731199 9541 log.cc:1196] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/wal/wals/a5c52a40eaf443e89b31a66c418db53b
I20260808 11:34:40.731748 9541 ts_tablet_manager.cc:1939] T a5c52a40eaf443e89b31a66c418db53b P 83de2e6f8f694a97954dd42fcf151df0: Deleting consensus metadata
I20260808 11:34:40.732218 9499 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260808 11:34:40.732372 9499 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.016s user 0.001s sys 0.000s
I20260808 11:34:40.732523 9499 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:34:40.732617 9499 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:40.767124 9499 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:34541
I20260808 11:34:40.767177 9654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:34541 every 8 connection(s)
I20260808 11:34:40.768694 9499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:34:40.772620 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 9499
I20260808 11:34:40.773480 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:46433
--local_ip_for_outbound_sockets=127.26.66.130
--tserver_master_addrs=127.26.66.190:38927
--webserver_port=40775
--webserver_interface=127.26.66.130
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:45365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 11:34:40 dist-test-slave-zkpd krb5kdc[8833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188880, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:34:40.795706 9657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:40.771796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:33875 (local address 127.26.66.190:38927)
0808 11:34:40.772455 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:40.772472 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:40.773391 (+ 919us) server_negotiation.cc:407] Connection header received
0808 11:34:40.776870 (+ 3479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:40.776892 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:40.777312 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:40.777718 (+ 406us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:40.779371 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:40.780729 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:40.782382 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:40.783045 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:40.783268 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:40.787364 (+ 4096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:40.787376 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:40.787401 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:40.787460 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:40.790888 (+ 3428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:40.791677 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:40.791690 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:40.791695 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:40.791868 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:40.792330 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:40.792335 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:40.792339 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:40.792858 (+ 519us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:40.793065 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:40.793933 (+ 868us) server_negotiation.cc:299] Negotiation successful
0808 11:34:40.794356 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":302,"threads_started":1}
I20260808 11:34:40.795701 9658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:40.772206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.129:33875)
0808 11:34:40.773146 (+ 940us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:40.773215 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:40.776246 (+ 3031us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:40.777873 (+ 1627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:40.777886 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:40.778562 (+ 676us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:34:40.779119 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:40.779139 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:40.780926 (+ 1787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:40.780937 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:40.782218 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:40.782230 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:40.783310 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:40.783317 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:40.783612 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:40.784403 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:34:40.784428 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:34:40.787053 (+ 2625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:34:40.791037 (+ 3984us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:40.791046 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:40.791061 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:40.791509 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:40.792034 (+ 525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:40.792039 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:40.792043 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:40.792214 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:40.793015 (+ 801us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:34:40.793024 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:34:40.793387 (+ 363us) client_negotiation.cc:769] Sending connection context
0808 11:34:40.793676 (+ 289us) client_negotiation.cc:240] Negotiation successful
0808 11:34:40.794289 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":614,"thread_start_us":400,"threads_started":1}
I20260808 11:34:40.798923 9655 heartbeater.cc:347] Connected to a master server at 127.26.66.190:38927
I20260808 11:34:40.799233 9655 heartbeater.cc:464] Registering TS with master...
I20260808 11:34:40.800027 9655 heartbeater.cc:511] Master 127.26.66.190:38927 requested a full tablet report, sending...
I20260808 11:34:40.802265 9458 ts_manager.cc:194] Registered new tserver with Master: 83de2e6f8f694a97954dd42fcf151df0 (127.26.66.129:34541)
I20260808 11:34:40.803735 9458 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.129@KRBTEST.COM'} at 127.26.66.129:33875
W20260808 11:34:41.123905 9659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:34:41.124248 9659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:34:41.124439 9659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:34:41.131745 9659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:34:41.131903 9659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:34:41.132128 9659 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:34:41.142254 9659 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:46433
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=40775
--tserver_master_addrs=127.26.66.190:38927
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:34:41.143567 9659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:34:41.144907 9659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:34:41.158489 9664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:41.158454 9667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:41.158412 9665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:41.159493 9659 server_base.cc:1034] running on GCE node
I20260808 11:34:41.160152 9659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:34:41.161103 9659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:34:41.162307 9659 hybrid_clock.cc:648] HybridClock initialized: now 1786188881162267 us; error 33 us; skew 500 ppm
I20260808 11:34:41.162616 9659 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:34:41 dist-test-slave-zkpd krb5kdc[8833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188881, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:34:41.165971 9659 init.cc:377] Logged in from keytab as kudu/127.26.66.130@KRBTEST.COM (short username kudu)
I20260808 11:34:41.167466 9659 webserver.cc:460] Webserver started at http://127.26.66.130:40775/ using document root <none> and password file <none>
I20260808 11:34:41.168258 9659 fs_manager.cc:359] Metadata directory not provided
I20260808 11:34:41.168422 9659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:34:41.174104 9659 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260808 11:34:41.177322 9675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:41.178663 9659 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 11:34:41.178861 9659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "935961690c244bf08f6f6353a4a5e28b"
format_stamp: "Formatted at 2026-08-08 11:34:38 on dist-test-slave-zkpd"
server_key: "cfcb4e5432c52784d5b9b7ab9da507f6"
server_key_iv: "38532d2eef477462868c6941040772e4"
server_key_version: "encryptionkey@0"
I20260808 11:34:41.179840 9659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:34:41.205668 9659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:34:41.210078 9659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:34:41.210367 9659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:34:41.211376 9659 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:34:41.212754 9659 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:34:41.212891 9659 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:41.213025 9659 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:34:41.213115 9659 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:41.249838 9659 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:46433
I20260808 11:34:41.249925 9795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:46433 every 8 connection(s)
I20260808 11:34:41.251304 9659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:34:41.259282 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 9659
I20260808 11:34:41.260251 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:37891
--local_ip_for_outbound_sockets=127.26.66.131
--tserver_master_addrs=127.26.66.190:38927
--webserver_port=34561
--webserver_interface=127.26.66.131
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:45365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 11:34:41 dist-test-slave-zkpd krb5kdc[8833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188881, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:34:41.272291 9657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:41.254009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:43049 (local address 127.26.66.190:38927)
0808 11:34:41.254188 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:41.254193 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:41.255273 (+ 1080us) server_negotiation.cc:407] Connection header received
0808 11:34:41.257178 (+ 1905us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:41.257183 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:41.257306 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:41.257434 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:41.258989 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.259801 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.261510 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.262000 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.262160 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:41.265866 (+ 3706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:41.265873 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:41.265883 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:41.265923 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:41.268780 (+ 2857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:41.269667 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:41.269672 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:41.269674 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:41.269824 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:41.270309 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:41.270313 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:41.270315 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:41.270702 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:41.270874 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:41.271640 (+ 766us) server_negotiation.cc:299] Negotiation successful
0808 11:34:41.271924 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 11:34:41.273309 9799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:41.254370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.130:43049)
0808 11:34:41.255103 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:41.255147 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:41.256903 (+ 1756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:41.257681 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:41.257689 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:41.258186 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:34:41.258726 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:41.258743 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.260000 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.260005 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:41.261344 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:41.261357 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.262254 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.262261 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:41.262502 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:41.263218 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:34:41.263243 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:34:41.265651 (+ 2408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:34:41.268948 (+ 3297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:41.268957 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:41.268974 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:41.269522 (+ 548us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:41.269949 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:41.269954 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:41.269958 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:41.270162 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:41.270852 (+ 690us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:34:41.270860 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:34:41.271242 (+ 382us) client_negotiation.cc:769] Sending connection context
0808 11:34:41.271523 (+ 281us) client_negotiation.cc:240] Negotiation successful
0808 11:34:41.272119 (+ 596us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":298,"threads_started":1}
I20260808 11:34:41.274997 9796 heartbeater.cc:347] Connected to a master server at 127.26.66.190:38927
I20260808 11:34:41.275350 9796 heartbeater.cc:464] Registering TS with master...
I20260808 11:34:41.276206 9796 heartbeater.cc:511] Master 127.26.66.190:38927 requested a full tablet report, sending...
I20260808 11:34:41.277784 9458 ts_manager.cc:194] Registered new tserver with Master: 935961690c244bf08f6f6353a4a5e28b (127.26.66.130:46433)
I20260808 11:34:41.278599 9458 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.130@KRBTEST.COM'} at 127.26.66.130:43049
W20260808 11:34:41.611753 9800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:34:41.612124 9800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:34:41.612311 9800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:34:41.619458 9800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:34:41.619621 9800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:34:41.619817 9800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:34:41.629706 9800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:37891
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=34561
--tserver_master_addrs=127.26.66.190:38927
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:34:41.630999 9800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:34:41.632402 9800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:34:41.645473 9808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:41.645604 9805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:41.645577 9806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:41.646477 9800 server_base.cc:1034] running on GCE node
I20260808 11:34:41.647066 9800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:34:41.648018 9800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:34:41.649251 9800 hybrid_clock.cc:648] HybridClock initialized: now 1786188881649201 us; error 39 us; skew 500 ppm
I20260808 11:34:41.649573 9800 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:34:41 dist-test-slave-zkpd krb5kdc[8833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188881, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:34:41.652644 9800 init.cc:377] Logged in from keytab as kudu/127.26.66.131@KRBTEST.COM (short username kudu)
I20260808 11:34:41.654117 9800 webserver.cc:460] Webserver started at http://127.26.66.131:34561/ using document root <none> and password file <none>
I20260808 11:34:41.654785 9800 fs_manager.cc:359] Metadata directory not provided
I20260808 11:34:41.654947 9800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:34:41.660276 9800 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260808 11:34:41.662885 9815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:41.664289 9800 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:34:41.664479 9800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "685331d0e8d74734a0ab7ab09eb23fa2"
format_stamp: "Formatted at 2026-08-08 11:34:38 on dist-test-slave-zkpd"
server_key: "67ceb4d21772a6b4125d3d00d3c2ae98"
server_key_iv: "458cf4843d11294d1c615862ddc5f97d"
server_key_version: "encryptionkey@0"
I20260808 11:34:41.665465 9800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:34:41.679138 9800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:34:41.682824 9800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:34:41.683094 9800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:34:41.684136 9800 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:34:41.685459 9800 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:34:41.685570 9800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:41.685671 9800 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:34:41.685793 9800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:41.721695 9800 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:37891
I20260808 11:34:41.721796 9938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:37891 every 8 connection(s)
I20260808 11:34:41.723258 9800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:34:41.733182 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 9800
Aug 08 11:34:41 dist-test-slave-zkpd krb5kdc[8833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188881, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:34:41.743443 9657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:41.725851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:33407 (local address 127.26.66.190:38927)
0808 11:34:41.726039 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:41.726043 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:41.727163 (+ 1120us) server_negotiation.cc:407] Connection header received
0808 11:34:41.729064 (+ 1901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:41.729070 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:41.729165 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:41.729288 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:41.730778 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.731504 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.733125 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.733596 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.733761 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:41.737468 (+ 3707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:41.737473 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:41.737476 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:41.737507 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:41.740373 (+ 2866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:41.741106 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:41.741116 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:41.741118 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:41.741249 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:41.741706 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:41.741715 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:41.741717 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:41.741964 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:41.742124 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:41.742819 (+ 695us) server_negotiation.cc:299] Negotiation successful
0808 11:34:41.743071 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 11:34:41.744515 9941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:41.726287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.131:33407)
0808 11:34:41.726995 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:41.727033 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:41.728777 (+ 1744us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:41.729523 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:41.729531 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:41.730035 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:34:41.730597 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:41.730614 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.731691 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.731695 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:41.732970 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:41.732983 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.733868 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.733877 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:41.734196 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:41.735017 (+ 821us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:34:41.735040 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:34:41.737243 (+ 2203us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:34:41.740522 (+ 3279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:41.740531 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:41.740545 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:41.740969 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:41.741376 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:34:41.741381 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:34:41.741385 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:34:41.741574 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:34:41.742101 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:34:41.742108 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:34:41.742432 (+ 324us) client_negotiation.cc:769] Sending connection context
0808 11:34:41.742697 (+ 265us) client_negotiation.cc:240] Negotiation successful
0808 11:34:41.743224 (+ 527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":271,"threads_started":1}
I20260808 11:34:41.746013 9939 heartbeater.cc:347] Connected to a master server at 127.26.66.190:38927
I20260808 11:34:41.746340 9939 heartbeater.cc:464] Registering TS with master...
I20260808 11:34:41.747071 9939 heartbeater.cc:511] Master 127.26.66.190:38927 requested a full tablet report, sending...
I20260808 11:34:41.748517 9943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:41.734161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59216 (local address 127.26.66.190:38927)
0808 11:34:41.734996 (+ 835us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:41.735002 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:41.735020 (+ 18us) server_negotiation.cc:407] Connection header received
0808 11:34:41.735074 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:41.735077 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:41.735126 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:41.735249 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:41.736826 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.737581 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.739317 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.739780 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.739943 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:41.742527 (+ 2584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:41.742532 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:41.742535 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:41.742562 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:41.745689 (+ 3127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:41.746435 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:41.746440 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:41.746443 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:41.746573 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:41.746965 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:41.746970 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:41.746974 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:41.747295 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:41.747567 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:41.747873 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 11:34:41.748120 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":720,"thread_start_us":705,"threads_started":1}
I20260808 11:34:41.748683 9458 ts_manager.cc:194] Registered new tserver with Master: 685331d0e8d74734a0ab7ab09eb23fa2 (127.26.66.131:37891)
I20260808 11:34:41.749703 9458 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.131@KRBTEST.COM'} at 127.26.66.131:33407
I20260808 11:34:41.751274 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 11:34:41.758184 9943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:41.752426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59228 (local address 127.26.66.190:38927)
0808 11:34:41.752653 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:41.752660 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:41.752967 (+ 307us) server_negotiation.cc:407] Connection header received
0808 11:34:41.753209 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:41.753215 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:41.753342 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:41.753488 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:34:41.753919 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.754568 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.756060 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.756493 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.756628 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:41.757123 (+ 495us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:34:41.757596 (+ 473us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:34:41.757759 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:41.757862 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 11:34:41.757936 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 11:34:41.759178 9457 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:59228:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 11:34:41.767629 9457 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:34:41.795320 9950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:41.781311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:46433 (local address 127.0.0.1:52924)
0808 11:34:41.783246 (+ 1935us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:41.783265 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:41.783379 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:41.784717 (+ 1338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:41.784730 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:41.784773 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:34:41.785339 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:41.785358 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.788156 (+ 2798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.788165 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:41.791361 (+ 3196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:41.791382 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.794036 (+ 2654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.794046 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:41.794340 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:41.794414 (+ 74us) client_negotiation.cc:769] Sending connection context
0808 11:34:41.794537 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 11:34:41.794784 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1821,"thread_start_us":1692,"threads_started":1}
I20260808 11:34:41.796916 9952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:41.781969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52924 (local address 127.26.66.130:46433)
0808 11:34:41.783986 (+ 2017us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:41.783996 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:41.784033 (+ 37us) server_negotiation.cc:407] Connection header received
0808 11:34:41.784145 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:41.784157 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:41.784420 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:41.785620 (+ 1200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:34:41.785939 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.787935 (+ 1996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.791681 (+ 3746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.793691 (+ 2010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.796185 (+ 2494us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:41.796406 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:41.796477 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 11:34:41.796655 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1831,"thread_start_us":1684,"threads_started":1}
I20260808 11:34:41.797953 9949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:41.781136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:37891 (local address 127.0.0.1:34830)
0808 11:34:41.782567 (+ 1431us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:41.782618 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:41.782813 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:41.785929 (+ 3116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:41.785937 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:41.785974 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:34:41.786446 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:41.786460 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.790515 (+ 4055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.790528 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:41.794792 (+ 4264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:41.794813 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.797132 (+ 2319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.797137 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:41.797324 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:41.797355 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 11:34:41.797452 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 11:34:41.797606 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1113,"thread_start_us":960,"threads_started":1}
I20260808 11:34:41.798676 9951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:41.781439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34830 (local address 127.26.66.131:37891)
0808 11:34:41.783421 (+ 1982us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:41.783434 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:41.783478 (+ 44us) server_negotiation.cc:407] Connection header received
0808 11:34:41.783745 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:41.783752 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:41.785293 (+ 1541us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:41.785541 (+ 248us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:34:41.786685 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.790295 (+ 3610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.795066 (+ 4771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.796895 (+ 1829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.797024 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:41.797750 (+ 726us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:41.798138 (+ 388us) server_negotiation.cc:299] Negotiation successful
0808 11:34:41.798327 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1769,"thread_start_us":1585,"threads_started":1}
I20260808 11:34:41.801215 9726 tablet_service.cc:1467] Processing CreateTablet for tablet 71cc5e7b611645ef80f175d7903c202a (DEFAULT_TABLE table=test-table [id=882fcfe55e5441718c181ec3052f0811]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:34:41.801868 9868 tablet_service.cc:1467] Processing CreateTablet for tablet 71cc5e7b611645ef80f175d7903c202a (DEFAULT_TABLE table=test-table [id=882fcfe55e5441718c181ec3052f0811]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:34:41.802722 9726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71cc5e7b611645ef80f175d7903c202a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:34:41.803294 9868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71cc5e7b611645ef80f175d7903c202a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:34:41.805058 9953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:41.783883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:34541 (local address 127.0.0.1:45526)
0808 11:34:41.796490 (+ 12607us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:41.796508 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:41.796615 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:41.797934 (+ 1319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:41.797943 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:41.797972 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:34:41.798325 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:41.798337 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.800057 (+ 1720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.800063 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:41.802013 (+ 1950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:41.802031 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.804280 (+ 2249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.804287 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:41.804462 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:41.804494 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 11:34:41.804597 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 11:34:41.804730 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12203,"thread_start_us":12261,"threads_started":1}
I20260808 11:34:41.805163 9954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:41.784398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45526 (local address 127.26.66.129:34541)
0808 11:34:41.796694 (+ 12296us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:41.796703 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:41.796731 (+ 28us) server_negotiation.cc:407] Connection header received
0808 11:34:41.796839 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:41.796847 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:41.797076 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:41.798587 (+ 1511us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:34:41.798797 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.799879 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.802194 (+ 2315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.803760 (+ 1566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.803917 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:41.804128 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:41.804694 (+ 566us) server_negotiation.cc:299] Negotiation successful
0808 11:34:41.804849 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12121,"thread_start_us":12897,"threads_started":1}
I20260808 11:34:41.806645 9655 heartbeater.cc:503] Master 127.26.66.190:38927 was elected leader, sending a full tablet report...
I20260808 11:34:41.807274 9588 tablet_service.cc:1467] Processing CreateTablet for tablet 71cc5e7b611645ef80f175d7903c202a (DEFAULT_TABLE table=test-table [id=882fcfe55e5441718c181ec3052f0811]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:34:41.808514 9588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71cc5e7b611645ef80f175d7903c202a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:34:41.815943 9955 tablet_bootstrap.cc:492] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b: Bootstrap starting.
I20260808 11:34:41.818257 9957 tablet_bootstrap.cc:492] T 71cc5e7b611645ef80f175d7903c202a P 83de2e6f8f694a97954dd42fcf151df0: Bootstrap starting.
I20260808 11:34:41.819099 9956 tablet_bootstrap.cc:492] T 71cc5e7b611645ef80f175d7903c202a P 685331d0e8d74734a0ab7ab09eb23fa2: Bootstrap starting.
I20260808 11:34:41.821206 9955 tablet_bootstrap.cc:654] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b: Neither blocks nor log segments found. Creating new log.
I20260808 11:34:41.822479 9957 tablet_bootstrap.cc:654] T 71cc5e7b611645ef80f175d7903c202a P 83de2e6f8f694a97954dd42fcf151df0: Neither blocks nor log segments found. Creating new log.
I20260808 11:34:41.822556 9955 log.cc:824] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b: Log is configured to *not* fsync() on all Append() calls
I20260808 11:34:41.822644 9956 tablet_bootstrap.cc:654] T 71cc5e7b611645ef80f175d7903c202a P 685331d0e8d74734a0ab7ab09eb23fa2: Neither blocks nor log segments found. Creating new log.
I20260808 11:34:41.823679 9957 log.cc:824] T 71cc5e7b611645ef80f175d7903c202a P 83de2e6f8f694a97954dd42fcf151df0: Log is configured to *not* fsync() on all Append() calls
I20260808 11:34:41.823856 9956 log.cc:824] T 71cc5e7b611645ef80f175d7903c202a P 685331d0e8d74734a0ab7ab09eb23fa2: Log is configured to *not* fsync() on all Append() calls
I20260808 11:34:41.826084 9957 tablet_bootstrap.cc:492] T 71cc5e7b611645ef80f175d7903c202a P 83de2e6f8f694a97954dd42fcf151df0: No bootstrap required, opened a new log
I20260808 11:34:41.826222 9955 tablet_bootstrap.cc:492] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b: No bootstrap required, opened a new log
I20260808 11:34:41.826363 9957 ts_tablet_manager.cc:1397] T 71cc5e7b611645ef80f175d7903c202a P 83de2e6f8f694a97954dd42fcf151df0: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260808 11:34:41.826610 9955 ts_tablet_manager.cc:1397] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260808 11:34:41.828749 9956 tablet_bootstrap.cc:492] T 71cc5e7b611645ef80f175d7903c202a P 685331d0e8d74734a0ab7ab09eb23fa2: No bootstrap required, opened a new log
I20260808 11:34:41.829011 9956 ts_tablet_manager.cc:1397] T 71cc5e7b611645ef80f175d7903c202a P 685331d0e8d74734a0ab7ab09eb23fa2: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260808 11:34:41.833916 9957 raft_consensus.cc:348] T 71cc5e7b611645ef80f175d7903c202a P 83de2e6f8f694a97954dd42fcf151df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "685331d0e8d74734a0ab7ab09eb23fa2" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 37891 } } peers { permanent_uuid: "935961690c244bf08f6f6353a4a5e28b" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46433 } } peers { permanent_uuid: "83de2e6f8f694a97954dd42fcf151df0" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34541 } }
I20260808 11:34:41.834263 9957 raft_consensus.cc:374] T 71cc5e7b611645ef80f175d7903c202a P 83de2e6f8f694a97954dd42fcf151df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:34:41.834393 9957 raft_consensus.cc:729] T 71cc5e7b611645ef80f175d7903c202a P 83de2e6f8f694a97954dd42fcf151df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83de2e6f8f694a97954dd42fcf151df0, State: Initialized, Role: FOLLOWER
I20260808 11:34:41.835007 9957 consensus_queue.cc:260] T 71cc5e7b611645ef80f175d7903c202a P 83de2e6f8f694a97954dd42fcf151df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "685331d0e8d74734a0ab7ab09eb23fa2" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 37891 } } peers { permanent_uuid: "935961690c244bf08f6f6353a4a5e28b" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46433 } } peers { permanent_uuid: "83de2e6f8f694a97954dd42fcf151df0" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34541 } }
I20260808 11:34:41.836786 9957 ts_tablet_manager.cc:1428] T 71cc5e7b611645ef80f175d7903c202a P 83de2e6f8f694a97954dd42fcf151df0: Time spent starting tablet: real 0.010s user 0.004s sys 0.005s
I20260808 11:34:41.837595 9955 raft_consensus.cc:348] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "685331d0e8d74734a0ab7ab09eb23fa2" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 37891 } } peers { permanent_uuid: "935961690c244bf08f6f6353a4a5e28b" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46433 } } peers { permanent_uuid: "83de2e6f8f694a97954dd42fcf151df0" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34541 } }
I20260808 11:34:41.838013 9955 raft_consensus.cc:374] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:34:41.838114 9955 raft_consensus.cc:729] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 935961690c244bf08f6f6353a4a5e28b, State: Initialized, Role: FOLLOWER
I20260808 11:34:41.838676 9955 consensus_queue.cc:260] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "685331d0e8d74734a0ab7ab09eb23fa2" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 37891 } } peers { permanent_uuid: "935961690c244bf08f6f6353a4a5e28b" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46433 } } peers { permanent_uuid: "83de2e6f8f694a97954dd42fcf151df0" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34541 } }
I20260808 11:34:41.839685 9956 raft_consensus.cc:348] T 71cc5e7b611645ef80f175d7903c202a P 685331d0e8d74734a0ab7ab09eb23fa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "685331d0e8d74734a0ab7ab09eb23fa2" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 37891 } } peers { permanent_uuid: "935961690c244bf08f6f6353a4a5e28b" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46433 } } peers { permanent_uuid: "83de2e6f8f694a97954dd42fcf151df0" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34541 } }
I20260808 11:34:41.840302 9956 raft_consensus.cc:374] T 71cc5e7b611645ef80f175d7903c202a P 685331d0e8d74734a0ab7ab09eb23fa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:34:41.840428 9956 raft_consensus.cc:729] T 71cc5e7b611645ef80f175d7903c202a P 685331d0e8d74734a0ab7ab09eb23fa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 685331d0e8d74734a0ab7ab09eb23fa2, State: Initialized, Role: FOLLOWER
I20260808 11:34:41.841141 9956 consensus_queue.cc:260] T 71cc5e7b611645ef80f175d7903c202a P 685331d0e8d74734a0ab7ab09eb23fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "685331d0e8d74734a0ab7ab09eb23fa2" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 37891 } } peers { permanent_uuid: "935961690c244bf08f6f6353a4a5e28b" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46433 } } peers { permanent_uuid: "83de2e6f8f694a97954dd42fcf151df0" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34541 } }
I20260808 11:34:41.844580 9939 heartbeater.cc:503] Master 127.26.66.190:38927 was elected leader, sending a full tablet report...
I20260808 11:34:41.845042 9796 heartbeater.cc:503] Master 127.26.66.190:38927 was elected leader, sending a full tablet report...
I20260808 11:34:41.845360 9956 ts_tablet_manager.cc:1428] T 71cc5e7b611645ef80f175d7903c202a P 685331d0e8d74734a0ab7ab09eb23fa2: Time spent starting tablet: real 0.016s user 0.011s sys 0.004s
I20260808 11:34:41.846793 9955 ts_tablet_manager.cc:1428] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b: Time spent starting tablet: real 0.020s user 0.011s sys 0.007s
I20260808 11:34:41.966403 9963 raft_consensus.cc:482] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:34:41.966740 9963 raft_consensus.cc:504] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "685331d0e8d74734a0ab7ab09eb23fa2" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 37891 } } peers { permanent_uuid: "935961690c244bf08f6f6353a4a5e28b" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46433 } } peers { permanent_uuid: "83de2e6f8f694a97954dd42fcf151df0" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34541 } }
I20260808 11:34:41.968734 9963 leader_election.cc:288] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 685331d0e8d74734a0ab7ab09eb23fa2 (127.26.66.131:37891), 83de2e6f8f694a97954dd42fcf151df0 (127.26.66.129:34541)
W20260808 11:34:41.974956 9940 tablet.cc:2369] T 71cc5e7b611645ef80f175d7903c202a P 685331d0e8d74734a0ab7ab09eb23fa2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:34:41.976728 9954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:41.969229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:35865 (local address 127.26.66.129:34541)
0808 11:34:41.969513 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:41.969523 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:41.970937 (+ 1414us) server_negotiation.cc:407] Connection header received
0808 11:34:41.971133 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:41.971138 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:41.971213 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:41.971329 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:34:41.971962 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.972683 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.974618 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.975726 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.975932 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:41.976015 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:41.976346 (+ 331us) server_negotiation.cc:299] Negotiation successful
0808 11:34:41.976470 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260808 11:34:41.976912 9965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:41.969791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:34541 (local address 127.26.66.130:35865)
0808 11:34:41.970803 (+ 1012us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:41.970824 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:41.970957 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:41.971349 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:41.971352 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:41.971371 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:34:41.971750 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:41.971761 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.972852 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.972855 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:41.974462 (+ 1607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:41.974475 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.975978 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.975985 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:41.976174 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:41.976199 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 11:34:41.976316 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 11:34:41.976451 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":850,"mutex_wait_us":1,"thread_start_us":520,"threads_started":1}
I20260808 11:34:41.977103 9951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:41.969473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:38359 (local address 127.26.66.131:37891)
0808 11:34:41.969741 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:41.969750 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:41.970736 (+ 986us) server_negotiation.cc:407] Connection header received
0808 11:34:41.970897 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:41.970903 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:41.970982 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:41.971087 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:34:41.971736 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.972558 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.974739 (+ 2181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.976139 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.976319 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:41.976401 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:41.976719 (+ 318us) server_negotiation.cc:299] Negotiation successful
0808 11:34:41.976851 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 11:34:41.977317 9966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:41.969048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:37891 (local address 127.26.66.130:38359)
0808 11:34:41.970620 (+ 1572us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:41.970636 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 11:34:41.970753 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:34:41.971127 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:34:41.971131 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:34:41.971158 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:34:41.971577 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:41.971589 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.972693 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.972697 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:41.974539 (+ 1842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:34:41.974556 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:34:41.976390 (+ 1834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:34:41.976396 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:34:41.976548 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:41.976571 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 11:34:41.976683 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 11:34:41.976810 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1453,"mutex_wait_us":22,"thread_start_us":930,"threads_started":1}
I20260808 11:34:41.978168 9609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71cc5e7b611645ef80f175d7903c202a" candidate_uuid: "935961690c244bf08f6f6353a4a5e28b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83de2e6f8f694a97954dd42fcf151df0" is_pre_election: true
I20260808 11:34:41.978204 9891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71cc5e7b611645ef80f175d7903c202a" candidate_uuid: "935961690c244bf08f6f6353a4a5e28b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "685331d0e8d74734a0ab7ab09eb23fa2" is_pre_election: true
I20260808 11:34:41.978677 9609 raft_consensus.cc:2454] T 71cc5e7b611645ef80f175d7903c202a P 83de2e6f8f694a97954dd42fcf151df0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 935961690c244bf08f6f6353a4a5e28b in term 0.
I20260808 11:34:41.978700 9891 raft_consensus.cc:2454] T 71cc5e7b611645ef80f175d7903c202a P 685331d0e8d74734a0ab7ab09eb23fa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 935961690c244bf08f6f6353a4a5e28b in term 0.
I20260808 11:34:41.979342 9678 leader_election.cc:302] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83de2e6f8f694a97954dd42fcf151df0, 935961690c244bf08f6f6353a4a5e28b; no voters:
I20260808 11:34:41.979743 9963 raft_consensus.cc:2781] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:34:41.979874 9963 raft_consensus.cc:482] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:34:41.980052 9963 raft_consensus.cc:3037] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:34:41.982375 9963 raft_consensus.cc:504] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "685331d0e8d74734a0ab7ab09eb23fa2" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 37891 } } peers { permanent_uuid: "935961690c244bf08f6f6353a4a5e28b" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46433 } } peers { permanent_uuid: "83de2e6f8f694a97954dd42fcf151df0" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34541 } }
I20260808 11:34:41.982982 9963 leader_election.cc:288] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b [CANDIDATE]: Term 1 election: Requested vote from peers 685331d0e8d74734a0ab7ab09eb23fa2 (127.26.66.131:37891), 83de2e6f8f694a97954dd42fcf151df0 (127.26.66.129:34541)
I20260808 11:34:41.983448 9891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71cc5e7b611645ef80f175d7903c202a" candidate_uuid: "935961690c244bf08f6f6353a4a5e28b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "685331d0e8d74734a0ab7ab09eb23fa2"
I20260808 11:34:41.983453 9609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71cc5e7b611645ef80f175d7903c202a" candidate_uuid: "935961690c244bf08f6f6353a4a5e28b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83de2e6f8f694a97954dd42fcf151df0"
I20260808 11:34:41.983651 9891 raft_consensus.cc:3037] T 71cc5e7b611645ef80f175d7903c202a P 685331d0e8d74734a0ab7ab09eb23fa2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:34:41.983664 9609 raft_consensus.cc:3037] T 71cc5e7b611645ef80f175d7903c202a P 83de2e6f8f694a97954dd42fcf151df0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:34:41.986078 9891 raft_consensus.cc:2454] T 71cc5e7b611645ef80f175d7903c202a P 685331d0e8d74734a0ab7ab09eb23fa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 935961690c244bf08f6f6353a4a5e28b in term 1.
I20260808 11:34:41.986394 9609 raft_consensus.cc:2454] T 71cc5e7b611645ef80f175d7903c202a P 83de2e6f8f694a97954dd42fcf151df0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 935961690c244bf08f6f6353a4a5e28b in term 1.
I20260808 11:34:41.986560 9676 leader_election.cc:302] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 685331d0e8d74734a0ab7ab09eb23fa2, 935961690c244bf08f6f6353a4a5e28b; no voters:
I20260808 11:34:41.986961 9963 raft_consensus.cc:2781] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:34:41.987411 9963 raft_consensus.cc:686] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b [term 1 LEADER]: Becoming Leader. State: Replica: 935961690c244bf08f6f6353a4a5e28b, State: Running, Role: LEADER
I20260808 11:34:41.987874 9963 consensus_queue.cc:237] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "685331d0e8d74734a0ab7ab09eb23fa2" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 37891 } } peers { permanent_uuid: "935961690c244bf08f6f6353a4a5e28b" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46433 } } peers { permanent_uuid: "83de2e6f8f694a97954dd42fcf151df0" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34541 } }
I20260808 11:34:41.992769 9457 catalog_manager.cc:5495] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b reported cstate change: term changed from 0 to 1, leader changed from <none> to 935961690c244bf08f6f6353a4a5e28b (127.26.66.130). New cstate: current_term: 1 leader_uuid: "935961690c244bf08f6f6353a4a5e28b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "685331d0e8d74734a0ab7ab09eb23fa2" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 37891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "935961690c244bf08f6f6353a4a5e28b" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 46433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83de2e6f8f694a97954dd42fcf151df0" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34541 } health_report { overall_health: UNKNOWN } } }
W20260808 11:34:42.003482 9798 tablet.cc:2369] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 11:34:42.021329 9656 tablet.cc:2369] T 71cc5e7b611645ef80f175d7903c202a P 83de2e6f8f694a97954dd42fcf151df0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:34:42.029181 9952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:42.023448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52934 (local address 127.26.66.130:46433)
0808 11:34:42.023661 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:42.023668 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:42.023713 (+ 45us) server_negotiation.cc:407] Connection header received
0808 11:34:42.024004 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:42.024009 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:42.024102 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:42.024264 (+ 162us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:34:42.024679 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:42.025426 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:42.026920 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:42.027346 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:42.027492 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:42.028047 (+ 555us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:34:42.028529 (+ 482us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:34:42.028694 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:42.028827 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 11:34:42.028906 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 11:34:42.037106 9609 raft_consensus.cc:1261] T 71cc5e7b611645ef80f175d7903c202a P 83de2e6f8f694a97954dd42fcf151df0 [term 1 FOLLOWER]: Refusing update from remote peer 935961690c244bf08f6f6353a4a5e28b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:34:42.037163 9891 raft_consensus.cc:1261] T 71cc5e7b611645ef80f175d7903c202a P 685331d0e8d74734a0ab7ab09eb23fa2 [term 1 FOLLOWER]: Refusing update from remote peer 935961690c244bf08f6f6353a4a5e28b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:34:42.038125 9967 consensus_queue.cc:1035] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b [LEADER]: Connected to new peer: Peer: permanent_uuid: "83de2e6f8f694a97954dd42fcf151df0" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 34541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:34:42.038477 9963 consensus_queue.cc:1035] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b [LEADER]: Connected to new peer: Peer: permanent_uuid: "685331d0e8d74734a0ab7ab09eb23fa2" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 37891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:34:42.052291 9972 mvcc.cc:205] Tried to move back new op lower bound from 7316229660814512128 to 7316229660626477056. Current Snapshot: MvccSnapshot[applied={T|T < 7316229660814512128}]
I20260808 11:34:42.056464 9971 mvcc.cc:205] Tried to move back new op lower bound from 7316229660814512128 to 7316229660626477056. Current Snapshot: MvccSnapshot[applied={T|T < 7316229660814512128}]
I20260808 11:34:42.069197 9458 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:59228:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:34:42.069554 9458 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:59228:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:34:42.073225 9458 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24: Sending DeleteTablet for 3 replicas of tablet 71cc5e7b611645ef80f175d7903c202a
I20260808 11:34:42.074481 9868 tablet_service.cc:1514] Processing DeleteTablet for tablet 71cc5e7b611645ef80f175d7903c202a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:34:42 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:34830
I20260808 11:34:42.074522 9588 tablet_service.cc:1514] Processing DeleteTablet for tablet 71cc5e7b611645ef80f175d7903c202a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:34:42 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:45526
I20260808 11:34:42.074476 9726 tablet_service.cc:1514] Processing DeleteTablet for tablet 71cc5e7b611645ef80f175d7903c202a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:34:42 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:52924
I20260808 11:34:42.078925 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 9499
I20260808 11:34:42.084822 9982 tablet_replica.cc:330] T 71cc5e7b611645ef80f175d7903c202a P 685331d0e8d74734a0ab7ab09eb23fa2: stopping tablet replica
I20260808 11:34:42.085496 9982 raft_consensus.cc:2229] T 71cc5e7b611645ef80f175d7903c202a P 685331d0e8d74734a0ab7ab09eb23fa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:34:42.086179 9984 tablet_replica.cc:330] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b: stopping tablet replica
I20260808 11:34:42.086714 9982 raft_consensus.cc:2258] T 71cc5e7b611645ef80f175d7903c202a P 685331d0e8d74734a0ab7ab09eb23fa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:34:42.087186 9984 raft_consensus.cc:2229] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b [term 1 LEADER]: Raft consensus shutting down.
I20260808 11:34:42.089056 9983 tablet_replica.cc:330] T 71cc5e7b611645ef80f175d7903c202a P 83de2e6f8f694a97954dd42fcf151df0: stopping tablet replica
I20260808 11:34:42.089525 9983 raft_consensus.cc:2229] T 71cc5e7b611645ef80f175d7903c202a P 83de2e6f8f694a97954dd42fcf151df0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:34:42.089715 9982 ts_tablet_manager.cc:1905] T 71cc5e7b611645ef80f175d7903c202a P 685331d0e8d74734a0ab7ab09eb23fa2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:34:42.090027 9984 raft_consensus.cc:2258] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:34:42.090099 9983 raft_consensus.cc:2258] T 71cc5e7b611645ef80f175d7903c202a P 83de2e6f8f694a97954dd42fcf151df0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:34:42.092427 9983 ts_tablet_manager.cc:1905] T 71cc5e7b611645ef80f175d7903c202a P 83de2e6f8f694a97954dd42fcf151df0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:34:42.094169 9984 ts_tablet_manager.cc:1905] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:34:42.099833 9983 ts_tablet_manager.cc:1918] T 71cc5e7b611645ef80f175d7903c202a P 83de2e6f8f694a97954dd42fcf151df0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:34:42.100060 9983 log.cc:1196] T 71cc5e7b611645ef80f175d7903c202a P 83de2e6f8f694a97954dd42fcf151df0: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/wal/wals/71cc5e7b611645ef80f175d7903c202a
I20260808 11:34:42.100615 9983 ts_tablet_manager.cc:1939] T 71cc5e7b611645ef80f175d7903c202a P 83de2e6f8f694a97954dd42fcf151df0: Deleting consensus metadata
I20260808 11:34:42.101231 9954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:42.080649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45540 (local address 127.26.66.129:34541)
0808 11:34:42.080914 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:42.080923 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:42.080950 (+ 27us) server_negotiation.cc:407] Connection header received
0808 11:34:42.081025 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:42.081034 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:42.081138 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:42.081282 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:42.083558 (+ 2276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:42.085255 (+ 1697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:42.087332 (+ 2077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:42.088253 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:42.088396 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:42.092055 (+ 3659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:42.092070 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:42.092086 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:42.092129 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:42.096416 (+ 4287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:42.097366 (+ 950us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:42.097376 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:42.097380 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:42.097600 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:42.098135 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:42.098141 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:42.098147 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:42.098634 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:42.098962 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:42.100281 (+ 1319us) server_negotiation.cc:299] Negotiation successful
0808 11:34:42.100583 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 11:34:42.102051 9650 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:34:42.105185 9984 ts_tablet_manager.cc:1918] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:34:42.105489 9984 log.cc:1196] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/wal/wals/71cc5e7b611645ef80f175d7903c202a
I20260808 11:34:42.105681 9982 ts_tablet_manager.cc:1918] T 71cc5e7b611645ef80f175d7903c202a P 685331d0e8d74734a0ab7ab09eb23fa2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:34:42.105927 9982 log.cc:1196] T 71cc5e7b611645ef80f175d7903c202a P 685331d0e8d74734a0ab7ab09eb23fa2: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/wal/wals/71cc5e7b611645ef80f175d7903c202a
I20260808 11:34:42.106297 9984 ts_tablet_manager.cc:1939] T 71cc5e7b611645ef80f175d7903c202a P 935961690c244bf08f6f6353a4a5e28b: Deleting consensus metadata
I20260808 11:34:42.106567 9982 ts_tablet_manager.cc:1939] T 71cc5e7b611645ef80f175d7903c202a P 685331d0e8d74734a0ab7ab09eb23fa2: Deleting consensus metadata
I20260808 11:34:42.108587 9441 catalog_manager.cc:4841] TS 685331d0e8d74734a0ab7ab09eb23fa2 (127.26.66.131:37891): tablet 71cc5e7b611645ef80f175d7903c202a (table test-table [id=882fcfe55e5441718c181ec3052f0811]) successfully deleted
I20260808 11:34:42.108772 9444 catalog_manager.cc:4841] TS 935961690c244bf08f6f6353a4a5e28b (127.26.66.130:46433): tablet 71cc5e7b611645ef80f175d7903c202a (table test-table [id=882fcfe55e5441718c181ec3052f0811]) successfully deleted
I20260808 11:34:42.201972 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 9499
I20260808 11:34:42.202131 9443 catalog_manager.cc:4841] TS 83de2e6f8f694a97954dd42fcf151df0 (127.26.66.129:34541): tablet 71cc5e7b611645ef80f175d7903c202a (table test-table [id=882fcfe55e5441718c181ec3052f0811]) successfully deleted
I20260808 11:34:42.225874 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 9659
I20260808 11:34:42.244974 9952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:42.226706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52948 (local address 127.26.66.130:46433)
0808 11:34:42.226910 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:42.226916 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:42.226942 (+ 26us) server_negotiation.cc:407] Connection header received
0808 11:34:42.227144 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:42.227150 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:42.227283 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:42.227388 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:42.229263 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:42.230480 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:42.232534 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:42.233224 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:42.233346 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:42.237062 (+ 3716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:42.237085 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:42.237108 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:42.237168 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:42.241593 (+ 4425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:42.242535 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:42.242545 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:42.242549 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:42.242744 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:42.243180 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:42.243185 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:42.243189 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:42.243670 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:42.244072 (+ 402us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:42.244361 (+ 289us) server_negotiation.cc:299] Negotiation successful
0808 11:34:42.244581 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 11:34:42.245810 9791 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:34:42.364073 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 9659
I20260808 11:34:42.387176 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 9800
I20260808 11:34:42.400420 9951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:42.388008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34840 (local address 127.26.66.131:37891)
0808 11:34:42.388214 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:42.388218 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:42.388237 (+ 19us) server_negotiation.cc:407] Connection header received
0808 11:34:42.388397 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:42.388401 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:42.388465 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:42.388549 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:42.389952 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:42.390681 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:42.392052 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:42.392421 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:42.392513 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:42.395091 (+ 2578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:42.395104 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:42.395119 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:42.395155 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:42.398053 (+ 2898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:42.398659 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:42.398665 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:42.398667 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:42.398793 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:42.399110 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:42.399113 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:42.399114 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:42.399473 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:42.399706 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:42.399988 (+ 282us) server_negotiation.cc:299] Negotiation successful
0808 11:34:42.400165 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 11:34:42.401105 9934 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:34:42.490734 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 9800
I20260808 11:34:42.512400 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 9424
I20260808 11:34:42.513645 9490 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:34:42.628374 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 9424
I20260808 11:34:42.654974 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:38927
--webserver_interface=127.26.66.190
--webserver_port=34899
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:45365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:38927
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:34:43.003746 9990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:34:43.004175 9990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:34:43.004352 9990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:34:43.011759 9990 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:34:43.011941 9990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:34:43.012063 9990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:34:43.012166 9990 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:34:43.012255 9990 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:34:43.022454 9990 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:38927
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:38927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=34899
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:34:43.023962 9990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:34:43.025338 9990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:34:43.037272 9998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:43.037329 9996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:43.037374 9995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:43.038285 9990 server_base.cc:1034] running on GCE node
I20260808 11:34:43.039103 9990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:34:43.040530 9990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:34:43.041742 9990 hybrid_clock.cc:648] HybridClock initialized: now 1786188883041706 us; error 30 us; skew 500 ppm
I20260808 11:34:43.042105 9990 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:34:43 dist-test-slave-zkpd krb5kdc[8833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188883, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:34:43.045408 9990 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:34:43.046833 9990 webserver.cc:460] Webserver started at http://127.26.66.190:34899/ using document root <none> and password file <none>
I20260808 11:34:43.047546 9990 fs_manager.cc:359] Metadata directory not provided
I20260808 11:34:43.047705 9990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:34:43.053205 9990 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 11:34:43.056094 10005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:43.057400 9990 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 11:34:43.057591 9990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "4c13ccee25ef462cbadc4201df8f7b24"
format_stamp: "Formatted at 2026-08-08 11:34:37 on dist-test-slave-zkpd"
server_key: "632573bae73682bde0ba99419233c243"
server_key_iv: "27989c41dc8e9e012fd0e2ec4827dbd2"
server_key_version: "encryptionkey@0"
I20260808 11:34:43.058596 9990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:34:43.079754 9990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:34:43.084360 9990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:34:43.084681 9990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:34:43.103993 9990 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:38927
I20260808 11:34:43.104013 10058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:38927 every 8 connection(s)
I20260808 11:34:43.105494 9990 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:34:43.112538 10059 sys_catalog.cc:263] Verifying existing consensus state
I20260808 11:34:43.115504 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 9990
I20260808 11:34:43.115832 10059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24: Bootstrap starting.
I20260808 11:34:43.116468 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:34541
--local_ip_for_outbound_sockets=127.26.66.129
--tserver_master_addrs=127.26.66.190:38927
--webserver_port=37711
--webserver_interface=127.26.66.129
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:45365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 11:34:43.136574 10059 log.cc:824] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24: Log is configured to *not* fsync() on all Append() calls
I20260808 11:34:43.153061 10059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 11:34:43.153635 10059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24: Bootstrap complete.
I20260808 11:34:43.163556 10059 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c13ccee25ef462cbadc4201df8f7b24" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38927 } }
I20260808 11:34:43.164585 10059 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c13ccee25ef462cbadc4201df8f7b24, State: Initialized, Role: FOLLOWER
I20260808 11:34:43.165241 10059 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c13ccee25ef462cbadc4201df8f7b24" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38927 } }
I20260808 11:34:43.165498 10059 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:34:43.165640 10059 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:34:43.165838 10059 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [term 2 FOLLOWER]: Advancing to term 3
I20260808 11:34:43.169837 10059 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c13ccee25ef462cbadc4201df8f7b24" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38927 } }
I20260808 11:34:43.170359 10059 leader_election.cc:302] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c13ccee25ef462cbadc4201df8f7b24; no voters:
I20260808 11:34:43.171084 10059 leader_election.cc:288] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 11:34:43.171236 10063 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 11:34:43.172508 10063 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [term 3 LEADER]: Becoming Leader. State: Replica: 4c13ccee25ef462cbadc4201df8f7b24, State: Running, Role: LEADER
I20260808 11:34:43.173123 10063 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c13ccee25ef462cbadc4201df8f7b24" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38927 } }
I20260808 11:34:43.173399 10059 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:34:43.176550 10065 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c13ccee25ef462cbadc4201df8f7b24. Latest consensus state: current_term: 3 leader_uuid: "4c13ccee25ef462cbadc4201df8f7b24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c13ccee25ef462cbadc4201df8f7b24" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38927 } } }
I20260808 11:34:43.176900 10065 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [sys.catalog]: This master's current role is: LEADER
I20260808 11:34:43.177518 10064 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "4c13ccee25ef462cbadc4201df8f7b24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c13ccee25ef462cbadc4201df8f7b24" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 38927 } } }
I20260808 11:34:43.177858 10064 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c13ccee25ef462cbadc4201df8f7b24 [sys.catalog]: This master's current role is: LEADER
I20260808 11:34:43.188205 10069 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:34:43.197247 10069 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:34:43.198927 10069 catalog_manager.cc:1259] Loaded cluster ID: cf2de7a7d08c4e978ec487e638a701c1
I20260808 11:34:43.199095 10069 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 11:34:43.201274 10069 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fd2e1c0f9ad google::LogMessage::Fail() at ??:0
@ 0x7fd2e1c1288a google::LogMessage::SendToLog() at ??:0
@ 0x7fd2e1c0f4de google::LogMessage::Flush() at ??:0
@ 0x7fd2e1c10a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fd2f7642512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7fd2f763f976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fd2f76c7610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fd2f76c7439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fd2e485b345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fd2e485e91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fd2e485e799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fd2e4839eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fd2e7b136db start_thread at ??:0
@ 0x7fd2e0aa961f clone at ??:0
W20260808 11:34:43.514626 10061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:34:43.514952 10061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:34:43.515129 10061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:34:43.522512 10061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:34:43.522667 10061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:34:43.522847 10061 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:34:43.532613 10061 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:34541
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=37711
--tserver_master_addrs=127.26.66.190:38927
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:34:43.533955 10061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:34:43.535302 10061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:34:43.549199 10103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:43.549232 10104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:43.549459 10106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:43.550148 10061 server_base.cc:1034] running on GCE node
I20260808 11:34:43.550800 10061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:34:43.551723 10061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:34:43.552971 10061 hybrid_clock.cc:648] HybridClock initialized: now 1786188883552930 us; error 51 us; skew 500 ppm
I20260808 11:34:43.553300 10061 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:34:43 dist-test-slave-zkpd krb5kdc[8833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188883, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:34:43.560141 10061 init.cc:377] Logged in from keytab as kudu/127.26.66.129@KRBTEST.COM (short username kudu)
I20260808 11:34:43.561657 10061 webserver.cc:460] Webserver started at http://127.26.66.129:37711/ using document root <none> and password file <none>
I20260808 11:34:43.562314 10061 fs_manager.cc:359] Metadata directory not provided
I20260808 11:34:43.562423 10061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:34:43.568408 10061 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 11:34:43.571347 10113 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:43.572798 10061 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:34:43.572944 10061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "83de2e6f8f694a97954dd42fcf151df0"
format_stamp: "Formatted at 2026-08-08 11:34:37 on dist-test-slave-zkpd"
server_key: "fbd51893f19dfc59fed4522570c1ff22"
server_key_iv: "ec079e6729a22eb9d54ec1c6e032c620"
server_key_version: "encryptionkey@0"
I20260808 11:34:43.573963 10061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:34:43.586648 10061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:34:43.590669 10061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:34:43.590948 10061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:34:43.591866 10061 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:34:43.593290 10061 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:34:43.593379 10061 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:43.593461 10061 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:34:43.593518 10061 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:43.629539 10061 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:34541
I20260808 11:34:43.629640 10238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:34541 every 8 connection(s)
I20260808 11:34:43.631147 10061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:34:43.636168 10241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:43.634240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.129:41713)
0808 11:34:43.634983 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:43.635224 (+ 241us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":276,"threads_started":1}
W20260808 11:34:43.636948 10239 heartbeater.cc:644] Failed to heartbeat to 127.26.66.190:38927 (0 consecutive failures): Network error: Failed to ping master at 127.26.66.190:38927: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
I20260808 11:34:43.637849 10241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:43.637517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.129:36999)
0808 11:34:43.637664 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:43.637734 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260808 11:34:43.638693 10241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:43.638394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.129:46205)
0808 11:34:43.638519 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:43.638590 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 11:34:43.638962 10239 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 11:34:43.640419 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 10061
I20260808 11:34:43.641076 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:46433
--local_ip_for_outbound_sockets=127.26.66.130
--tserver_master_addrs=127.26.66.190:38927
--webserver_port=40775
--webserver_interface=127.26.66.130
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:45365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:34:43.981967 10242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:34:43.982280 10242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:34:43.982466 10242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:34:43.989508 10242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:34:43.989662 10242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:34:43.989857 10242 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:34:43.999207 10242 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:46433
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=40775
--tserver_master_addrs=127.26.66.190:38927
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:34:44.000499 10242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:34:44.001837 10242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:34:44.015007 10247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:44.014926 10250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:44.014973 10248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:44.016185 10242 server_base.cc:1034] running on GCE node
I20260808 11:34:44.016734 10242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:34:44.017570 10242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:34:44.018786 10242 hybrid_clock.cc:648] HybridClock initialized: now 1786188884018739 us; error 42 us; skew 500 ppm
I20260808 11:34:44.019057 10242 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:34:44 dist-test-slave-zkpd krb5kdc[8833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188884, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:34:44.022260 10242 init.cc:377] Logged in from keytab as kudu/127.26.66.130@KRBTEST.COM (short username kudu)
I20260808 11:34:44.023765 10242 webserver.cc:460] Webserver started at http://127.26.66.130:40775/ using document root <none> and password file <none>
I20260808 11:34:44.024500 10242 fs_manager.cc:359] Metadata directory not provided
I20260808 11:34:44.024652 10242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:34:44.029928 10242 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 11:34:44.032619 10257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:44.033936 10242 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:34:44.034108 10242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "935961690c244bf08f6f6353a4a5e28b"
format_stamp: "Formatted at 2026-08-08 11:34:38 on dist-test-slave-zkpd"
server_key: "cfcb4e5432c52784d5b9b7ab9da507f6"
server_key_iv: "38532d2eef477462868c6941040772e4"
server_key_version: "encryptionkey@0"
I20260808 11:34:44.035082 10242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:34:44.054893 10242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:34:44.058689 10242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:34:44.058976 10242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:34:44.059996 10242 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:34:44.061285 10242 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:34:44.061384 10242 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:44.061539 10242 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:34:44.061626 10242 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:44.097023 10242 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:46433
I20260808 11:34:44.097115 10382 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:46433 every 8 connection(s)
I20260808 11:34:44.098583 10242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:34:44.101135 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 10242
I20260808 11:34:44.101776 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:37891
--local_ip_for_outbound_sockets=127.26.66.131
--tserver_master_addrs=127.26.66.190:38927
--webserver_port=34561
--webserver_interface=127.26.66.131
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:45365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 11:34:44.103832 10385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:44.101712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.130:42753)
0808 11:34:44.102684 (+ 972us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:44.102971 (+ 287us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":602,"thread_start_us":414,"threads_started":1}
W20260808 11:34:44.104645 10383 heartbeater.cc:644] Failed to heartbeat to 127.26.66.190:38927 (0 consecutive failures): Network error: Failed to ping master at 127.26.66.190:38927: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
I20260808 11:34:44.105616 10385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:44.105268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.130:37783)
0808 11:34:44.105428 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:44.105509 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 11:34:44.106622 10385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:44.106156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.130:60115)
0808 11:34:44.106350 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:44.106456 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 11:34:44.106889 10383 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 11:34:44.447423 10386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:34:44.447697 10386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:34:44.447942 10386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:34:44.455660 10386 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:34:44.455835 10386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:34:44.456034 10386 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:34:44.465703 10386 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:37891
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=34561
--tserver_master_addrs=127.26.66.190:38927
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:34:44.466995 10386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:34:44.468367 10386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:34:44.482610 10391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:44.482570 10392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:34:44.482632 10396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:34:44.483781 10386 server_base.cc:1034] running on GCE node
I20260808 11:34:44.484448 10386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:34:44.485399 10386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:34:44.486658 10386 hybrid_clock.cc:648] HybridClock initialized: now 1786188884486617 us; error 51 us; skew 500 ppm
I20260808 11:34:44.487046 10386 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:34:44 dist-test-slave-zkpd krb5kdc[8833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188884, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:34:44.490281 10386 init.cc:377] Logged in from keytab as kudu/127.26.66.131@KRBTEST.COM (short username kudu)
I20260808 11:34:44.491766 10386 webserver.cc:460] Webserver started at http://127.26.66.131:34561/ using document root <none> and password file <none>
I20260808 11:34:44.492501 10386 fs_manager.cc:359] Metadata directory not provided
I20260808 11:34:44.492656 10386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:34:44.498036 10386 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20260808 11:34:44.500713 10403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:44.501984 10386 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:34:44.502161 10386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "685331d0e8d74734a0ab7ab09eb23fa2"
format_stamp: "Formatted at 2026-08-08 11:34:38 on dist-test-slave-zkpd"
server_key: "67ceb4d21772a6b4125d3d00d3c2ae98"
server_key_iv: "458cf4843d11294d1c615862ddc5f97d"
server_key_version: "encryptionkey@0"
I20260808 11:34:44.503159 10386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:34:44.526594 10386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:34:44.530521 10386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:34:44.530833 10386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:34:44.531829 10386 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:34:44.533217 10386 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:34:44.533349 10386 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:44.533488 10386 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:34:44.533583 10386 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:34:44.568445 10386 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:37891
I20260808 11:34:44.568537 10525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:37891 every 8 connection(s)
I20260808 11:34:44.569968 10386 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:34:44.573093 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 10386
I20260808 11:34:44.575428 10528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:44.573204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.131:39325)
0808 11:34:44.574104 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:44.574424 (+ 320us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":363,"threads_started":1}
W20260808 11:34:44.576184 10526 heartbeater.cc:644] Failed to heartbeat to 127.26.66.190:38927 (0 consecutive failures): Network error: Failed to ping master at 127.26.66.190:38927: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
I20260808 11:34:44.577035 10528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:44.576684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.131:38087)
0808 11:34:44.576861 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:44.576931 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260808 11:34:44.577988 10528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:44.577583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.131:38813)
0808 11:34:44.577732 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:44.577881 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260808 11:34:44.578202 10526 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 11:34:44.640374 10531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:44.639532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.129:48079)
0808 11:34:44.640045 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:44.640134 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":198,"threads_started":1}
I20260808 11:34:45.108336 10532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:45.107484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.130:59665)
0808 11:34:45.107990 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:45.108098 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":213,"threads_started":1}
I20260808 11:34:45.579510 10533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:45.578694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.131:55783)
0808 11:34:45.579181 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:45.579275 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":257,"threads_started":1}
I20260808 11:34:45.642043 10534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:45.641237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.129:39601)
0808 11:34:45.641697 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:45.641780 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":218,"threads_started":1}
I20260808 11:34:46.109872 10535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:46.109166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.130:48619)
0808 11:34:46.109599 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:46.109679 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":217,"threads_started":1}
I20260808 11:34:46.581051 10536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:46.580364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.131:43607)
0808 11:34:46.580812 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:46.580889 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":233,"threads_started":1}
I20260808 11:34:46.643549 10537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:46.642871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.129:46371)
0808 11:34:46.643310 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:46.643386 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":237,"threads_started":1}
I20260808 11:34:47.111343 10538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:47.110668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.130:44337)
0808 11:34:47.111111 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:47.111184 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":246,"threads_started":1}
I20260808 11:34:47.582597 10539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:47.581868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.131:34839)
0808 11:34:47.582347 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:47.582424 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":284,"threads_started":1}
I20260808 11:34:47.645226 10540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:47.644427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.129:57289)
0808 11:34:47.644947 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:47.645025 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":288,"threads_started":1}
I20260808 11:34:48.112960 10541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:48.112254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.130:58467)
0808 11:34:48.112678 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:48.112756 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":215,"threads_started":1}
I20260808 11:34:48.584307 10542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:48.583493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.131:41443)
0808 11:34:48.584045 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:48.584140 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":245,"threads_started":1}
I20260808 11:34:48.646867 10543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:48.646136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.129:47377)
0808 11:34:48.646611 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:48.646694 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":250,"threads_started":1}
I20260808 11:34:49.114519 10544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:49.113808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.130:33549)
0808 11:34:49.114269 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:49.114354 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":238,"threads_started":1}
I20260808 11:34:49.585898 10545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:49.585207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.131:60941)
0808 11:34:49.585644 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:49.585723 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":228,"threads_started":1}
I20260808 11:34:49.648693 10547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:49.647762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.129:54915)
0808 11:34:49.648338 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:49.648463 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":286,"threads_started":1}
I20260808 11:34:50.116192 10548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:50.115431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.130:33841)
0808 11:34:50.115872 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:50.116029 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":229,"threads_started":1}
I20260808 11:34:50.587435 10549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:50.586747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.131:49567)
0808 11:34:50.587183 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:50.587272 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":230,"threads_started":1}
I20260808 11:34:50.650367 10550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:50.649541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.129:39493)
0808 11:34:50.650060 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:50.650154 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":239,"threads_started":1}
I20260808 11:34:51.117873 10551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:51.117081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.130:41625)
0808 11:34:51.117557 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:51.117639 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":217,"threads_started":1}
I20260808 11:34:51.589146 10552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:51.588378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.131:39889)
0808 11:34:51.588846 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:51.588924 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":207,"threads_started":1}
I20260808 11:34:51.652027 10553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:51.651315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.129:49323)
0808 11:34:51.651756 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:51.651849 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":227,"threads_started":1}
I20260808 11:34:52.119586 10555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:52.118820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.130:48245)
0808 11:34:52.119348 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:52.119425 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":305,"threads_started":1}
I20260808 11:34:52.590642 10556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:52.589989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.131:45437)
0808 11:34:52.590407 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:52.590485 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":217,"threads_started":1}
I20260808 11:34:52.653761 10557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:52.652907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.129:47011)
0808 11:34:52.653378 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:52.653507 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":241,"threads_started":1}
I20260808 11:34:53.121243 10558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:53.120503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.130:47929)
0808 11:34:53.120978 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:53.121059 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":245,"threads_started":1}
I20260808 11:34:53.592368 10559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:53.591517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.131:33315)
0808 11:34:53.592087 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:53.592174 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":249,"threads_started":1}
I20260808 11:34:53.655395 10560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:53.654666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.129:60005)
0808 11:34:53.655133 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:53.655214 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":266,"threads_started":1}
I20260808 11:34:54.123036 10561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:54.122193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.130:39641)
0808 11:34:54.122685 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:54.122807 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":255,"threads_started":1}
I20260808 11:34:54.594099 10562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:54.593238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.131:59247)
0808 11:34:54.593788 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:54.593883 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":326,"threads_started":1}
I20260808 11:34:54.657096 10563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:54.656363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.129:39811)
0808 11:34:54.656837 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:54.656919 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":218,"threads_started":1}
I20260808 11:34:55.124717 10564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:55.123994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.130:40857)
0808 11:34:55.124445 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:55.124537 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":213,"threads_started":1}
I20260808 11:34:55.595630 10565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:55.594931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.131:52607)
0808 11:34:55.595362 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:55.595456 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":216,"threads_started":1}
I20260808 11:34:55.658715 10566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:55.658026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.129:32879)
0808 11:34:55.658477 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:55.658555 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":213,"threads_started":1}
I20260808 11:34:56.126297 10567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:56.125616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.130:34921)
0808 11:34:56.126052 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:56.126130 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":219,"threads_started":1}
I20260808 11:34:56.597281 10568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:56.596607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.131:45645)
0808 11:34:56.597040 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:56.597124 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":223,"threads_started":1}
I20260808 11:34:56.660493 10569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:56.659589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.129:36137)
0808 11:34:56.660201 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:56.660320 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":240,"threads_started":1}
I20260808 11:34:57.128058 10570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:57.127247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.130:36339)
0808 11:34:57.127717 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:57.127814 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":243,"threads_started":1}
I20260808 11:34:57.598986 10571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:57.598178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.131:38589)
0808 11:34:57.598683 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:57.598773 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":270,"threads_started":1}
I20260808 11:34:57.662552 10572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:57.661656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.129:58117)
0808 11:34:57.662273 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:57.662362 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":291,"threads_started":1}
I20260808 11:34:58.129673 10573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:58.128960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.130:34639)
0808 11:34:58.129397 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:58.129479 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":218,"threads_started":1}
I20260808 11:34:58.600843 10574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:58.600077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.131:54347)
0808 11:34:58.600545 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:58.600634 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":238,"threads_started":1}
I20260808 11:34:58.664640 10575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:58.663773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.129:53783)
0808 11:34:58.664348 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:58.664454 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":319,"threads_started":1}
I20260808 11:34:59.131589 10576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:59.130836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.130:47061)
0808 11:34:59.131306 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:59.131400 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":260,"threads_started":1}
I20260808 11:34:59.575022 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 10061
I20260808 11:34:59.593536 10577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:59.576320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54114 (local address 127.26.66.129:34541)
0808 11:34:59.577045 (+ 725us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:59.577066 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:59.577119 (+ 53us) server_negotiation.cc:407] Connection header received
0808 11:34:59.579198 (+ 2079us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:59.579207 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:59.579638 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:59.580012 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:59.581334 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:59.582561 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:59.583852 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:59.584564 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:59.584710 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:59.587390 (+ 2680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:59.587399 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:59.587412 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:59.587452 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:59.590524 (+ 3072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:59.591194 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:59.591201 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:59.591207 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:59.591389 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:59.591715 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:59.591718 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:59.591721 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:59.592326 (+ 605us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:59.592584 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:59.592935 (+ 351us) server_negotiation.cc:299] Negotiation successful
0808 11:34:59.593257 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":318,"threads_started":1}
I20260808 11:34:59.594970 10231 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:34:59.606436 10579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:59.602016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.131:54473)
0808 11:34:59.606147 (+ 4131us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:59.606259 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3964,"thread_start_us":3860,"threads_started":1}
I20260808 11:34:59.680781 10580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:59.679561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:38927 (local address 127.26.66.129:54353)
0808 11:34:59.680190 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0808 11:34:59.680455 (+ 265us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:38927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":348,"threads_started":1}
I20260808 11:34:59.684103 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 10061
I20260808 11:34:59.706231 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 10242
I20260808 11:34:59.724080 10581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:59.707370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43240 (local address 127.26.66.130:46433)
0808 11:34:59.708014 (+ 644us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:59.708028 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:59.708066 (+ 38us) server_negotiation.cc:407] Connection header received
0808 11:34:59.709710 (+ 1644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:59.709720 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:59.710138 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:59.710438 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:59.711781 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:59.713077 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:59.714352 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:59.715042 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:59.715175 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:59.717943 (+ 2768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:59.717950 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:59.717965 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:59.718001 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:59.721160 (+ 3159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:59.721790 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:59.721796 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:59.721802 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:59.721969 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:59.722330 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:59.722334 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:59.722335 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:59.722837 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:59.723080 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:59.723419 (+ 339us) server_negotiation.cc:299] Negotiation successful
0808 11:34:59.723737 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":278,"threads_started":1}
I20260808 11:34:59.725443 10378 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:34:59.813169 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 10242
I20260808 11:34:59.835687 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 10386
I20260808 11:34:59.854668 10583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:34:59.836996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53650 (local address 127.26.66.131:37891)
0808 11:34:59.837646 (+ 650us) server_negotiation.cc:206] Beginning negotiation
0808 11:34:59.837661 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 11:34:59.837705 (+ 44us) server_negotiation.cc:407] Connection header received
0808 11:34:59.839429 (+ 1724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:34:59.839438 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:34:59.839871 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:34:59.840361 (+ 490us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:34:59.841947 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:59.843193 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:59.844715 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:34:59.845417 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:34:59.845558 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:34:59.848280 (+ 2722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:34:59.848288 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:34:59.848302 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:34:59.848340 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:34:59.851420 (+ 3080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:59.852279 (+ 859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:59.852287 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:59.852293 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:59.852471 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:34:59.852807 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:34:59.852810 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:34:59.852812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:34:59.853322 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:34:59.853564 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0808 11:34:59.853914 (+ 350us) server_negotiation.cc:299] Negotiation successful
0808 11:34:59.854352 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":475,"thread_start_us":314,"threads_started":1}
I20260808 11:34:59.856184 10521 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:34:59.940068 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 10386
2026-08-08T11:34:59Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (24722 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:35:00 dist-test-slave-zkpd krb5kdc[10587](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:35:00 dist-test-slave-zkpd krb5kdc[10587](info): set up 2 sockets
Aug 08 11:35:00 dist-test-slave-zkpd krb5kdc[10587](info): commencing operation
krb5kdc: starting...
W20260808 11:35:01.096199 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.005s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:35:01 dist-test-slave-zkpd krb5kdc[10587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188901, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:35:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:35:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:35:01.447692 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:39703
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:39703
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:35:01.806457 10600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:35:01.806730 10600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:35:01.806900 10600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:35:01.813990 10600 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 11:35:01.814086 10600 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 11:35:01.814165 10600 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 11:35:01.814292 10600 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:35:01.814390 10600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:35:01.814513 10600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:35:01.814592 10600 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:35:01.814675 10600 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:35:01.824409 10600 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:39703
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:39703
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:35:01.825663 10600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:35:01.827018 10600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:35:01.839598 10605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:35:01.839658 10608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:35:01.839455 10606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:35:01.840281 10600 server_base.cc:1034] running on GCE node
I20260808 11:35:01.841084 10600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:35:01.842527 10600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:35:01.843793 10600 hybrid_clock.cc:648] HybridClock initialized: now 1786188901843712 us; error 49 us; skew 500 ppm
I20260808 11:35:01.844158 10600 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:35:01 dist-test-slave-zkpd krb5kdc[10587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188901, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:35:01.852445 10600 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:35:01.854010 10600 webserver.cc:460] Webserver started at http://127.26.66.190:45347/ using document root <none> and password file <none>
I20260808 11:35:01.854751 10600 fs_manager.cc:359] Metadata directory not provided
I20260808 11:35:01.854849 10600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:35:01.855144 10600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:35:01.858472 10600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "c72822eafd9b4cd5b79d03020b7e43e7"
format_stamp: "Formatted at 2026-08-08 11:35:01 on dist-test-slave-zkpd"
server_key: "e11557d954707e98aab5e0497c87fd34"
server_key_iv: "22fd1b0ad2cd156079d8a520dcf00908"
server_key_version: "encryptionkey@0"
I20260808 11:35:01.859302 10600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "c72822eafd9b4cd5b79d03020b7e43e7"
format_stamp: "Formatted at 2026-08-08 11:35:01 on dist-test-slave-zkpd"
server_key: "e11557d954707e98aab5e0497c87fd34"
server_key_iv: "22fd1b0ad2cd156079d8a520dcf00908"
server_key_version: "encryptionkey@0"
I20260808 11:35:01.865070 10600 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260808 11:35:01.868782 10616 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:01.870137 10600 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:35:01.870286 10600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "c72822eafd9b4cd5b79d03020b7e43e7"
format_stamp: "Formatted at 2026-08-08 11:35:01 on dist-test-slave-zkpd"
server_key: "e11557d954707e98aab5e0497c87fd34"
server_key_iv: "22fd1b0ad2cd156079d8a520dcf00908"
server_key_version: "encryptionkey@0"
I20260808 11:35:01.870471 10600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:35:01.903698 10600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:35:01.908011 10600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:35:01.908280 10600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:35:01.927381 10600 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:39703
I20260808 11:35:01.927404 10671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:39703 every 8 connection(s)
I20260808 11:35:01.928849 10600 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:35:01.932698 10672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:35:01.933398 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 10600
I20260808 11:35:01.933625 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:35:01.934391 26890 external_mini_cluster.cc:1428] Setting key cb3f7df37e5a54b2809fca6356add71e
I20260808 11:35:01.947165 10672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7: Bootstrap starting.
Aug 08 11:35:01 dist-test-slave-zkpd krb5kdc[10587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188901, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:35:01.951186 10672 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7: Neither blocks nor log segments found. Creating new log.
I20260808 11:35:01.952639 10672 log.cc:824] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7: Log is configured to *not* fsync() on all Append() calls
I20260808 11:35:01.956147 10672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7: No bootstrap required, opened a new log
I20260808 11:35:01.959987 10675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:01.936476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48326 (local address 127.26.66.190:39703)
0808 11:35:01.937309 (+ 833us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:01.937321 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:01.937365 (+ 44us) server_negotiation.cc:407] Connection header received
0808 11:35:01.938962 (+ 1597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:01.938987 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:01.939384 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:01.939725 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:35:01.941624 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:01.942919 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:01.945042 (+ 2123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:01.945729 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:01.945924 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:01.950853 (+ 4929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:35:01.950866 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:35:01.950885 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:35:01.950934 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:35:01.955100 (+ 4166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:01.955860 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:01.955869 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:01.955876 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:01.956119 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:01.956602 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:01.956612 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:01.956617 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:01.957332 (+ 715us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:35:01.957647 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:01.957993 (+ 346us) server_negotiation.cc:299] Negotiation successful
0808 11:35:01.958479 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":389,"threads_started":1}
I20260808 11:35:01.965734 10672 raft_consensus.cc:348] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c72822eafd9b4cd5b79d03020b7e43e7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 39703 } }
I20260808 11:35:01.966233 10672 raft_consensus.cc:374] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:35:01.966419 10672 raft_consensus.cc:729] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c72822eafd9b4cd5b79d03020b7e43e7, State: Initialized, Role: FOLLOWER
I20260808 11:35:01.966996 10672 consensus_queue.cc:260] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c72822eafd9b4cd5b79d03020b7e43e7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 39703 } }
I20260808 11:35:01.967275 10672 raft_consensus.cc:388] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:35:01.967424 10672 raft_consensus.cc:482] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:35:01.967602 10672 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:35:01.969888 10672 raft_consensus.cc:504] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c72822eafd9b4cd5b79d03020b7e43e7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 39703 } }
I20260808 11:35:01.970392 10672 leader_election.cc:302] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c72822eafd9b4cd5b79d03020b7e43e7; no voters:
I20260808 11:35:01.971001 10672 leader_election.cc:288] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:35:01.971154 10677 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:35:01.972290 10677 raft_consensus.cc:686] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [term 1 LEADER]: Becoming Leader. State: Replica: c72822eafd9b4cd5b79d03020b7e43e7, State: Running, Role: LEADER
I20260808 11:35:01.972873 10677 consensus_queue.cc:237] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c72822eafd9b4cd5b79d03020b7e43e7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 39703 } }
I20260808 11:35:01.973351 10672 sys_catalog.cc:564] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:35:01.976239 10678 sys_catalog.cc:455] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c72822eafd9b4cd5b79d03020b7e43e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c72822eafd9b4cd5b79d03020b7e43e7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 39703 } } }
I20260808 11:35:01.976238 10679 sys_catalog.cc:455] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c72822eafd9b4cd5b79d03020b7e43e7. Latest consensus state: current_term: 1 leader_uuid: "c72822eafd9b4cd5b79d03020b7e43e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c72822eafd9b4cd5b79d03020b7e43e7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 39703 } } }
I20260808 11:35:01.976752 10678 sys_catalog.cc:458] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [sys.catalog]: This master's current role is: LEADER
I20260808 11:35:01.976766 10679 sys_catalog.cc:458] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [sys.catalog]: This master's current role is: LEADER
I20260808 11:35:01.979419 10684 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:35:01.984884 10684 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:35:01.994004 10684 catalog_manager.cc:1347] Generated new cluster ID: f38a225543774e84bd9634d9126d0675
I20260808 11:35:01.994124 10684 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:35:02.006552 10684 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:35:02.008016 10684 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:35:02.023386 10684 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7: Generated new TSK 0
I20260808 11:35:02.024327 10684 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.66.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
I20260808 11:35:02.112416 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:0
--local_ip_for_outbound_sockets=127.26.66.129
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:39703
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:35:02.473529 10699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:35:02.473881 10699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:35:02.474061 10699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:35:02.481659 10699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:35:02.481766 10699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:35:02.481894 10699 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:35:02.492017 10699 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:39703
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:35:02.493257 10699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:35:02.494563 10699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:35:02.507953 10707 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:35:02.508082 10705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:35:02.508239 10704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:35:02.509227 10699 server_base.cc:1034] running on GCE node
I20260808 11:35:02.509796 10699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:35:02.510758 10699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:35:02.512001 10699 hybrid_clock.cc:648] HybridClock initialized: now 1786188902511963 us; error 28 us; skew 500 ppm
I20260808 11:35:02.512334 10699 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:35:02 dist-test-slave-zkpd krb5kdc[10587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188902, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:35:02.515527 10699 init.cc:377] Logged in from keytab as kudu/127.26.66.129@KRBTEST.COM (short username kudu)
I20260808 11:35:02.517015 10699 webserver.cc:460] Webserver started at http://127.26.66.129:43587/ using document root <none> and password file <none>
I20260808 11:35:02.517722 10699 fs_manager.cc:359] Metadata directory not provided
I20260808 11:35:02.517900 10699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:35:02.518227 10699 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:35:02.521373 10699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/data/instance:
uuid: "4d5e803b03d94123b85dcd17e893383d"
format_stamp: "Formatted at 2026-08-08 11:35:02 on dist-test-slave-zkpd"
server_key: "638ba969979c10723b9aa38758212d12"
server_key_iv: "20e0e2b5e5253a959a0523baa6401239"
server_key_version: "encryptionkey@0"
I20260808 11:35:02.522199 10699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance:
uuid: "4d5e803b03d94123b85dcd17e893383d"
format_stamp: "Formatted at 2026-08-08 11:35:02 on dist-test-slave-zkpd"
server_key: "638ba969979c10723b9aa38758212d12"
server_key_iv: "20e0e2b5e5253a959a0523baa6401239"
server_key_version: "encryptionkey@0"
I20260808 11:35:02.527508 10699 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 11:35:02.531147 10714 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:02.532531 10699 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 11:35:02.532716 10699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "4d5e803b03d94123b85dcd17e893383d"
format_stamp: "Formatted at 2026-08-08 11:35:02 on dist-test-slave-zkpd"
server_key: "638ba969979c10723b9aa38758212d12"
server_key_iv: "20e0e2b5e5253a959a0523baa6401239"
server_key_version: "encryptionkey@0"
I20260808 11:35:02.532949 10699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:35:02.549551 10699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:35:02.553782 10699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:35:02.554100 10699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:35:02.555095 10699 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:35:02.556604 10699 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:35:02.556711 10699 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:02.556882 10699 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:35:02.556957 10699 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:02.594748 10699 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:37063
I20260808 11:35:02.594782 10835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:37063 every 8 connection(s)
I20260808 11:35:02.596210 10699 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:35:02.597401 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 10699
I20260808 11:35:02.597640 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance
I20260808 11:35:02.598495 26890 external_mini_cluster.cc:1428] Setting key 49a18343bdb63a5811b089ad720b0738
Aug 08 11:35:02 dist-test-slave-zkpd krb5kdc[10587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188902, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:35:02.619415 10839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:02.599438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:38337 (local address 127.26.66.190:39703)
0808 11:35:02.600074 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:02.600081 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:02.601146 (+ 1065us) server_negotiation.cc:407] Connection header received
0808 11:35:02.603069 (+ 1923us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:02.603077 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:02.603181 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:02.603306 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:35:02.604943 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:02.606127 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:02.607866 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:02.608602 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:02.608762 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:02.612437 (+ 3675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:35:02.612446 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:35:02.612454 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:35:02.612504 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:35:02.615861 (+ 3357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:02.616945 (+ 1084us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:02.616952 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:02.616961 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:02.617086 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:02.617563 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:02.617567 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:02.617569 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:02.617871 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:35:02.618039 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:02.618791 (+ 752us) server_negotiation.cc:299] Negotiation successful
0808 11:35:02.619045 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":276,"threads_started":1}
I20260808 11:35:02.620532 10840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:02.600056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.129:38337)
0808 11:35:02.600975 (+ 919us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:02.601023 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 11:35:02.602785 (+ 1762us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:35:02.603524 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:35:02.603532 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:35:02.604164 (+ 632us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:35:02.604764 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:02.604783 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:02.606302 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:02.606305 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:02.607715 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:02.607728 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:02.608829 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:02.608834 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:02.609034 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:02.609739 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:35:02.609766 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:35:02.612210 (+ 2444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:35:02.616074 (+ 3864us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:35:02.616084 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:35:02.616106 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:35:02.616802 (+ 696us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:35:02.617212 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:35:02.617217 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:35:02.617222 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:35:02.617422 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:35:02.618011 (+ 589us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:35:02.618019 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:35:02.618387 (+ 368us) client_negotiation.cc:769] Sending connection context
0808 11:35:02.618666 (+ 279us) client_negotiation.cc:240] Negotiation successful
0808 11:35:02.619217 (+ 551us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":390,"threads_started":1}
I20260808 11:35:02.622121 10836 heartbeater.cc:347] Connected to a master server at 127.26.66.190:39703
I20260808 11:35:02.622455 10836 heartbeater.cc:464] Registering TS with master...
I20260808 11:35:02.623225 10836 heartbeater.cc:511] Master 127.26.66.190:39703 requested a full tablet report, sending...
I20260808 11:35:02.625473 10634 ts_manager.cc:194] Registered new tserver with Master: 4d5e803b03d94123b85dcd17e893383d (127.26.66.129:37063)
I20260808 11:35:02.626983 10634 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.129@KRBTEST.COM'} at 127.26.66.129:38337
WARNING: no policy specified for kudu/127.26.66.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
I20260808 11:35:02.671444 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:0
--local_ip_for_outbound_sockets=127.26.66.130
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:39703
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:35:03.025424 10843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:35:03.025728 10843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:35:03.025833 10843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:35:03.033497 10843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:35:03.033617 10843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:35:03.033753 10843 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:35:03.044404 10843 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:39703
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:35:03.045671 10843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:35:03.046957 10843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:35:03.060261 10848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:35:03.060388 10851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:35:03.060388 10849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:35:03.061337 10843 server_base.cc:1034] running on GCE node
I20260808 11:35:03.061947 10843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:35:03.062909 10843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:35:03.064181 10843 hybrid_clock.cc:648] HybridClock initialized: now 1786188903064136 us; error 37 us; skew 500 ppm
I20260808 11:35:03.064473 10843 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:35:03 dist-test-slave-zkpd krb5kdc[10587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188903, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:35:03.067516 10843 init.cc:377] Logged in from keytab as kudu/127.26.66.130@KRBTEST.COM (short username kudu)
I20260808 11:35:03.069020 10843 webserver.cc:460] Webserver started at http://127.26.66.130:34945/ using document root <none> and password file <none>
I20260808 11:35:03.069679 10843 fs_manager.cc:359] Metadata directory not provided
I20260808 11:35:03.069783 10843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:35:03.070041 10843 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:35:03.073112 10843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/data/instance:
uuid: "54a776854cd045ff80d6859a22d4083d"
format_stamp: "Formatted at 2026-08-08 11:35:03 on dist-test-slave-zkpd"
server_key: "cdd45583f63efcb50bc16616617360a2"
server_key_iv: "e41b4197d7ac594b7725f02fb957a5a1"
server_key_version: "encryptionkey@0"
I20260808 11:35:03.074038 10843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance:
uuid: "54a776854cd045ff80d6859a22d4083d"
format_stamp: "Formatted at 2026-08-08 11:35:03 on dist-test-slave-zkpd"
server_key: "cdd45583f63efcb50bc16616617360a2"
server_key_iv: "e41b4197d7ac594b7725f02fb957a5a1"
server_key_version: "encryptionkey@0"
I20260808 11:35:03.079519 10843 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260808 11:35:03.083205 10859 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:03.084573 10843 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:35:03.084744 10843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "54a776854cd045ff80d6859a22d4083d"
format_stamp: "Formatted at 2026-08-08 11:35:03 on dist-test-slave-zkpd"
server_key: "cdd45583f63efcb50bc16616617360a2"
server_key_iv: "e41b4197d7ac594b7725f02fb957a5a1"
server_key_version: "encryptionkey@0"
I20260808 11:35:03.084944 10843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:35:03.111281 10843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:35:03.116014 10843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:35:03.116341 10843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:35:03.117350 10843 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:35:03.118741 10843 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:35:03.118816 10843 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:03.118960 10843 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:35:03.119011 10843 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:03.152418 10843 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:33071
I20260808 11:35:03.152496 10974 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:33071 every 8 connection(s)
I20260808 11:35:03.153810 10843 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:35:03.154883 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 10843
I20260808 11:35:03.155083 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance
I20260808 11:35:03.155706 26890 external_mini_cluster.cc:1428] Setting key e7fe7fa9dc14d69f21eb4c3c4b594a88
Aug 08 11:35:03 dist-test-slave-zkpd krb5kdc[10587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188903, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:35:03.176965 10977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:03.157028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:45003 (local address 127.26.66.190:39703)
0808 11:35:03.157497 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:03.157503 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:03.158474 (+ 971us) server_negotiation.cc:407] Connection header received
0808 11:35:03.160437 (+ 1963us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:03.160442 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:03.160551 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:03.160669 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:35:03.162214 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.163107 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.164746 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.165188 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.165323 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:03.169852 (+ 4529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:35:03.169861 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:35:03.169869 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:35:03.169921 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:35:03.173210 (+ 3289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:03.174329 (+ 1119us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:03.174333 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:03.174335 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:03.174469 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:03.175079 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:03.175083 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:03.175085 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:03.175440 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:35:03.175556 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:03.176520 (+ 964us) server_negotiation.cc:299] Negotiation successful
0808 11:35:03.176690 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":228,"threads_started":1}
I20260808 11:35:03.178603 10978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:03.157474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.130:45003)
0808 11:35:03.158308 (+ 834us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:03.158360 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 11:35:03.160156 (+ 1796us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:35:03.160914 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:35:03.160923 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:35:03.161459 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:35:03.162036 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:03.162054 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.163272 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.163276 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:03.164593 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:03.164611 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.165446 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.165456 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:03.165685 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:03.166490 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:35:03.166523 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:35:03.169551 (+ 3028us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:35:03.173387 (+ 3836us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:35:03.173397 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:35:03.173420 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:35:03.174188 (+ 768us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:35:03.174589 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:35:03.174597 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:35:03.174603 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:35:03.174921 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:35:03.175568 (+ 647us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:35:03.175579 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:35:03.176101 (+ 522us) client_negotiation.cc:769] Sending connection context
0808 11:35:03.176426 (+ 325us) client_negotiation.cc:240] Negotiation successful
0808 11:35:03.177067 (+ 641us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":362,"threads_started":1}
I20260808 11:35:03.180261 10975 heartbeater.cc:347] Connected to a master server at 127.26.66.190:39703
I20260808 11:35:03.180605 10975 heartbeater.cc:464] Registering TS with master...
I20260808 11:35:03.181335 10975 heartbeater.cc:511] Master 127.26.66.190:39703 requested a full tablet report, sending...
I20260808 11:35:03.182909 10634 ts_manager.cc:194] Registered new tserver with Master: 54a776854cd045ff80d6859a22d4083d (127.26.66.130:33071)
I20260808 11:35:03.183756 10634 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.130@KRBTEST.COM'} at 127.26.66.130:45003
WARNING: no policy specified for kudu/127.26.66.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
I20260808 11:35:03.232430 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:0
--local_ip_for_outbound_sockets=127.26.66.131
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:39703
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:35:03.594852 10983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:35:03.595181 10983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:35:03.595371 10983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:35:03.602952 10983 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:35:03.603098 10983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:35:03.603281 10983 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:35:03.612977 10983 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:39703
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:35:03.614239 10983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:35:03.615550 10983 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:35:03.628625 10988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:35:03.628651 10989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:35:03.628695 10992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:35:03.629849 10983 server_base.cc:1034] running on GCE node
I20260808 11:35:03.630064 10836 heartbeater.cc:503] Master 127.26.66.190:39703 was elected leader, sending a full tablet report...
I20260808 11:35:03.630533 10983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:35:03.631726 10983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:35:03.632977 10983 hybrid_clock.cc:648] HybridClock initialized: now 1786188903632924 us; error 77 us; skew 500 ppm
I20260808 11:35:03.633320 10983 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:35:03 dist-test-slave-zkpd krb5kdc[10587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188903, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:35:03.636631 10983 init.cc:377] Logged in from keytab as kudu/127.26.66.131@KRBTEST.COM (short username kudu)
I20260808 11:35:03.638180 10983 webserver.cc:460] Webserver started at http://127.26.66.131:33629/ using document root <none> and password file <none>
I20260808 11:35:03.638818 10983 fs_manager.cc:359] Metadata directory not provided
I20260808 11:35:03.638918 10983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:35:03.639173 10983 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:35:03.642125 10983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/data/instance:
uuid: "9b28c9cb4cb34090b683aebd99da66ed"
format_stamp: "Formatted at 2026-08-08 11:35:03 on dist-test-slave-zkpd"
server_key: "0760314f8b097bf1e438edb13013aa36"
server_key_iv: "edca641c20345fa5f9f04924a76ec4e3"
server_key_version: "encryptionkey@0"
I20260808 11:35:03.642839 10983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance:
uuid: "9b28c9cb4cb34090b683aebd99da66ed"
format_stamp: "Formatted at 2026-08-08 11:35:03 on dist-test-slave-zkpd"
server_key: "0760314f8b097bf1e438edb13013aa36"
server_key_iv: "edca641c20345fa5f9f04924a76ec4e3"
server_key_version: "encryptionkey@0"
I20260808 11:35:03.648149 10983 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260808 11:35:03.651710 11001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:03.653164 10983 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:35:03.653358 10983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "9b28c9cb4cb34090b683aebd99da66ed"
format_stamp: "Formatted at 2026-08-08 11:35:03 on dist-test-slave-zkpd"
server_key: "0760314f8b097bf1e438edb13013aa36"
server_key_iv: "edca641c20345fa5f9f04924a76ec4e3"
server_key_version: "encryptionkey@0"
I20260808 11:35:03.653584 10983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:35:03.677820 10983 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:35:03.682396 10983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:35:03.682716 10983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:35:03.683679 10983 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:35:03.685105 10983 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:35:03.685179 10983 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:03.685261 10983 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:35:03.685313 10983 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:03.720362 10983 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:43463
I20260808 11:35:03.720407 11119 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:43463 every 8 connection(s)
I20260808 11:35:03.721694 10983 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:35:03.725636 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 10983
I20260808 11:35:03.725836 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance
I20260808 11:35:03.726519 26890 external_mini_cluster.cc:1428] Setting key 2d4a1b65a12351dbce12c79b1a39801c
Aug 08 11:35:03 dist-test-slave-zkpd krb5kdc[10587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188903, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:35:03.743074 11122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:03.724392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:57707 (local address 127.26.66.190:39703)
0808 11:35:03.724860 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:03.724864 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:03.725973 (+ 1109us) server_negotiation.cc:407] Connection header received
0808 11:35:03.728672 (+ 2699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:03.728677 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:03.728806 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:03.728929 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:35:03.730865 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.731653 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.733216 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.733618 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.733724 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:03.737128 (+ 3404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:35:03.737132 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:35:03.737135 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:35:03.737166 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:35:03.739949 (+ 2783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:03.740782 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:03.740793 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:03.740797 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:03.740921 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:03.741460 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:03.741465 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:03.741468 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:03.741789 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:35:03.741956 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:03.742647 (+ 691us) server_negotiation.cc:299] Negotiation successful
0808 11:35:03.742809 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":234,"threads_started":1}
I20260808 11:35:03.744100 11123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:03.724917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.131:57707)
0808 11:35:03.725802 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:03.725866 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 11:35:03.728224 (+ 2358us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:35:03.729378 (+ 1154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:35:03.729391 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:35:03.730088 (+ 697us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:35:03.730710 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:03.730727 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.731791 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.731795 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:03.733090 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:03.733103 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.733832 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.733837 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:03.734037 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:03.734649 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:35:03.734670 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:35:03.736940 (+ 2270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:35:03.740070 (+ 3130us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:35:03.740076 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:35:03.740087 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:35:03.740648 (+ 561us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:35:03.741057 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:35:03.741061 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:35:03.741063 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:35:03.741330 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:35:03.741935 (+ 605us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:35:03.741942 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:35:03.742264 (+ 322us) client_negotiation.cc:769] Sending connection context
0808 11:35:03.742539 (+ 275us) client_negotiation.cc:240] Negotiation successful
0808 11:35:03.742945 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":328,"threads_started":1}
I20260808 11:35:03.745426 11120 heartbeater.cc:347] Connected to a master server at 127.26.66.190:39703
I20260808 11:35:03.745730 11120 heartbeater.cc:464] Registering TS with master...
I20260808 11:35:03.746439 11120 heartbeater.cc:511] Master 127.26.66.190:39703 requested a full tablet report, sending...
I20260808 11:35:03.747831 10634 ts_manager.cc:194] Registered new tserver with Master: 9b28c9cb4cb34090b683aebd99da66ed (127.26.66.131:43463)
I20260808 11:35:03.748674 10634 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.131@KRBTEST.COM'} at 127.26.66.131:57707
I20260808 11:35:03.754488 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 11:35:03.772217 11122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:03.759092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48328 (local address 127.26.66.190:39703)
0808 11:35:03.759265 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:03.759272 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:03.759759 (+ 487us) server_negotiation.cc:407] Connection header received
0808 11:35:03.759998 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:03.760002 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:03.760081 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:03.760186 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:35:03.761755 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.762498 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.763950 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.764371 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.764510 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:03.766919 (+ 2409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:35:03.766924 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:35:03.766928 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:35:03.766958 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:35:03.769391 (+ 2433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:03.770079 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:03.770086 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:03.770090 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:03.770228 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:03.770625 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:03.770631 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:03.770634 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:03.770971 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:35:03.771250 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:03.771610 (+ 360us) server_negotiation.cc:299] Negotiation successful
0808 11:35:03.771858 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 11:35:03.776798 10634 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48328:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 11:35:03.784305 10634 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:35:03.821184 11138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:03.798675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34396 (local address 127.26.66.130:33071)
0808 11:35:03.812000 (+ 13325us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:03.812011 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:03.813042 (+ 1031us) server_negotiation.cc:407] Connection header received
0808 11:35:03.813155 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:03.813162 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:03.813422 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:03.813621 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:35:03.814328 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.815918 (+ 1590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.818404 (+ 2486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.819854 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.820086 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:03.820312 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:03.820639 (+ 327us) server_negotiation.cc:299] Negotiation successful
0808 11:35:03.820824 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13091,"thread_start_us":12902,"threads_started":1}
I20260808 11:35:03.821684 11135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:03.798095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:43463 (local address 127.0.0.1:51002)
0808 11:35:03.812568 (+ 14473us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:03.812624 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 11:35:03.812838 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:35:03.814007 (+ 1169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:35:03.814015 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:35:03.814060 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:35:03.814572 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:03.814587 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.816567 (+ 1980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.816575 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:03.818821 (+ 2246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:03.818835 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.820800 (+ 1965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.820807 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:03.821003 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:03.821036 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 11:35:03.821101 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 11:35:03.821234 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14149,"mutex_wait_us":1,"thread_start_us":13965,"threads_started":1}
I20260808 11:35:03.821278 11136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:03.798388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:33071 (local address 127.0.0.1:34396)
0808 11:35:03.812659 (+ 14271us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:03.812679 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 11:35:03.812845 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:35:03.813630 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:35:03.813637 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:35:03.813668 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:35:03.814127 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:03.814143 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.816091 (+ 1948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.816096 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:03.818195 (+ 2099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:03.818212 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.820142 (+ 1930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.820153 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:03.820393 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:03.820448 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 11:35:03.820593 (+ 145us) client_negotiation.cc:240] Negotiation successful
0808 11:35:03.820818 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14142,"mutex_wait_us":52,"thread_start_us":13971,"threads_started":1}
I20260808 11:35:03.822280 11137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:03.798350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51002 (local address 127.26.66.131:43463)
0808 11:35:03.811389 (+ 13039us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:03.811404 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:03.813037 (+ 1633us) server_negotiation.cc:407] Connection header received
0808 11:35:03.813148 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:03.813155 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:03.813442 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:03.813630 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:35:03.814798 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.816412 (+ 1614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.819019 (+ 2607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.820550 (+ 1531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.821484 (+ 934us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:03.821710 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:03.821781 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 11:35:03.821951 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12771,"thread_start_us":13674,"threads_started":1}
I20260808 11:35:03.825896 11050 tablet_service.cc:1467] Processing CreateTablet for tablet f3677c08b7874d16843a03f0e28aa254 (DEFAULT_TABLE table=test-table [id=e31689d16c394db7a834cdfcd1bf1b20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:35:03.826426 11139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:03.813629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39582 (local address 127.26.66.129:37063)
0808 11:35:03.815207 (+ 1578us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:03.815215 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:03.815953 (+ 738us) server_negotiation.cc:407] Connection header received
0808 11:35:03.816256 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:03.816269 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:03.816454 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:03.816644 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:35:03.817805 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.819456 (+ 1651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.823398 (+ 3942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.824965 (+ 1567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.825108 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:03.825322 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:03.825921 (+ 599us) server_negotiation.cc:299] Negotiation successful
0808 11:35:03.826094 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1421,"thread_start_us":1273,"threads_started":1}
I20260808 11:35:03.826134 10907 tablet_service.cc:1467] Processing CreateTablet for tablet f3677c08b7874d16843a03f0e28aa254 (DEFAULT_TABLE table=test-table [id=e31689d16c394db7a834cdfcd1bf1b20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:35:03.827224 11140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:03.815241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:37063 (local address 127.0.0.1:39582)
0808 11:35:03.815814 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:03.815833 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 11:35:03.816061 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:35:03.816978 (+ 917us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:35:03.816983 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:35:03.817011 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:35:03.817581 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:03.817595 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.819609 (+ 2014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.819614 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:03.821862 (+ 2248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:03.821877 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.825466 (+ 3589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.825472 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:03.825642 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:03.825675 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 11:35:03.826669 (+ 994us) client_negotiation.cc:240] Negotiation successful
0808 11:35:03.826807 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"mutex_wait_us":42,"thread_start_us":316,"threads_started":1}
I20260808 11:35:03.827396 11050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3677c08b7874d16843a03f0e28aa254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:35:03.827484 10907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3677c08b7874d16843a03f0e28aa254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:35:03.831084 10766 tablet_service.cc:1467] Processing CreateTablet for tablet f3677c08b7874d16843a03f0e28aa254 (DEFAULT_TABLE table=test-table [id=e31689d16c394db7a834cdfcd1bf1b20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:35:03.832556 10766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3677c08b7874d16843a03f0e28aa254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:35:03.840919 11141 tablet_bootstrap.cc:492] T f3677c08b7874d16843a03f0e28aa254 P 9b28c9cb4cb34090b683aebd99da66ed: Bootstrap starting.
I20260808 11:35:03.842895 11142 tablet_bootstrap.cc:492] T f3677c08b7874d16843a03f0e28aa254 P 54a776854cd045ff80d6859a22d4083d: Bootstrap starting.
I20260808 11:35:03.845396 11141 tablet_bootstrap.cc:654] T f3677c08b7874d16843a03f0e28aa254 P 9b28c9cb4cb34090b683aebd99da66ed: Neither blocks nor log segments found. Creating new log.
I20260808 11:35:03.846504 11142 tablet_bootstrap.cc:654] T f3677c08b7874d16843a03f0e28aa254 P 54a776854cd045ff80d6859a22d4083d: Neither blocks nor log segments found. Creating new log.
I20260808 11:35:03.846696 11143 tablet_bootstrap.cc:492] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d: Bootstrap starting.
I20260808 11:35:03.847826 11141 log.cc:824] T f3677c08b7874d16843a03f0e28aa254 P 9b28c9cb4cb34090b683aebd99da66ed: Log is configured to *not* fsync() on all Append() calls
I20260808 11:35:03.847837 11142 log.cc:824] T f3677c08b7874d16843a03f0e28aa254 P 54a776854cd045ff80d6859a22d4083d: Log is configured to *not* fsync() on all Append() calls
I20260808 11:35:03.850272 11143 tablet_bootstrap.cc:654] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d: Neither blocks nor log segments found. Creating new log.
I20260808 11:35:03.850947 11141 tablet_bootstrap.cc:492] T f3677c08b7874d16843a03f0e28aa254 P 9b28c9cb4cb34090b683aebd99da66ed: No bootstrap required, opened a new log
I20260808 11:35:03.851231 11141 ts_tablet_manager.cc:1397] T f3677c08b7874d16843a03f0e28aa254 P 9b28c9cb4cb34090b683aebd99da66ed: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260808 11:35:03.851323 11142 tablet_bootstrap.cc:492] T f3677c08b7874d16843a03f0e28aa254 P 54a776854cd045ff80d6859a22d4083d: No bootstrap required, opened a new log
I20260808 11:35:03.851698 11142 ts_tablet_manager.cc:1397] T f3677c08b7874d16843a03f0e28aa254 P 54a776854cd045ff80d6859a22d4083d: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260808 11:35:03.851724 11143 log.cc:824] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d: Log is configured to *not* fsync() on all Append() calls
I20260808 11:35:03.854817 11143 tablet_bootstrap.cc:492] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d: No bootstrap required, opened a new log
I20260808 11:35:03.855077 11143 ts_tablet_manager.cc:1397] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260808 11:35:03.860652 11141 raft_consensus.cc:348] T f3677c08b7874d16843a03f0e28aa254 P 9b28c9cb4cb34090b683aebd99da66ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b28c9cb4cb34090b683aebd99da66ed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43463 } } peers { permanent_uuid: "54a776854cd045ff80d6859a22d4083d" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33071 } } peers { permanent_uuid: "4d5e803b03d94123b85dcd17e893383d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37063 } }
I20260808 11:35:03.861047 11141 raft_consensus.cc:374] T f3677c08b7874d16843a03f0e28aa254 P 9b28c9cb4cb34090b683aebd99da66ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:35:03.861157 11141 raft_consensus.cc:729] T f3677c08b7874d16843a03f0e28aa254 P 9b28c9cb4cb34090b683aebd99da66ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b28c9cb4cb34090b683aebd99da66ed, State: Initialized, Role: FOLLOWER
I20260808 11:35:03.861824 11141 consensus_queue.cc:260] T f3677c08b7874d16843a03f0e28aa254 P 9b28c9cb4cb34090b683aebd99da66ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b28c9cb4cb34090b683aebd99da66ed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43463 } } peers { permanent_uuid: "54a776854cd045ff80d6859a22d4083d" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33071 } } peers { permanent_uuid: "4d5e803b03d94123b85dcd17e893383d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37063 } }
I20260808 11:35:03.862284 11142 raft_consensus.cc:348] T f3677c08b7874d16843a03f0e28aa254 P 54a776854cd045ff80d6859a22d4083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b28c9cb4cb34090b683aebd99da66ed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43463 } } peers { permanent_uuid: "54a776854cd045ff80d6859a22d4083d" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33071 } } peers { permanent_uuid: "4d5e803b03d94123b85dcd17e893383d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37063 } }
I20260808 11:35:03.862725 11142 raft_consensus.cc:374] T f3677c08b7874d16843a03f0e28aa254 P 54a776854cd045ff80d6859a22d4083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:35:03.862826 11142 raft_consensus.cc:729] T f3677c08b7874d16843a03f0e28aa254 P 54a776854cd045ff80d6859a22d4083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54a776854cd045ff80d6859a22d4083d, State: Initialized, Role: FOLLOWER
I20260808 11:35:03.863101 11120 heartbeater.cc:503] Master 127.26.66.190:39703 was elected leader, sending a full tablet report...
I20260808 11:35:03.863389 11142 consensus_queue.cc:260] T f3677c08b7874d16843a03f0e28aa254 P 54a776854cd045ff80d6859a22d4083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b28c9cb4cb34090b683aebd99da66ed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43463 } } peers { permanent_uuid: "54a776854cd045ff80d6859a22d4083d" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33071 } } peers { permanent_uuid: "4d5e803b03d94123b85dcd17e893383d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37063 } }
I20260808 11:35:03.864518 10975 heartbeater.cc:503] Master 127.26.66.190:39703 was elected leader, sending a full tablet report...
I20260808 11:35:03.865185 11142 ts_tablet_manager.cc:1428] T f3677c08b7874d16843a03f0e28aa254 P 54a776854cd045ff80d6859a22d4083d: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260808 11:35:03.865792 11143 raft_consensus.cc:348] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b28c9cb4cb34090b683aebd99da66ed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43463 } } peers { permanent_uuid: "54a776854cd045ff80d6859a22d4083d" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33071 } } peers { permanent_uuid: "4d5e803b03d94123b85dcd17e893383d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37063 } }
I20260808 11:35:03.866214 11143 raft_consensus.cc:374] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:35:03.866315 11143 raft_consensus.cc:729] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d5e803b03d94123b85dcd17e893383d, State: Initialized, Role: FOLLOWER
I20260808 11:35:03.867336 11143 consensus_queue.cc:260] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b28c9cb4cb34090b683aebd99da66ed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43463 } } peers { permanent_uuid: "54a776854cd045ff80d6859a22d4083d" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33071 } } peers { permanent_uuid: "4d5e803b03d94123b85dcd17e893383d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37063 } }
I20260808 11:35:03.868515 11141 ts_tablet_manager.cc:1428] T f3677c08b7874d16843a03f0e28aa254 P 9b28c9cb4cb34090b683aebd99da66ed: Time spent starting tablet: real 0.017s user 0.013s sys 0.000s
I20260808 11:35:03.870652 11143 ts_tablet_manager.cc:1428] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
W20260808 11:35:03.905910 10976 tablet.cc:2369] T f3677c08b7874d16843a03f0e28aa254 P 54a776854cd045ff80d6859a22d4083d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:35:03.965586 11151 raft_consensus.cc:482] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:35:03.965940 11151 raft_consensus.cc:504] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b28c9cb4cb34090b683aebd99da66ed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43463 } } peers { permanent_uuid: "54a776854cd045ff80d6859a22d4083d" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33071 } } peers { permanent_uuid: "4d5e803b03d94123b85dcd17e893383d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37063 } }
I20260808 11:35:03.967686 11151 leader_election.cc:288] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b28c9cb4cb34090b683aebd99da66ed (127.26.66.131:43463), 54a776854cd045ff80d6859a22d4083d (127.26.66.130:33071)
W20260808 11:35:03.973426 11121 tablet.cc:2369] T f3677c08b7874d16843a03f0e28aa254 P 9b28c9cb4cb34090b683aebd99da66ed: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:35:03.975430 11138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:03.968348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:50117 (local address 127.26.66.130:33071)
0808 11:35:03.968561 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:03.968568 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:03.969341 (+ 773us) server_negotiation.cc:407] Connection header received
0808 11:35:03.969572 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:03.969582 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:03.969646 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:03.969755 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:35:03.970423 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.971218 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.973363 (+ 2145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.974471 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.974663 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:03.974739 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:03.975026 (+ 287us) server_negotiation.cc:299] Negotiation successful
0808 11:35:03.975153 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 11:35:03.975487 11153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:03.968113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:33071 (local address 127.26.66.129:50117)
0808 11:35:03.969185 (+ 1072us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:03.969213 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 11:35:03.969401 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:35:03.969782 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:35:03.969787 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:35:03.969816 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:35:03.970213 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:03.970224 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.971362 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.971368 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:03.973169 (+ 1801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:03.973189 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.974688 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.974695 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:03.974855 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:03.974879 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 11:35:03.974988 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 11:35:03.975124 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":919,"thread_start_us":688,"threads_started":1}
I20260808 11:35:03.976089 11152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:03.968179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:43463 (local address 127.26.66.129:60081)
0808 11:35:03.969265 (+ 1086us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:03.969282 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:35:03.969446 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:35:03.969991 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:35:03.969995 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:35:03.970026 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:35:03.970510 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:03.970524 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.971670 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.971673 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:03.973425 (+ 1752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:03.973440 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.975147 (+ 1707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.975154 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:03.975325 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:03.975349 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 11:35:03.975455 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 11:35:03.975580 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":964,"thread_start_us":595,"threads_started":1}
I20260808 11:35:03.976109 11137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:03.968348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:60081 (local address 127.26.66.131:43463)
0808 11:35:03.968561 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:03.968568 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:03.969362 (+ 794us) server_negotiation.cc:407] Connection header received
0808 11:35:03.969605 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:03.969611 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:03.969690 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:03.969754 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:35:03.970678 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.971511 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.973621 (+ 2110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:03.974892 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:03.975069 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:03.975151 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:03.975485 (+ 334us) server_negotiation.cc:299] Negotiation successful
0808 11:35:03.975617 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 11:35:03.976752 10929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3677c08b7874d16843a03f0e28aa254" candidate_uuid: "4d5e803b03d94123b85dcd17e893383d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54a776854cd045ff80d6859a22d4083d" is_pre_election: true
I20260808 11:35:03.976981 11073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3677c08b7874d16843a03f0e28aa254" candidate_uuid: "4d5e803b03d94123b85dcd17e893383d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b28c9cb4cb34090b683aebd99da66ed" is_pre_election: true
I20260808 11:35:03.977263 10929 raft_consensus.cc:2454] T f3677c08b7874d16843a03f0e28aa254 P 54a776854cd045ff80d6859a22d4083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d5e803b03d94123b85dcd17e893383d in term 0.
I20260808 11:35:03.977502 11073 raft_consensus.cc:2454] T f3677c08b7874d16843a03f0e28aa254 P 9b28c9cb4cb34090b683aebd99da66ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d5e803b03d94123b85dcd17e893383d in term 0.
I20260808 11:35:03.977944 10716 leader_election.cc:302] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d5e803b03d94123b85dcd17e893383d, 54a776854cd045ff80d6859a22d4083d; no voters:
I20260808 11:35:03.978363 11151 raft_consensus.cc:2781] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:35:03.978528 11151 raft_consensus.cc:482] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:35:03.978636 11151 raft_consensus.cc:3037] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:35:03.980989 11151 raft_consensus.cc:504] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b28c9cb4cb34090b683aebd99da66ed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43463 } } peers { permanent_uuid: "54a776854cd045ff80d6859a22d4083d" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33071 } } peers { permanent_uuid: "4d5e803b03d94123b85dcd17e893383d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37063 } }
I20260808 11:35:03.981611 11151 leader_election.cc:288] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d [CANDIDATE]: Term 1 election: Requested vote from peers 9b28c9cb4cb34090b683aebd99da66ed (127.26.66.131:43463), 54a776854cd045ff80d6859a22d4083d (127.26.66.130:33071)
I20260808 11:35:03.982056 11073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3677c08b7874d16843a03f0e28aa254" candidate_uuid: "4d5e803b03d94123b85dcd17e893383d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b28c9cb4cb34090b683aebd99da66ed"
I20260808 11:35:03.982064 10929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3677c08b7874d16843a03f0e28aa254" candidate_uuid: "4d5e803b03d94123b85dcd17e893383d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54a776854cd045ff80d6859a22d4083d"
I20260808 11:35:03.982249 11073 raft_consensus.cc:3037] T f3677c08b7874d16843a03f0e28aa254 P 9b28c9cb4cb34090b683aebd99da66ed [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:35:03.982266 10929 raft_consensus.cc:3037] T f3677c08b7874d16843a03f0e28aa254 P 54a776854cd045ff80d6859a22d4083d [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:35:03.984522 10929 raft_consensus.cc:2454] T f3677c08b7874d16843a03f0e28aa254 P 54a776854cd045ff80d6859a22d4083d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d5e803b03d94123b85dcd17e893383d in term 1.
I20260808 11:35:03.984601 11073 raft_consensus.cc:2454] T f3677c08b7874d16843a03f0e28aa254 P 9b28c9cb4cb34090b683aebd99da66ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d5e803b03d94123b85dcd17e893383d in term 1.
I20260808 11:35:03.984999 10716 leader_election.cc:302] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d5e803b03d94123b85dcd17e893383d, 54a776854cd045ff80d6859a22d4083d; no voters:
I20260808 11:35:03.985301 11151 raft_consensus.cc:2781] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:35:03.985760 11151 raft_consensus.cc:686] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d [term 1 LEADER]: Becoming Leader. State: Replica: 4d5e803b03d94123b85dcd17e893383d, State: Running, Role: LEADER
I20260808 11:35:03.986321 11151 consensus_queue.cc:237] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b28c9cb4cb34090b683aebd99da66ed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43463 } } peers { permanent_uuid: "54a776854cd045ff80d6859a22d4083d" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33071 } } peers { permanent_uuid: "4d5e803b03d94123b85dcd17e893383d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37063 } }
I20260808 11:35:03.991003 10633 catalog_manager.cc:5495] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d5e803b03d94123b85dcd17e893383d (127.26.66.129). New cstate: current_term: 1 leader_uuid: "4d5e803b03d94123b85dcd17e893383d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b28c9cb4cb34090b683aebd99da66ed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54a776854cd045ff80d6859a22d4083d" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d5e803b03d94123b85dcd17e893383d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37063 } health_report { overall_health: HEALTHY } } }
I20260808 11:35:04.019855 11139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:04.014469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39586 (local address 127.26.66.129:37063)
0808 11:35:04.014685 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:04.014690 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:04.014708 (+ 18us) server_negotiation.cc:407] Connection header received
0808 11:35:04.014888 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:04.014892 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:04.014989 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:04.015111 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:35:04.015442 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:04.016230 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:04.017692 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:04.018093 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:04.018183 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:04.018694 (+ 511us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:35:04.019229 (+ 535us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:35:04.019345 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:04.019443 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 11:35:04.019513 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 11:35:04.028271 10929 raft_consensus.cc:1261] T f3677c08b7874d16843a03f0e28aa254 P 54a776854cd045ff80d6859a22d4083d [term 1 FOLLOWER]: Refusing update from remote peer 4d5e803b03d94123b85dcd17e893383d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:35:04.028297 11073 raft_consensus.cc:1261] T f3677c08b7874d16843a03f0e28aa254 P 9b28c9cb4cb34090b683aebd99da66ed [term 1 FOLLOWER]: Refusing update from remote peer 4d5e803b03d94123b85dcd17e893383d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:35:04.029290 11154 consensus_queue.cc:1035] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b28c9cb4cb34090b683aebd99da66ed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:35:04.029688 11151 consensus_queue.cc:1035] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d [LEADER]: Connected to new peer: Peer: permanent_uuid: "54a776854cd045ff80d6859a22d4083d" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:35:04.041599 11158 mvcc.cc:205] Tried to move back new op lower bound from 7316229750889254912 to 7316229750731276288. Current Snapshot: MvccSnapshot[applied={T|T < 7316229750889254912}]
I20260808 11:35:04.044615 11159 mvcc.cc:205] Tried to move back new op lower bound from 7316229750889254912 to 7316229750731276288. Current Snapshot: MvccSnapshot[applied={T|T < 7316229750889254912}]
I20260808 11:35:04.055323 10632 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48328:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:35:04.055660 10632 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48328:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:35:04.059602 10632 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7: Sending DeleteTablet for 3 replicas of tablet f3677c08b7874d16843a03f0e28aa254
I20260808 11:35:04.060798 11050 tablet_service.cc:1514] Processing DeleteTablet for tablet f3677c08b7874d16843a03f0e28aa254 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:35:04 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:51002
I20260808 11:35:04.061051 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 10699
I20260808 11:35:04.061270 10766 tablet_service.cc:1514] Processing DeleteTablet for tablet f3677c08b7874d16843a03f0e28aa254 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:35:04 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:39582
I20260808 11:35:04.061965 10907 tablet_service.cc:1514] Processing DeleteTablet for tablet f3677c08b7874d16843a03f0e28aa254 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:35:04 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:34396
I20260808 11:35:04.075609 11169 tablet_replica.cc:330] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d: stopping tablet replica
I20260808 11:35:04.076347 11171 tablet_replica.cc:330] T f3677c08b7874d16843a03f0e28aa254 P 54a776854cd045ff80d6859a22d4083d: stopping tablet replica
I20260808 11:35:04.076591 11168 tablet_replica.cc:330] T f3677c08b7874d16843a03f0e28aa254 P 9b28c9cb4cb34090b683aebd99da66ed: stopping tablet replica
I20260808 11:35:04.076854 11171 raft_consensus.cc:2229] T f3677c08b7874d16843a03f0e28aa254 P 54a776854cd045ff80d6859a22d4083d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:35:04.077008 11168 raft_consensus.cc:2229] T f3677c08b7874d16843a03f0e28aa254 P 9b28c9cb4cb34090b683aebd99da66ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:35:04.077455 11168 raft_consensus.cc:2258] T f3677c08b7874d16843a03f0e28aa254 P 9b28c9cb4cb34090b683aebd99da66ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:35:04.077456 11171 raft_consensus.cc:2258] T f3677c08b7874d16843a03f0e28aa254 P 54a776854cd045ff80d6859a22d4083d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:35:04.078153 11169 raft_consensus.cc:2229] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d [term 1 LEADER]: Raft consensus shutting down.
I20260808 11:35:04.078889 11169 raft_consensus.cc:2258] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:35:04.081221 11168 ts_tablet_manager.cc:1905] T f3677c08b7874d16843a03f0e28aa254 P 9b28c9cb4cb34090b683aebd99da66ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:35:04.081676 11169 ts_tablet_manager.cc:1905] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:35:04.083148 11171 ts_tablet_manager.cc:1905] T f3677c08b7874d16843a03f0e28aa254 P 54a776854cd045ff80d6859a22d4083d: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 11:35:04 dist-test-slave-zkpd krb5kdc[10587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188901, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.129@KRBTEST.COM
I20260808 11:35:04.088599 11168 ts_tablet_manager.cc:1918] T f3677c08b7874d16843a03f0e28aa254 P 9b28c9cb4cb34090b683aebd99da66ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:35:04.088791 11168 log.cc:1196] T f3677c08b7874d16843a03f0e28aa254 P 9b28c9cb4cb34090b683aebd99da66ed: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/wal/wals/f3677c08b7874d16843a03f0e28aa254
I20260808 11:35:04.089454 11168 ts_tablet_manager.cc:1939] T f3677c08b7874d16843a03f0e28aa254 P 9b28c9cb4cb34090b683aebd99da66ed: Deleting consensus metadata
I20260808 11:35:04.091512 10621 catalog_manager.cc:4841] TS 9b28c9cb4cb34090b683aebd99da66ed (127.26.66.131:43463): tablet f3677c08b7874d16843a03f0e28aa254 (table test-table [id=e31689d16c394db7a834cdfcd1bf1b20]) successfully deleted
I20260808 11:35:04.094848 11171 ts_tablet_manager.cc:1918] T f3677c08b7874d16843a03f0e28aa254 P 54a776854cd045ff80d6859a22d4083d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:35:04.095042 11171 log.cc:1196] T f3677c08b7874d16843a03f0e28aa254 P 54a776854cd045ff80d6859a22d4083d: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/wal/wals/f3677c08b7874d16843a03f0e28aa254
I20260808 11:35:04.095587 11169 ts_tablet_manager.cc:1918] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:35:04.095639 11171 ts_tablet_manager.cc:1939] T f3677c08b7874d16843a03f0e28aa254 P 54a776854cd045ff80d6859a22d4083d: Deleting consensus metadata
I20260808 11:35:04.095780 11169 log.cc:1196] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/wal/wals/f3677c08b7874d16843a03f0e28aa254
I20260808 11:35:04.096724 11169 ts_tablet_manager.cc:1939] T f3677c08b7874d16843a03f0e28aa254 P 4d5e803b03d94123b85dcd17e893383d: Deleting consensus metadata
I20260808 11:35:04.097596 10618 catalog_manager.cc:4841] TS 54a776854cd045ff80d6859a22d4083d (127.26.66.130:33071): tablet f3677c08b7874d16843a03f0e28aa254 (table test-table [id=e31689d16c394db7a834cdfcd1bf1b20]) successfully deleted
I20260808 11:35:04.098738 11139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:04.062374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39590 (local address 127.26.66.129:37063)
0808 11:35:04.062590 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:04.062598 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:04.072830 (+ 10232us) server_negotiation.cc:407] Connection header received
0808 11:35:04.073396 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:04.073406 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:04.073537 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:04.073646 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:35:04.079417 (+ 5771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:04.080632 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:04.082742 (+ 2110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:04.083481 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:04.083590 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:04.089695 (+ 6105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:35:04.089711 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:35:04.089734 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:35:04.089802 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:35:04.094372 (+ 4570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:04.095355 (+ 983us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:04.095364 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:04.095375 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:04.095590 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:04.096154 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:04.096167 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:04.096173 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:04.096670 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:35:04.096999 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:04.098056 (+ 1057us) server_negotiation.cc:299] Negotiation successful
0808 11:35:04.098332 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 11:35:04.099532 10618 catalog_manager.cc:4841] TS 4d5e803b03d94123b85dcd17e893383d (127.26.66.129:37063): tablet f3677c08b7874d16843a03f0e28aa254 (table test-table [id=e31689d16c394db7a834cdfcd1bf1b20]) successfully deleted
I20260808 11:35:04.099565 10831 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:35:04.213152 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 10699
I20260808 11:35:04.236495 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 10843
Aug 08 11:35:04 dist-test-slave-zkpd krb5kdc[10587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188901, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.130@KRBTEST.COM
I20260808 11:35:04.251657 11138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:04.237339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34398 (local address 127.26.66.130:33071)
0808 11:35:04.237528 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:04.237532 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:04.237552 (+ 20us) server_negotiation.cc:407] Connection header received
0808 11:35:04.237680 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:04.237684 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:04.237749 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:04.237838 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:35:04.239068 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:04.239837 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:04.241247 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:04.241644 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:04.241736 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:04.246386 (+ 4650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:35:04.246401 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:35:04.246417 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:35:04.246454 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:35:04.249224 (+ 2770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:04.249887 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:04.249894 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:04.249896 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:04.250043 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:04.250374 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:04.250377 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:04.250379 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:04.250744 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:35:04.250965 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:04.251221 (+ 256us) server_negotiation.cc:299] Negotiation successful
0808 11:35:04.251388 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 11:35:04.252414 10970 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:35:04.346045 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 10843
I20260808 11:35:04.369541 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 10983
Aug 08 11:35:04 dist-test-slave-zkpd krb5kdc[10587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188901, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.131@KRBTEST.COM
I20260808 11:35:04.386759 11137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:04.370904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51018 (local address 127.26.66.131:43463)
0808 11:35:04.371110 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:04.371116 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:04.371135 (+ 19us) server_negotiation.cc:407] Connection header received
0808 11:35:04.371201 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:04.371206 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:04.371271 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:04.371385 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:35:04.373333 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:04.374202 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:04.375702 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:04.376299 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:04.376445 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:04.381269 (+ 4824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:35:04.381287 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:35:04.381303 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:35:04.381337 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:35:04.384266 (+ 2929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:04.384940 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:04.384948 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:04.384950 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:04.385080 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:04.385417 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:04.385420 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:04.385422 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:04.385757 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:35:04.386012 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:04.386219 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 11:35:04.386384 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 11:35:04.387559 11115 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:35:04.478394 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 10983
I20260808 11:35:04.500075 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 10600
I20260808 11:35:04.501297 10666 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:35:04.614918 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 10600
I20260808 11:35:24.641858 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:39703
--webserver_interface=127.26.66.190
--webserver_port=45347
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:39703
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:35:24.996658 11178 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:35:24.996938 11178 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:35:24.997102 11178 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:35:25.004330 11178 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 11:35:25.004426 11178 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 11:35:25.004492 11178 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 11:35:25.004565 11178 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:35:25.004652 11178 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:35:25.004769 11178 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:35:25.004849 11178 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:35:25.004928 11178 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:35:25.015285 11178 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:39703
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:39703
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=45347
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:35:25.016623 11178 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:35:25.018036 11178 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:35:25.044747 11185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:35:25.044858 11184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:35:25.044761 11187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:35:25.045625 11178 server_base.cc:1034] running on GCE node
I20260808 11:35:25.046437 11178 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:35:25.047953 11178 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:35:25.049193 11178 hybrid_clock.cc:648] HybridClock initialized: now 1786188925049123 us; error 37 us; skew 500 ppm
I20260808 11:35:25.049548 11178 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:35:25 dist-test-slave-zkpd krb5kdc[10587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188925, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:35:25.056120 11178 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:35:25.057835 11178 webserver.cc:460] Webserver started at http://127.26.66.190:45347/ using document root <none> and password file <none>
I20260808 11:35:25.058561 11178 fs_manager.cc:359] Metadata directory not provided
I20260808 11:35:25.058665 11178 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:35:25.064610 11178 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 11:35:25.067495 11194 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:25.069007 11178 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 11:35:25.069238 11178 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "c72822eafd9b4cd5b79d03020b7e43e7"
format_stamp: "Formatted at 2026-08-08 11:35:01 on dist-test-slave-zkpd"
server_key: "e11557d954707e98aab5e0497c87fd34"
server_key_iv: "22fd1b0ad2cd156079d8a520dcf00908"
server_key_version: "encryptionkey@0"
I20260808 11:35:25.070451 11178 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:35:25.088076 11178 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:35:25.093297 11178 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:35:25.093627 11178 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:35:25.115291 11178 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:39703
I20260808 11:35:25.115320 11250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:39703 every 8 connection(s)
I20260808 11:35:25.117072 11178 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:35:25.117874 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 11178
I20260808 11:35:25.118963 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:37063
--local_ip_for_outbound_sockets=127.26.66.129
--tserver_master_addrs=127.26.66.190:39703
--webserver_port=43587
--webserver_interface=127.26.66.129
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 11:35:25.125332 11251 sys_catalog.cc:263] Verifying existing consensus state
I20260808 11:35:25.129118 11251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7: Bootstrap starting.
I20260808 11:35:25.151299 11251 log.cc:824] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7: Log is configured to *not* fsync() on all Append() calls
I20260808 11:35:25.165000 11251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 11:35:25.165604 11251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7: Bootstrap complete.
I20260808 11:35:25.176580 11251 raft_consensus.cc:348] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c72822eafd9b4cd5b79d03020b7e43e7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 39703 } }
I20260808 11:35:25.177536 11251 raft_consensus.cc:729] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c72822eafd9b4cd5b79d03020b7e43e7, State: Initialized, Role: FOLLOWER
I20260808 11:35:25.178220 11251 consensus_queue.cc:260] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c72822eafd9b4cd5b79d03020b7e43e7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 39703 } }
I20260808 11:35:25.178493 11251 raft_consensus.cc:388] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:35:25.178654 11251 raft_consensus.cc:482] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:35:25.178854 11251 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [term 1 FOLLOWER]: Advancing to term 2
I20260808 11:35:25.183218 11251 raft_consensus.cc:504] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c72822eafd9b4cd5b79d03020b7e43e7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 39703 } }
I20260808 11:35:25.183792 11251 leader_election.cc:302] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c72822eafd9b4cd5b79d03020b7e43e7; no voters:
I20260808 11:35:25.184561 11251 leader_election.cc:288] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 11:35:25.184725 11256 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 11:35:25.186002 11256 raft_consensus.cc:686] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [term 2 LEADER]: Becoming Leader. State: Replica: c72822eafd9b4cd5b79d03020b7e43e7, State: Running, Role: LEADER
I20260808 11:35:25.186626 11256 consensus_queue.cc:237] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c72822eafd9b4cd5b79d03020b7e43e7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 39703 } }
I20260808 11:35:25.187047 11251 sys_catalog.cc:564] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:35:25.189417 11258 sys_catalog.cc:455] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c72822eafd9b4cd5b79d03020b7e43e7. Latest consensus state: current_term: 2 leader_uuid: "c72822eafd9b4cd5b79d03020b7e43e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c72822eafd9b4cd5b79d03020b7e43e7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 39703 } } }
I20260808 11:35:25.189817 11258 sys_catalog.cc:458] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [sys.catalog]: This master's current role is: LEADER
I20260808 11:35:25.189749 11257 sys_catalog.cc:455] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c72822eafd9b4cd5b79d03020b7e43e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c72822eafd9b4cd5b79d03020b7e43e7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 39703 } } }
I20260808 11:35:25.190237 11257 sys_catalog.cc:458] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [sys.catalog]: This master's current role is: LEADER
I20260808 11:35:25.201463 11263 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:35:25.210860 11263 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:35:25.212464 11263 catalog_manager.cc:1259] Loaded cluster ID: f38a225543774e84bd9634d9126d0675
I20260808 11:35:25.212579 11263 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:35:25.217430 11263 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:35:25.219131 11263 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7: Loaded TSK: 0
I20260808 11:35:25.264791 11263 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7: Generated new TSK 1
I20260808 11:35:25.265239 11263 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 11:35:25.495527 11253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:35:25.495860 11253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:35:25.496094 11253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:35:25.503750 11253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:35:25.503929 11253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:35:25.504106 11253 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:35:25.513855 11253 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:37063
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=43587
--tserver_master_addrs=127.26.66.190:39703
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:35:25.515146 11253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:35:25.516520 11253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:35:25.531493 11285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:35:25.531531 11283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:35:25.532202 11282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:35:25.532506 11253 server_base.cc:1034] running on GCE node
I20260808 11:35:25.533221 11253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:35:25.534559 11253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:35:25.535828 11253 hybrid_clock.cc:648] HybridClock initialized: now 1786188925535767 us; error 64 us; skew 500 ppm
I20260808 11:35:25.536235 11253 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:35:25 dist-test-slave-zkpd krb5kdc[10587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188925, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:35:25.540362 11253 init.cc:377] Logged in from keytab as kudu/127.26.66.129@KRBTEST.COM (short username kudu)
I20260808 11:35:25.541972 11253 webserver.cc:460] Webserver started at http://127.26.66.129:43587/ using document root <none> and password file <none>
I20260808 11:35:25.542670 11253 fs_manager.cc:359] Metadata directory not provided
I20260808 11:35:25.542827 11253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:35:25.548519 11253 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 11:35:25.551334 11292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:25.552762 11253 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:35:25.552946 11253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "4d5e803b03d94123b85dcd17e893383d"
format_stamp: "Formatted at 2026-08-08 11:35:02 on dist-test-slave-zkpd"
server_key: "638ba969979c10723b9aa38758212d12"
server_key_iv: "20e0e2b5e5253a959a0523baa6401239"
server_key_version: "encryptionkey@0"
I20260808 11:35:25.553954 11253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:35:25.580684 11253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:35:25.585209 11253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:35:25.585494 11253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:35:25.586531 11253 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:35:25.588084 11253 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:35:25.588212 11253 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:25.588352 11253 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:35:25.588444 11253 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:25.622531 11253 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:37063
I20260808 11:35:25.622635 11412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:37063 every 8 connection(s)
I20260808 11:35:25.624037 11253 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:35:25.626215 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 11253
I20260808 11:35:25.627017 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:33071
--local_ip_for_outbound_sockets=127.26.66.130
--tserver_master_addrs=127.26.66.190:39703
--webserver_port=34945
--webserver_interface=127.26.66.130
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 11:35:25 dist-test-slave-zkpd krb5kdc[10587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188925, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:35:25.648548 11417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:25.627345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.129:53537)
0808 11:35:25.628393 (+ 1048us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:25.628444 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 11:35:25.630208 (+ 1764us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:35:25.631551 (+ 1343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:35:25.631563 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:35:25.632196 (+ 633us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:35:25.632714 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:25.632731 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:25.634369 (+ 1638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:25.634374 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:25.635571 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:25.635583 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:25.636669 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:25.636677 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:25.636954 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:25.637617 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:35:25.637639 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:35:25.640073 (+ 2434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:35:25.644618 (+ 4545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:35:25.644625 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:35:25.644635 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:35:25.645031 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:35:25.645552 (+ 521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:35:25.645556 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:35:25.645558 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:35:25.645719 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:35:25.646701 (+ 982us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:35:25.646706 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:35:25.646969 (+ 263us) client_negotiation.cc:769] Sending connection context
0808 11:35:25.647172 (+ 203us) client_negotiation.cc:240] Negotiation successful
0808 11:35:25.647532 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":756,"thread_start_us":548,"threads_started":1}
I20260808 11:35:25.649219 11416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:25.627271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:53537 (local address 127.26.66.190:39703)
0808 11:35:25.627989 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:25.628007 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:25.628597 (+ 590us) server_negotiation.cc:407] Connection header received
0808 11:35:25.630742 (+ 2145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:25.630755 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:25.631061 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:25.631405 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:35:25.632931 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:25.634200 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:25.635723 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:25.636442 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:25.636637 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:25.640417 (+ 3780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:35:25.640429 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:35:25.640456 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:35:25.640499 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:35:25.644468 (+ 3969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:25.645182 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:25.645193 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:25.645203 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:25.645422 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:25.645857 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:25.645865 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:25.645870 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:25.646546 (+ 676us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:35:25.646766 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:25.647458 (+ 692us) server_negotiation.cc:299] Negotiation successful
0808 11:35:25.647997 (+ 539us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":269,"threads_started":1}
I20260808 11:35:25.651973 11413 heartbeater.cc:347] Connected to a master server at 127.26.66.190:39703
I20260808 11:35:25.652298 11413 heartbeater.cc:464] Registering TS with master...
I20260808 11:35:25.653250 11413 heartbeater.cc:511] Master 127.26.66.190:39703 requested a full tablet report, sending...
I20260808 11:35:25.655544 11213 ts_manager.cc:194] Registered new tserver with Master: 4d5e803b03d94123b85dcd17e893383d (127.26.66.129:37063)
I20260808 11:35:25.657220 11213 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.129@KRBTEST.COM'} at 127.26.66.129:53537
W20260808 11:35:25.983016 11418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:35:25.983285 11418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:35:25.983438 11418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:35:25.990710 11418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:35:25.990821 11418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:35:25.991031 11418 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:35:26.000723 11418 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:33071
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=34945
--tserver_master_addrs=127.26.66.190:39703
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:35:26.002178 11418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:35:26.003682 11418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:35:26.016837 11424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:35:26.016893 11425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:35:26.016862 11427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:35:26.018060 11418 server_base.cc:1034] running on GCE node
I20260808 11:35:26.018709 11418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:35:26.019663 11418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:35:26.020910 11418 hybrid_clock.cc:648] HybridClock initialized: now 1786188926020835 us; error 81 us; skew 500 ppm
I20260808 11:35:26.021245 11418 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:35:26 dist-test-slave-zkpd krb5kdc[10587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188926, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:35:26.024495 11418 init.cc:377] Logged in from keytab as kudu/127.26.66.130@KRBTEST.COM (short username kudu)
I20260808 11:35:26.025911 11418 webserver.cc:460] Webserver started at http://127.26.66.130:34945/ using document root <none> and password file <none>
I20260808 11:35:26.026546 11418 fs_manager.cc:359] Metadata directory not provided
I20260808 11:35:26.026670 11418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:35:26.031883 11418 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.002s
I20260808 11:35:26.034519 11434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:26.035795 11418 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 11:35:26.036003 11418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "54a776854cd045ff80d6859a22d4083d"
format_stamp: "Formatted at 2026-08-08 11:35:03 on dist-test-slave-zkpd"
server_key: "cdd45583f63efcb50bc16616617360a2"
server_key_iv: "e41b4197d7ac594b7725f02fb957a5a1"
server_key_version: "encryptionkey@0"
I20260808 11:35:26.036984 11418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:35:26.054860 11418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:35:26.059048 11418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:35:26.059319 11418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:35:26.060361 11418 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:35:26.061633 11418 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:35:26.061746 11418 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:26.061875 11418 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:35:26.061971 11418 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:26.099337 11418 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:33071
I20260808 11:35:26.099406 11552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:33071 every 8 connection(s)
I20260808 11:35:26.101045 11418 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:35:26.104957 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 11418
I20260808 11:35:26.105846 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:43463
--local_ip_for_outbound_sockets=127.26.66.131
--tserver_master_addrs=127.26.66.190:39703
--webserver_port=33629
--webserver_interface=127.26.66.131
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 11:35:26 dist-test-slave-zkpd krb5kdc[10587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188926, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:35:26.134205 11555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:26.104952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.130:39159)
0808 11:35:26.106161 (+ 1209us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:26.106234 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0808 11:35:26.109121 (+ 2887us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:35:26.110269 (+ 1148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:35:26.110284 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:35:26.111105 (+ 821us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:35:26.111969 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:26.112000 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:26.113599 (+ 1599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:26.113606 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:26.115678 (+ 2072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:26.115694 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:26.117042 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:26.117052 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:26.117342 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:26.118103 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:35:26.118131 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:35:26.122373 (+ 4242us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:35:26.128295 (+ 5922us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:35:26.128309 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:35:26.128329 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:35:26.129047 (+ 718us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:35:26.129653 (+ 606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:35:26.129660 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:35:26.129665 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:35:26.129969 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:35:26.130892 (+ 923us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:35:26.130902 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:35:26.131415 (+ 513us) client_negotiation.cc:769] Sending connection context
0808 11:35:26.131760 (+ 345us) client_negotiation.cc:240] Negotiation successful
0808 11:35:26.132480 (+ 720us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":851,"thread_start_us":564,"threads_started":1}
I20260808 11:35:26.135773 11416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:26.104314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:39159 (local address 127.26.66.190:39703)
0808 11:35:26.104533 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:26.104539 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:26.106359 (+ 1820us) server_negotiation.cc:407] Connection header received
0808 11:35:26.109485 (+ 3126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:26.109493 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:26.109593 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:26.109678 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:35:26.112200 (+ 2522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:26.113350 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:26.115868 (+ 2518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:26.116569 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:26.116672 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:26.122712 (+ 6040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:35:26.122722 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:35:26.122730 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:35:26.122785 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:35:26.128058 (+ 5273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:26.129245 (+ 1187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:26.129254 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:26.129261 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:26.129446 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:26.130127 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:26.130134 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:26.130139 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:26.130613 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:35:26.130774 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:26.135011 (+ 4237us) server_negotiation.cc:299] Negotiation successful
0808 11:35:26.135337 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 11:35:26.137195 11553 heartbeater.cc:347] Connected to a master server at 127.26.66.190:39703
I20260808 11:35:26.137549 11553 heartbeater.cc:464] Registering TS with master...
I20260808 11:35:26.138605 11553 heartbeater.cc:511] Master 127.26.66.190:39703 requested a full tablet report, sending...
I20260808 11:35:26.140574 11213 ts_manager.cc:194] Registered new tserver with Master: 54a776854cd045ff80d6859a22d4083d (127.26.66.130:33071)
I20260808 11:35:26.141992 11213 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.130@KRBTEST.COM'} at 127.26.66.130:39159
W20260808 11:35:26.466284 11557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:35:26.466528 11557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:35:26.466686 11557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:35:26.473649 11557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:35:26.473762 11557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:35:26.473944 11557 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:35:26.483254 11557 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:43463
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=33629
--tserver_master_addrs=127.26.66.190:39703
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:35:26.484450 11557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:35:26.485699 11557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:35:26.498733 11563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:35:26.498852 11562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:35:26.498853 11567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:35:26.499704 11557 server_base.cc:1034] running on GCE node
I20260808 11:35:26.500301 11557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:35:26.501331 11557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:35:26.502552 11557 hybrid_clock.cc:648] HybridClock initialized: now 1786188926502507 us; error 56 us; skew 500 ppm
I20260808 11:35:26.502866 11557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:35:26 dist-test-slave-zkpd krb5kdc[10587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188926, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:35:26.506033 11557 init.cc:377] Logged in from keytab as kudu/127.26.66.131@KRBTEST.COM (short username kudu)
I20260808 11:35:26.507395 11557 webserver.cc:460] Webserver started at http://127.26.66.131:33629/ using document root <none> and password file <none>
I20260808 11:35:26.508049 11557 fs_manager.cc:359] Metadata directory not provided
I20260808 11:35:26.508188 11557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:35:26.513273 11557 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260808 11:35:26.515817 11574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:26.517120 11557 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 11:35:26.517292 11557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "9b28c9cb4cb34090b683aebd99da66ed"
format_stamp: "Formatted at 2026-08-08 11:35:03 on dist-test-slave-zkpd"
server_key: "0760314f8b097bf1e438edb13013aa36"
server_key_iv: "edca641c20345fa5f9f04924a76ec4e3"
server_key_version: "encryptionkey@0"
I20260808 11:35:26.518239 11557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:35:26.544620 11557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:35:26.549017 11557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:35:26.549306 11557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:35:26.550376 11557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:35:26.551731 11557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:35:26.551851 11557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:26.552006 11557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:35:26.552095 11557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:26.586954 11557 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:43463
I20260808 11:35:26.586997 11696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:43463 every 8 connection(s)
I20260808 11:35:26.588577 11557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:35:26.591002 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 11557
Aug 08 11:35:26 dist-test-slave-zkpd krb5kdc[10587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188926, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:35:26.610948 11700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:26.591994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51430 (local address 127.26.66.190:39703)
0808 11:35:26.595589 (+ 3595us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:26.595597 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:26.596196 (+ 599us) server_negotiation.cc:407] Connection header received
0808 11:35:26.596374 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:26.596378 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:26.596434 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:26.596523 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:35:26.598459 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:26.599188 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:26.600986 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:26.601463 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:26.601590 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:26.604606 (+ 3016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:35:26.604611 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:35:26.604614 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:35:26.604658 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:35:26.607859 (+ 3201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:26.608691 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:26.608697 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:26.608702 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:26.608845 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:26.609288 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:26.609292 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:26.609294 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:26.609653 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:35:26.609903 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:26.610247 (+ 344us) server_negotiation.cc:299] Negotiation successful
0808 11:35:26.610497 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3493,"thread_start_us":3415,"threads_started":1}
I20260808 11:35:26.611008 11416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:26.591156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:45401 (local address 127.26.66.190:39703)
0808 11:35:26.591377 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:26.591384 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:26.592955 (+ 1571us) server_negotiation.cc:407] Connection header received
0808 11:35:26.594943 (+ 1988us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:26.594949 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:26.595052 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:26.595162 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:35:26.597266 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:26.597958 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:26.600084 (+ 2126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:26.600460 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:26.600547 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:26.604402 (+ 3855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:35:26.604408 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:35:26.604412 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:35:26.604452 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:35:26.607462 (+ 3010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:26.608355 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:26.608361 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:26.608366 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:26.608512 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:26.609057 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:26.609062 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:26.609065 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:26.609402 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:35:26.609534 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:26.610463 (+ 929us) server_negotiation.cc:299] Negotiation successful
0808 11:35:26.610706 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 11:35:26.612207 11699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:26.591605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.131:45401)
0808 11:35:26.592804 (+ 1199us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:26.592851 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 11:35:26.594659 (+ 1808us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:35:26.595430 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:35:26.595442 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:35:26.596250 (+ 808us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:35:26.597093 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:26.597120 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:26.598119 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:26.598125 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:26.599949 (+ 1824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:26.599965 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:26.600678 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:26.600685 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:26.601006 (+ 321us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:26.601736 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:35:26.601758 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:35:26.604174 (+ 2416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:35:26.607602 (+ 3428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:35:26.607611 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:35:26.607629 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:35:26.608218 (+ 589us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:35:26.608651 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:35:26.608658 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:35:26.608665 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:35:26.608930 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:35:26.609548 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:35:26.609556 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:35:26.609986 (+ 430us) client_negotiation.cc:769] Sending connection context
0808 11:35:26.610329 (+ 343us) client_negotiation.cc:240] Negotiation successful
0808 11:35:26.610852 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":923,"thread_start_us":741,"threads_started":1}
I20260808 11:35:26.613639 11697 heartbeater.cc:347] Connected to a master server at 127.26.66.190:39703
I20260808 11:35:26.613986 11697 heartbeater.cc:464] Registering TS with master...
I20260808 11:35:26.614656 11697 heartbeater.cc:511] Master 127.26.66.190:39703 requested a full tablet report, sending...
I20260808 11:35:26.615995 11213 ts_manager.cc:194] Registered new tserver with Master: 9b28c9cb4cb34090b683aebd99da66ed (127.26.66.131:43463)
I20260808 11:35:26.616750 11213 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.131@KRBTEST.COM'} at 127.26.66.131:45401
I20260808 11:35:26.626135 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 11:35:26.632468 11416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:26.627095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51436 (local address 127.26.66.190:39703)
0808 11:35:26.627240 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:26.627245 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:26.627762 (+ 517us) server_negotiation.cc:407] Connection header received
0808 11:35:26.627988 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:26.627992 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:26.628112 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:26.628231 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:35:26.628664 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:26.629387 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:26.630849 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:26.631216 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:26.631298 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:26.631783 (+ 485us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:35:26.632033 (+ 250us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 11:35:26.632297 (+ 264us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51436: token expired
Metrics: {"server-negotiator.queue_time_us":52}
W20260808 11:35:26.632603 11416 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51436: token expired
W20260808 11:35:26.633154 11124 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.26.66.190:39703)
I20260808 11:35:26.646363 11416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:26.633633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51448 (local address 127.26.66.190:39703)
0808 11:35:26.633809 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:26.633814 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:26.633890 (+ 76us) server_negotiation.cc:407] Connection header received
0808 11:35:26.634064 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:26.634069 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:26.634146 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:26.634249 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:35:26.635654 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:26.636439 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:26.637734 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:26.638137 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:26.638270 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:26.640995 (+ 2725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:35:26.641000 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:35:26.641003 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:35:26.641034 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:35:26.643624 (+ 2590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:26.644370 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:26.644376 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:26.644380 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:26.644504 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:26.644916 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:26.644922 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:26.644925 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:26.645232 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:35:26.645500 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:26.645828 (+ 328us) server_negotiation.cc:299] Negotiation successful
0808 11:35:26.646049 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 11:35:26.649617 11213 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51448:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 11:35:26.657253 11213 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:35:26.661230 11413 heartbeater.cc:503] Master 127.26.66.190:39703 was elected leader, sending a full tablet report...
I20260808 11:35:26.690986 11708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:26.669355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:37063 (local address 127.0.0.1:32924)
0808 11:35:26.670150 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:26.670197 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 11:35:26.670377 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:35:26.682929 (+ 12552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:35:26.682935 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:35:26.682964 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:35:26.683362 (+ 398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:26.683375 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:26.685232 (+ 1857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:26.685239 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:26.687922 (+ 2683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:26.687940 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:26.689952 (+ 2012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:26.689961 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:26.690169 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:26.690240 (+ 71us) client_negotiation.cc:769] Sending connection context
0808 11:35:26.690365 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 11:35:26.690548 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":426,"threads_started":1}
I20260808 11:35:26.691228 11714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:26.671798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50970 (local address 127.26.66.130:33071)
0808 11:35:26.683096 (+ 11298us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:26.683104 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:26.683131 (+ 27us) server_negotiation.cc:407] Connection header received
0808 11:35:26.683231 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:26.683241 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:26.683453 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:26.683637 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:35:26.684424 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:26.685953 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:26.688576 (+ 2623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:26.689871 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:26.690004 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:26.690234 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:26.690681 (+ 447us) server_negotiation.cc:299] Negotiation successful
0808 11:35:26.690872 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11130,"thread_start_us":11104,"threads_started":1}
I20260808 11:35:26.691032 11713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:26.671191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:33071 (local address 127.0.0.1:50970)
0808 11:35:26.682438 (+ 11247us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:26.682452 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 11:35:26.682577 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:35:26.683859 (+ 1282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:35:26.683864 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:35:26.683892 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:35:26.684226 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:26.684240 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:26.686145 (+ 1905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:26.686150 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:26.688424 (+ 2274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:26.688444 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:26.690317 (+ 1873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:26.690324 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:26.690473 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:26.690502 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 11:35:26.690582 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 11:35:26.690700 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11154,"thread_start_us":11040,"threads_started":1}
I20260808 11:35:26.691762 11710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:26.669561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:43463 (local address 127.0.0.1:59834)
0808 11:35:26.681135 (+ 11574us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:26.681160 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 11:35:26.681300 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:35:26.684480 (+ 3180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:35:26.684484 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:35:26.684510 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:35:26.684871 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:26.684881 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:26.686878 (+ 1997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:26.686883 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:26.689172 (+ 2289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:26.689190 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:26.690988 (+ 1798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:26.690996 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:26.691180 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:26.691221 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 11:35:26.691292 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 11:35:26.691419 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11396,"thread_start_us":11850,"threads_started":1}
I20260808 11:35:26.692379 11711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:26.669678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32924 (local address 127.26.66.129:37063)
0808 11:35:26.682126 (+ 12448us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:26.682138 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:26.682173 (+ 35us) server_negotiation.cc:407] Connection header received
0808 11:35:26.682278 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:26.682285 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:26.682550 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:26.683121 (+ 571us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:35:26.683588 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:26.685060 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:26.688110 (+ 3050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:26.689688 (+ 1578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:26.691498 (+ 1810us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:26.691759 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:26.691826 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 11:35:26.692022 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12225,"thread_start_us":12080,"threads_started":1}
I20260808 11:35:26.693027 11712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:26.670326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59834 (local address 127.26.66.131:43463)
0808 11:35:26.683881 (+ 13555us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:26.683920 (+ 39us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:26.683957 (+ 37us) server_negotiation.cc:407] Connection header received
0808 11:35:26.684055 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:26.684064 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:26.684270 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:26.684490 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:35:26.685035 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:26.686732 (+ 1697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:26.689339 (+ 2607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:26.690720 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:26.691791 (+ 1071us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:26.692220 (+ 429us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:26.692285 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 11:35:26.692620 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13398,"thread_start_us":13226,"threads_started":1}
I20260808 11:35:26.695394 11487 tablet_service.cc:1467] Processing CreateTablet for tablet b6434eddf2fd403882f5d02645b5cfa8 (DEFAULT_TABLE table=test-table [id=78da76d2747b4ea8bb5e5b7be06c5bd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:35:26.696907 11487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6434eddf2fd403882f5d02645b5cfa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:35:26.696492 11344 tablet_service.cc:1467] Processing CreateTablet for tablet b6434eddf2fd403882f5d02645b5cfa8 (DEFAULT_TABLE table=test-table [id=78da76d2747b4ea8bb5e5b7be06c5bd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:35:26.698009 11344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6434eddf2fd403882f5d02645b5cfa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:35:26.698640 11627 tablet_service.cc:1467] Processing CreateTablet for tablet b6434eddf2fd403882f5d02645b5cfa8 (DEFAULT_TABLE table=test-table [id=78da76d2747b4ea8bb5e5b7be06c5bd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:35:26.700035 11627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6434eddf2fd403882f5d02645b5cfa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:35:26.711663 11715 tablet_bootstrap.cc:492] T b6434eddf2fd403882f5d02645b5cfa8 P 4d5e803b03d94123b85dcd17e893383d: Bootstrap starting.
I20260808 11:35:26.713640 11716 tablet_bootstrap.cc:492] T b6434eddf2fd403882f5d02645b5cfa8 P 54a776854cd045ff80d6859a22d4083d: Bootstrap starting.
I20260808 11:35:26.715615 11717 tablet_bootstrap.cc:492] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed: Bootstrap starting.
I20260808 11:35:26.717154 11716 tablet_bootstrap.cc:654] T b6434eddf2fd403882f5d02645b5cfa8 P 54a776854cd045ff80d6859a22d4083d: Neither blocks nor log segments found. Creating new log.
I20260808 11:35:26.717514 11715 tablet_bootstrap.cc:654] T b6434eddf2fd403882f5d02645b5cfa8 P 4d5e803b03d94123b85dcd17e893383d: Neither blocks nor log segments found. Creating new log.
I20260808 11:35:26.718529 11716 log.cc:824] T b6434eddf2fd403882f5d02645b5cfa8 P 54a776854cd045ff80d6859a22d4083d: Log is configured to *not* fsync() on all Append() calls
I20260808 11:35:26.718717 11717 tablet_bootstrap.cc:654] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed: Neither blocks nor log segments found. Creating new log.
I20260808 11:35:26.719120 11715 log.cc:824] T b6434eddf2fd403882f5d02645b5cfa8 P 4d5e803b03d94123b85dcd17e893383d: Log is configured to *not* fsync() on all Append() calls
I20260808 11:35:26.719970 11717 log.cc:824] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed: Log is configured to *not* fsync() on all Append() calls
I20260808 11:35:26.722059 11716 tablet_bootstrap.cc:492] T b6434eddf2fd403882f5d02645b5cfa8 P 54a776854cd045ff80d6859a22d4083d: No bootstrap required, opened a new log
I20260808 11:35:26.722160 11715 tablet_bootstrap.cc:492] T b6434eddf2fd403882f5d02645b5cfa8 P 4d5e803b03d94123b85dcd17e893383d: No bootstrap required, opened a new log
I20260808 11:35:26.722342 11716 ts_tablet_manager.cc:1397] T b6434eddf2fd403882f5d02645b5cfa8 P 54a776854cd045ff80d6859a22d4083d: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260808 11:35:26.722414 11715 ts_tablet_manager.cc:1397] T b6434eddf2fd403882f5d02645b5cfa8 P 4d5e803b03d94123b85dcd17e893383d: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260808 11:35:26.722682 11717 tablet_bootstrap.cc:492] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed: No bootstrap required, opened a new log
I20260808 11:35:26.722940 11717 ts_tablet_manager.cc:1397] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.003s
I20260808 11:35:26.730307 11717 raft_consensus.cc:348] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d5e803b03d94123b85dcd17e893383d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37063 } } peers { permanent_uuid: "9b28c9cb4cb34090b683aebd99da66ed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43463 } } peers { permanent_uuid: "54a776854cd045ff80d6859a22d4083d" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33071 } }
I20260808 11:35:26.730700 11717 raft_consensus.cc:374] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:35:26.730789 11717 raft_consensus.cc:729] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b28c9cb4cb34090b683aebd99da66ed, State: Initialized, Role: FOLLOWER
I20260808 11:35:26.731372 11717 consensus_queue.cc:260] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d5e803b03d94123b85dcd17e893383d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37063 } } peers { permanent_uuid: "9b28c9cb4cb34090b683aebd99da66ed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43463 } } peers { permanent_uuid: "54a776854cd045ff80d6859a22d4083d" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33071 } }
I20260808 11:35:26.732527 11697 heartbeater.cc:503] Master 127.26.66.190:39703 was elected leader, sending a full tablet report...
I20260808 11:35:26.733049 11717 ts_tablet_manager.cc:1428] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260808 11:35:26.733194 11715 raft_consensus.cc:348] T b6434eddf2fd403882f5d02645b5cfa8 P 4d5e803b03d94123b85dcd17e893383d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d5e803b03d94123b85dcd17e893383d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37063 } } peers { permanent_uuid: "9b28c9cb4cb34090b683aebd99da66ed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43463 } } peers { permanent_uuid: "54a776854cd045ff80d6859a22d4083d" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33071 } }
I20260808 11:35:26.733656 11715 raft_consensus.cc:374] T b6434eddf2fd403882f5d02645b5cfa8 P 4d5e803b03d94123b85dcd17e893383d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:35:26.733791 11715 raft_consensus.cc:729] T b6434eddf2fd403882f5d02645b5cfa8 P 4d5e803b03d94123b85dcd17e893383d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d5e803b03d94123b85dcd17e893383d, State: Initialized, Role: FOLLOWER
I20260808 11:35:26.734367 11715 consensus_queue.cc:260] T b6434eddf2fd403882f5d02645b5cfa8 P 4d5e803b03d94123b85dcd17e893383d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d5e803b03d94123b85dcd17e893383d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37063 } } peers { permanent_uuid: "9b28c9cb4cb34090b683aebd99da66ed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43463 } } peers { permanent_uuid: "54a776854cd045ff80d6859a22d4083d" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33071 } }
I20260808 11:35:26.734624 11716 raft_consensus.cc:348] T b6434eddf2fd403882f5d02645b5cfa8 P 54a776854cd045ff80d6859a22d4083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d5e803b03d94123b85dcd17e893383d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37063 } } peers { permanent_uuid: "9b28c9cb4cb34090b683aebd99da66ed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43463 } } peers { permanent_uuid: "54a776854cd045ff80d6859a22d4083d" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33071 } }
I20260808 11:35:26.735047 11716 raft_consensus.cc:374] T b6434eddf2fd403882f5d02645b5cfa8 P 54a776854cd045ff80d6859a22d4083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:35:26.735159 11716 raft_consensus.cc:729] T b6434eddf2fd403882f5d02645b5cfa8 P 54a776854cd045ff80d6859a22d4083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54a776854cd045ff80d6859a22d4083d, State: Initialized, Role: FOLLOWER
I20260808 11:35:26.735711 11716 consensus_queue.cc:260] T b6434eddf2fd403882f5d02645b5cfa8 P 54a776854cd045ff80d6859a22d4083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d5e803b03d94123b85dcd17e893383d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37063 } } peers { permanent_uuid: "9b28c9cb4cb34090b683aebd99da66ed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43463 } } peers { permanent_uuid: "54a776854cd045ff80d6859a22d4083d" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33071 } }
I20260808 11:35:26.736191 11715 ts_tablet_manager.cc:1428] T b6434eddf2fd403882f5d02645b5cfa8 P 4d5e803b03d94123b85dcd17e893383d: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
I20260808 11:35:26.737401 11553 heartbeater.cc:503] Master 127.26.66.190:39703 was elected leader, sending a full tablet report...
I20260808 11:35:26.737875 11716 ts_tablet_manager.cc:1428] T b6434eddf2fd403882f5d02645b5cfa8 P 54a776854cd045ff80d6859a22d4083d: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
W20260808 11:35:26.840281 11698 tablet.cc:2369] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 11:35:26.853282 11554 tablet.cc:2369] T b6434eddf2fd403882f5d02645b5cfa8 P 54a776854cd045ff80d6859a22d4083d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 11:35:26.876453 11414 tablet.cc:2369] T b6434eddf2fd403882f5d02645b5cfa8 P 4d5e803b03d94123b85dcd17e893383d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:35:27.021281 11721 raft_consensus.cc:482] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:35:27.021605 11721 raft_consensus.cc:504] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d5e803b03d94123b85dcd17e893383d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37063 } } peers { permanent_uuid: "9b28c9cb4cb34090b683aebd99da66ed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43463 } } peers { permanent_uuid: "54a776854cd045ff80d6859a22d4083d" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33071 } }
I20260808 11:35:27.023315 11721 leader_election.cc:288] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d5e803b03d94123b85dcd17e893383d (127.26.66.129:37063), 54a776854cd045ff80d6859a22d4083d (127.26.66.130:33071)
I20260808 11:35:27.029659 11711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:27.023970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:37299 (local address 127.26.66.129:37063)
0808 11:35:27.024211 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:27.024218 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:27.024241 (+ 23us) server_negotiation.cc:407] Connection header received
0808 11:35:27.024428 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:27.024435 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:27.024523 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:27.024636 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:35:27.025130 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:27.025889 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:27.027987 (+ 2098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:27.028745 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:27.028940 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:27.029016 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:27.029285 (+ 269us) server_negotiation.cc:299] Negotiation successful
0808 11:35:27.029412 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 11:35:27.029681 11699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:27.023835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:37063 (local address 127.26.66.131:37299)
0808 11:35:27.024074 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:27.024100 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 11:35:27.024251 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:35:27.024655 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:35:27.024662 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:35:27.024694 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:35:27.024977 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:27.024990 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:27.026033 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:27.026038 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:27.027773 (+ 1735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:27.027788 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:27.028916 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:27.028922 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:27.029113 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:27.029138 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 11:35:27.029248 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 11:35:27.029391 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88,"mutex_wait_us":24}
I20260808 11:35:27.030802 11714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:27.024501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:55953 (local address 127.26.66.130:33071)
0808 11:35:27.024712 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:27.024718 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:27.025235 (+ 517us) server_negotiation.cc:407] Connection header received
0808 11:35:27.025426 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:27.025432 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:27.025503 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:27.025600 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:35:27.026225 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:27.026911 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:27.028859 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:27.029618 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:27.029814 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:27.029898 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:27.030523 (+ 625us) server_negotiation.cc:299] Negotiation successful
0808 11:35:27.030622 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 11:35:27.031081 11724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:27.024350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:33071 (local address 127.26.66.131:55953)
0808 11:35:27.025138 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:27.025152 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 11:35:27.025291 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:35:27.025618 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:35:27.025622 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:35:27.025647 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:35:27.026046 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:27.026057 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:27.027054 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:27.027059 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:27.028692 (+ 1633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:35:27.028704 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:35:27.030161 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:35:27.030165 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:35:27.030345 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:27.030387 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 11:35:27.030495 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 11:35:27.030626 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"mutex_wait_us":1,"thread_start_us":511,"threads_started":1}
I20260808 11:35:27.030834 11365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6434eddf2fd403882f5d02645b5cfa8" candidate_uuid: "9b28c9cb4cb34090b683aebd99da66ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5e803b03d94123b85dcd17e893383d" is_pre_election: true
I20260808 11:35:27.031492 11365 raft_consensus.cc:2454] T b6434eddf2fd403882f5d02645b5cfa8 P 4d5e803b03d94123b85dcd17e893383d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b28c9cb4cb34090b683aebd99da66ed in term 0.
I20260808 11:35:27.032274 11576 leader_election.cc:302] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d5e803b03d94123b85dcd17e893383d, 9b28c9cb4cb34090b683aebd99da66ed; no voters:
I20260808 11:35:27.032195 11508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6434eddf2fd403882f5d02645b5cfa8" candidate_uuid: "9b28c9cb4cb34090b683aebd99da66ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54a776854cd045ff80d6859a22d4083d" is_pre_election: true
I20260808 11:35:27.032696 11721 raft_consensus.cc:2781] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:35:27.032862 11721 raft_consensus.cc:482] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:35:27.032768 11508 raft_consensus.cc:2454] T b6434eddf2fd403882f5d02645b5cfa8 P 54a776854cd045ff80d6859a22d4083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b28c9cb4cb34090b683aebd99da66ed in term 0.
I20260808 11:35:27.032971 11721 raft_consensus.cc:3037] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:35:27.035321 11721 raft_consensus.cc:504] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d5e803b03d94123b85dcd17e893383d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37063 } } peers { permanent_uuid: "9b28c9cb4cb34090b683aebd99da66ed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43463 } } peers { permanent_uuid: "54a776854cd045ff80d6859a22d4083d" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33071 } }
I20260808 11:35:27.035969 11721 leader_election.cc:288] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed [CANDIDATE]: Term 1 election: Requested vote from peers 4d5e803b03d94123b85dcd17e893383d (127.26.66.129:37063), 54a776854cd045ff80d6859a22d4083d (127.26.66.130:33071)
I20260808 11:35:27.036401 11365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6434eddf2fd403882f5d02645b5cfa8" candidate_uuid: "9b28c9cb4cb34090b683aebd99da66ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5e803b03d94123b85dcd17e893383d"
I20260808 11:35:27.036484 11508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6434eddf2fd403882f5d02645b5cfa8" candidate_uuid: "9b28c9cb4cb34090b683aebd99da66ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54a776854cd045ff80d6859a22d4083d"
I20260808 11:35:27.036608 11365 raft_consensus.cc:3037] T b6434eddf2fd403882f5d02645b5cfa8 P 4d5e803b03d94123b85dcd17e893383d [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:35:27.036707 11508 raft_consensus.cc:3037] T b6434eddf2fd403882f5d02645b5cfa8 P 54a776854cd045ff80d6859a22d4083d [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:35:27.038848 11365 raft_consensus.cc:2454] T b6434eddf2fd403882f5d02645b5cfa8 P 4d5e803b03d94123b85dcd17e893383d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b28c9cb4cb34090b683aebd99da66ed in term 1.
I20260808 11:35:27.038931 11508 raft_consensus.cc:2454] T b6434eddf2fd403882f5d02645b5cfa8 P 54a776854cd045ff80d6859a22d4083d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b28c9cb4cb34090b683aebd99da66ed in term 1.
I20260808 11:35:27.039235 11576 leader_election.cc:302] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d5e803b03d94123b85dcd17e893383d, 9b28c9cb4cb34090b683aebd99da66ed; no voters:
I20260808 11:35:27.039541 11721 raft_consensus.cc:2781] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:35:27.040098 11721 raft_consensus.cc:686] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed [term 1 LEADER]: Becoming Leader. State: Replica: 9b28c9cb4cb34090b683aebd99da66ed, State: Running, Role: LEADER
I20260808 11:35:27.040676 11721 consensus_queue.cc:237] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d5e803b03d94123b85dcd17e893383d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37063 } } peers { permanent_uuid: "9b28c9cb4cb34090b683aebd99da66ed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43463 } } peers { permanent_uuid: "54a776854cd045ff80d6859a22d4083d" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33071 } }
I20260808 11:35:27.045421 11213 catalog_manager.cc:5495] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b28c9cb4cb34090b683aebd99da66ed (127.26.66.131). New cstate: current_term: 1 leader_uuid: "9b28c9cb4cb34090b683aebd99da66ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d5e803b03d94123b85dcd17e893383d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b28c9cb4cb34090b683aebd99da66ed" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54a776854cd045ff80d6859a22d4083d" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33071 } health_report { overall_health: UNKNOWN } } }
I20260808 11:35:27.062104 11712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:27.057023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59844 (local address 127.26.66.131:43463)
0808 11:35:27.057284 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:27.057288 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:27.057306 (+ 18us) server_negotiation.cc:407] Connection header received
0808 11:35:27.057476 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:27.057480 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:27.057552 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:27.057670 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:35:27.057986 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:27.058780 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:27.060181 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:27.060555 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:27.060646 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:27.061115 (+ 469us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:35:27.061569 (+ 454us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:35:27.061672 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:27.061754 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 11:35:27.061813 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 11:35:27.070004 11508 raft_consensus.cc:1261] T b6434eddf2fd403882f5d02645b5cfa8 P 54a776854cd045ff80d6859a22d4083d [term 1 FOLLOWER]: Refusing update from remote peer 9b28c9cb4cb34090b683aebd99da66ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:35:27.070003 11365 raft_consensus.cc:1261] T b6434eddf2fd403882f5d02645b5cfa8 P 4d5e803b03d94123b85dcd17e893383d [term 1 FOLLOWER]: Refusing update from remote peer 9b28c9cb4cb34090b683aebd99da66ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:35:27.070977 11725 consensus_queue.cc:1035] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "54a776854cd045ff80d6859a22d4083d" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:35:27.071360 11721 consensus_queue.cc:1035] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d5e803b03d94123b85dcd17e893383d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 37063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:35:27.101809 11213 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51448:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:35:27.102161 11213 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51448:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:35:27.105835 11213 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7: Sending DeleteTablet for 3 replicas of tablet b6434eddf2fd403882f5d02645b5cfa8
I20260808 11:35:27.107090 11627 tablet_service.cc:1514] Processing DeleteTablet for tablet b6434eddf2fd403882f5d02645b5cfa8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:35:27 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:59834
I20260808 11:35:27.107219 11344 tablet_service.cc:1514] Processing DeleteTablet for tablet b6434eddf2fd403882f5d02645b5cfa8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:35:27 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:32924
I20260808 11:35:27.107421 11487 tablet_service.cc:1514] Processing DeleteTablet for tablet b6434eddf2fd403882f5d02645b5cfa8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:35:27 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:50970
I20260808 11:35:27.108942 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 11253
I20260808 11:35:27.123462 11741 tablet_replica.cc:330] T b6434eddf2fd403882f5d02645b5cfa8 P 4d5e803b03d94123b85dcd17e893383d: stopping tablet replica
I20260808 11:35:27.123931 11741 raft_consensus.cc:2229] T b6434eddf2fd403882f5d02645b5cfa8 P 4d5e803b03d94123b85dcd17e893383d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:35:27.124470 11741 raft_consensus.cc:2258] T b6434eddf2fd403882f5d02645b5cfa8 P 4d5e803b03d94123b85dcd17e893383d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:35:27.132341 11741 ts_tablet_manager.cc:1905] T b6434eddf2fd403882f5d02645b5cfa8 P 4d5e803b03d94123b85dcd17e893383d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:35:27.135301 11739 tablet_replica.cc:330] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed: stopping tablet replica
I20260808 11:35:27.135776 11739 raft_consensus.cc:2229] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed [term 1 LEADER]: Raft consensus shutting down.
I20260808 11:35:27.136518 11739 raft_consensus.cc:2258] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:35:27.140221 11711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:27.110471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32936 (local address 127.26.66.129:37063)
0808 11:35:27.110695 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:27.110704 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:27.110726 (+ 22us) server_negotiation.cc:407] Connection header received
0808 11:35:27.110800 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:27.110808 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:27.110906 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:27.111023 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:35:27.113542 (+ 2519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:27.115103 (+ 1561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:27.117846 (+ 2743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:27.118815 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:27.118970 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:27.129321 (+ 10351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:35:27.129338 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:35:27.129361 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:35:27.129418 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:35:27.134818 (+ 5400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:27.135795 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:27.135807 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:27.135824 (+ 17us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:27.136177 (+ 353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:27.136889 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:27.136898 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:27.136904 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:27.137446 (+ 542us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:35:27.137829 (+ 383us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:27.139433 (+ 1604us) server_negotiation.cc:299] Negotiation successful
0808 11:35:27.139766 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 11:35:27.141214 11742 tablet_replica.cc:330] T b6434eddf2fd403882f5d02645b5cfa8 P 54a776854cd045ff80d6859a22d4083d: stopping tablet replica
I20260808 11:35:27.141292 11408 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:35:27.141744 11742 raft_consensus.cc:2229] T b6434eddf2fd403882f5d02645b5cfa8 P 54a776854cd045ff80d6859a22d4083d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:35:27.142346 11742 raft_consensus.cc:2258] T b6434eddf2fd403882f5d02645b5cfa8 P 54a776854cd045ff80d6859a22d4083d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:35:27.142379 11739 ts_tablet_manager.cc:1905] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:35:27.144941 11742 ts_tablet_manager.cc:1905] T b6434eddf2fd403882f5d02645b5cfa8 P 54a776854cd045ff80d6859a22d4083d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:35:27.155077 11742 ts_tablet_manager.cc:1918] T b6434eddf2fd403882f5d02645b5cfa8 P 54a776854cd045ff80d6859a22d4083d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:35:27.155269 11742 log.cc:1196] T b6434eddf2fd403882f5d02645b5cfa8 P 54a776854cd045ff80d6859a22d4083d: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/wal/wals/b6434eddf2fd403882f5d02645b5cfa8
I20260808 11:35:27.155917 11739 ts_tablet_manager.cc:1918] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:35:27.156095 11739 log.cc:1196] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/wal/wals/b6434eddf2fd403882f5d02645b5cfa8
I20260808 11:35:27.156114 11742 ts_tablet_manager.cc:1939] T b6434eddf2fd403882f5d02645b5cfa8 P 54a776854cd045ff80d6859a22d4083d: Deleting consensus metadata
I20260808 11:35:27.156778 11739 ts_tablet_manager.cc:1939] T b6434eddf2fd403882f5d02645b5cfa8 P 9b28c9cb4cb34090b683aebd99da66ed: Deleting consensus metadata
I20260808 11:35:27.158777 11200 catalog_manager.cc:4841] TS 9b28c9cb4cb34090b683aebd99da66ed (127.26.66.131:43463): tablet b6434eddf2fd403882f5d02645b5cfa8 (table test-table [id=78da76d2747b4ea8bb5e5b7be06c5bd2]) successfully deleted
I20260808 11:35:27.158854 11198 catalog_manager.cc:4841] TS 54a776854cd045ff80d6859a22d4083d (127.26.66.130:33071): tablet b6434eddf2fd403882f5d02645b5cfa8 (table test-table [id=78da76d2747b4ea8bb5e5b7be06c5bd2]) successfully deleted
I20260808 11:35:27.250021 11741 ts_tablet_manager.cc:1918] T b6434eddf2fd403882f5d02645b5cfa8 P 4d5e803b03d94123b85dcd17e893383d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:35:27.250253 11741 log.cc:1196] T b6434eddf2fd403882f5d02645b5cfa8 P 4d5e803b03d94123b85dcd17e893383d: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/wal/wals/b6434eddf2fd403882f5d02645b5cfa8
I20260808 11:35:27.250746 11741 ts_tablet_manager.cc:1939] T b6434eddf2fd403882f5d02645b5cfa8 P 4d5e803b03d94123b85dcd17e893383d: Deleting consensus metadata
I20260808 11:35:27.252543 11198 catalog_manager.cc:4841] TS 4d5e803b03d94123b85dcd17e893383d (127.26.66.129:37063): tablet b6434eddf2fd403882f5d02645b5cfa8 (table test-table [id=78da76d2747b4ea8bb5e5b7be06c5bd2]) successfully deleted
I20260808 11:35:27.252874 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 11253
I20260808 11:35:27.274819 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 11418
I20260808 11:35:27.291081 11714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:27.275779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50982 (local address 127.26.66.130:33071)
0808 11:35:27.276015 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:27.276020 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:27.276041 (+ 21us) server_negotiation.cc:407] Connection header received
0808 11:35:27.276165 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:27.276169 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:27.276255 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:27.276349 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:35:27.278125 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:27.278866 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:27.280961 (+ 2095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:27.281368 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:27.281469 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:27.284989 (+ 3520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:35:27.285005 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:35:27.285019 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:35:27.285053 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:35:27.288124 (+ 3071us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:27.289012 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:27.289020 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:27.289022 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:27.289161 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:27.289630 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:27.289633 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:27.289635 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:27.290009 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:35:27.290229 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:27.290604 (+ 375us) server_negotiation.cc:299] Negotiation successful
0808 11:35:27.290767 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260808 11:35:27.291767 11548 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:35:27.383492 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 11418
I20260808 11:35:27.406059 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 11557
I20260808 11:35:27.423111 11712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:27.406946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59846 (local address 127.26.66.131:43463)
0808 11:35:27.407132 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 11:35:27.407137 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:35:27.407211 (+ 74us) server_negotiation.cc:407] Connection header received
0808 11:35:27.407434 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:35:27.407439 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:35:27.407519 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:35:27.407598 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:35:27.409640 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:27.410447 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:27.412442 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:35:27.412894 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:35:27.412990 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:35:27.416587 (+ 3597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:35:27.416603 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:35:27.416640 (+ 37us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:35:27.416693 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:35:27.419971 (+ 3278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:27.420837 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:27.420844 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:27.420849 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:27.421002 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:35:27.421490 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:35:27.421493 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:35:27.421495 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:35:27.421849 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:35:27.422097 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0808 11:35:27.422542 (+ 445us) server_negotiation.cc:299] Negotiation successful
0808 11:35:27.422719 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 11:35:27.423818 11692 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:35:27.551527 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 11557
I20260808 11:35:27.578054 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 11178
I20260808 11:35:27.579280 11243 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:35:27.695554 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 11178
I20260808 11:35:47.724433 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:39703
--webserver_interface=127.26.66.190
--webserver_port=45347
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:39703
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:35:48.074111 11748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:35:48.074451 11748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:35:48.074620 11748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:35:48.081645 11748 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 11:35:48.081789 11748 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 11:35:48.081902 11748 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 11:35:48.082010 11748 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:35:48.082114 11748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:35:48.082216 11748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:35:48.082302 11748 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:35:48.082384 11748 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:35:48.091882 11748 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:39703
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:39703
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=45347
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:35:48.093129 11748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:35:48.094496 11748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:35:48.106693 11754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:35:48.106775 11758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:35:48.106799 11755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:35:48.106982 11748 server_base.cc:1034] running on GCE node
I20260808 11:35:48.107983 11748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:35:48.109331 11748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:35:48.110579 11748 hybrid_clock.cc:648] HybridClock initialized: now 1786188948110509 us; error 45 us; skew 500 ppm
I20260808 11:35:48.110929 11748 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:35:48 dist-test-slave-zkpd krb5kdc[10587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188948, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:35:48.114065 11748 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:35:48.115420 11748 webserver.cc:460] Webserver started at http://127.26.66.190:45347/ using document root <none> and password file <none>
I20260808 11:35:48.116218 11748 fs_manager.cc:359] Metadata directory not provided
I20260808 11:35:48.116353 11748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:35:48.121651 11748 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 11:35:48.124508 11765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:48.125710 11748 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:35:48.125931 11748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "c72822eafd9b4cd5b79d03020b7e43e7"
format_stamp: "Formatted at 2026-08-08 11:35:01 on dist-test-slave-zkpd"
server_key: "e11557d954707e98aab5e0497c87fd34"
server_key_iv: "22fd1b0ad2cd156079d8a520dcf00908"
server_key_version: "encryptionkey@0"
I20260808 11:35:48.126856 11748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:35:48.142832 11748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:35:48.147140 11748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:35:48.147462 11748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:35:48.166509 11748 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:39703
I20260808 11:35:48.166543 11819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:39703 every 8 connection(s)
I20260808 11:35:48.168092 11748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:35:48.169459 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 11748
I20260808 11:35:48.170387 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:37063
--local_ip_for_outbound_sockets=127.26.66.129
--tserver_master_addrs=127.26.66.190:39703
--webserver_port=43587
--webserver_interface=127.26.66.129
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 11:35:48.175697 11821 sys_catalog.cc:263] Verifying existing consensus state
I20260808 11:35:48.179188 11821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7: Bootstrap starting.
I20260808 11:35:48.202057 11821 log.cc:824] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7: Log is configured to *not* fsync() on all Append() calls
I20260808 11:35:48.219718 11821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 11:35:48.220366 11821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7: Bootstrap complete.
I20260808 11:35:48.230719 11821 raft_consensus.cc:348] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c72822eafd9b4cd5b79d03020b7e43e7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 39703 } }
I20260808 11:35:48.231961 11821 raft_consensus.cc:729] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: c72822eafd9b4cd5b79d03020b7e43e7, State: Initialized, Role: FOLLOWER
I20260808 11:35:48.232604 11821 consensus_queue.cc:260] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c72822eafd9b4cd5b79d03020b7e43e7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 39703 } }
I20260808 11:35:48.232897 11821 raft_consensus.cc:388] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:35:48.233034 11821 raft_consensus.cc:482] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:35:48.233249 11821 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [term 2 FOLLOWER]: Advancing to term 3
I20260808 11:35:48.237489 11821 raft_consensus.cc:504] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c72822eafd9b4cd5b79d03020b7e43e7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 39703 } }
I20260808 11:35:48.238013 11821 leader_election.cc:302] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c72822eafd9b4cd5b79d03020b7e43e7; no voters:
I20260808 11:35:48.238773 11821 leader_election.cc:288] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 11:35:48.238936 11825 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 11:35:48.240288 11825 raft_consensus.cc:686] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [term 3 LEADER]: Becoming Leader. State: Replica: c72822eafd9b4cd5b79d03020b7e43e7, State: Running, Role: LEADER
I20260808 11:35:48.241034 11825 consensus_queue.cc:237] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c72822eafd9b4cd5b79d03020b7e43e7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 39703 } }
I20260808 11:35:48.241416 11821 sys_catalog.cc:564] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:35:48.243825 11826 sys_catalog.cc:455] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "c72822eafd9b4cd5b79d03020b7e43e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c72822eafd9b4cd5b79d03020b7e43e7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 39703 } } }
I20260808 11:35:48.244191 11826 sys_catalog.cc:458] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [sys.catalog]: This master's current role is: LEADER
I20260808 11:35:48.244691 11827 sys_catalog.cc:455] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c72822eafd9b4cd5b79d03020b7e43e7. Latest consensus state: current_term: 3 leader_uuid: "c72822eafd9b4cd5b79d03020b7e43e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c72822eafd9b4cd5b79d03020b7e43e7" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 39703 } } }
I20260808 11:35:48.245136 11827 sys_catalog.cc:458] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7 [sys.catalog]: This master's current role is: LEADER
I20260808 11:35:48.245440 11830 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:35:48.264117 11830 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:35:48.266279 11830 catalog_manager.cc:1259] Loaded cluster ID: f38a225543774e84bd9634d9126d0675
I20260808 11:35:48.266515 11830 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:35:48.272115 11830 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:35:48.274442 11830 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7: Loaded TSK: 0
I20260808 11:35:48.274736 11830 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c72822eafd9b4cd5b79d03020b7e43e7: Loaded TSK: 1
F20260808 11:35:48.276155 11830 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f31676e79ad google::LogMessage::Fail() at ??:0
@ 0x7f31676ea88a google::LogMessage::SendToLog() at ??:0
@ 0x7f31676e74de google::LogMessage::Flush() at ??:0
@ 0x7f31676e8a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f316b44b7d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f316b43a73e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f317d1161c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f317d115783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f317d1a12a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f317d1a10c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f317d1eb5e9 std::function<>::operator()() at ??:0
@ 0x7f317d119cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
I20260808 11:35:48.337325 11846 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7f317d117c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f317d19f610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f317d19f439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f316a333345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f316a33691c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f316a336799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f316a311eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f316d5eb6db start_thread at ??:0
@ 0x7f316658161f clone at ??:0
W20260808 11:35:48.580260 11823 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:35:48.580578 11823 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:35:48.580762 11823 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:35:48.588332 11823 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:35:48.588493 11823 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:35:48.588670 11823 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:35:48.598517 11823 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:37063
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=43587
--tserver_master_addrs=127.26.66.190:39703
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:35:48.599821 11823 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:35:48.601212 11823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:35:48.614414 11881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:35:48.614574 11877 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:35:48.614506 11879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:35:48.615680 11823 server_base.cc:1034] running on GCE node
I20260808 11:35:48.616544 11823 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:35:48.617661 11823 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:35:48.618882 11823 hybrid_clock.cc:648] HybridClock initialized: now 1786188948618825 us; error 45 us; skew 500 ppm
I20260808 11:35:48.619225 11823 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:35:48 dist-test-slave-zkpd krb5kdc[10587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188948, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:35:48.622452 11823 init.cc:377] Logged in from keytab as kudu/127.26.66.129@KRBTEST.COM (short username kudu)
I20260808 11:35:48.624104 11823 webserver.cc:460] Webserver started at http://127.26.66.129:43587/ using document root <none> and password file <none>
I20260808 11:35:48.624801 11823 fs_manager.cc:359] Metadata directory not provided
I20260808 11:35:48.624934 11823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:35:48.630264 11823 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.003s
I20260808 11:35:48.632939 11888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:48.634275 11823 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 11:35:48.634435 11823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "4d5e803b03d94123b85dcd17e893383d"
format_stamp: "Formatted at 2026-08-08 11:35:02 on dist-test-slave-zkpd"
server_key: "638ba969979c10723b9aa38758212d12"
server_key_iv: "20e0e2b5e5253a959a0523baa6401239"
server_key_version: "encryptionkey@0"
I20260808 11:35:48.635408 11823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:35:48.655854 11823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:35:48.659826 11823 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:35:48.660108 11823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:35:48.661093 11823 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:35:48.662441 11823 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:35:48.662564 11823 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:48.662696 11823 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:35:48.662811 11823 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:48.698048 11823 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:37063
I20260808 11:35:48.698135 12006 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:37063 every 8 connection(s)
I20260808 11:35:48.699522 11823 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:35:48.704355 12009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:48.702449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.129:44001)
0808 11:35:48.703177 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:48.703391 (+ 214us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":281,"threads_started":1}
W20260808 11:35:48.704962 12007 heartbeater.cc:644] Failed to heartbeat to 127.26.66.190:39703 (0 consecutive failures): Network error: Failed to ping master at 127.26.66.190:39703: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
I20260808 11:35:48.705838 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 11823
I20260808 11:35:48.705889 12009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:48.705461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.129:35595)
0808 11:35:48.705637 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:48.705739 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 11:35:48.706634 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:33071
--local_ip_for_outbound_sockets=127.26.66.130
--tserver_master_addrs=127.26.66.190:39703
--webserver_port=34945
--webserver_interface=127.26.66.130
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 11:35:48.706800 12009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:48.706410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.129:54425)
0808 11:35:48.706564 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:48.706658 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 11:35:48.707095 12007 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 11:35:49.057492 12010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:35:49.057768 12010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:35:49.057928 12010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:35:49.065106 12010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:35:49.065231 12010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:35:49.065421 12010 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:35:49.074878 12010 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:33071
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=34945
--tserver_master_addrs=127.26.66.190:39703
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:35:49.076285 12010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:35:49.077606 12010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:35:49.091276 12016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:35:49.091306 12019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:35:49.091465 12017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:35:49.092489 12010 server_base.cc:1034] running on GCE node
I20260808 11:35:49.093104 12010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:35:49.094079 12010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:35:49.095330 12010 hybrid_clock.cc:648] HybridClock initialized: now 1786188949095284 us; error 60 us; skew 500 ppm
I20260808 11:35:49.095670 12010 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:35:49 dist-test-slave-zkpd krb5kdc[10587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188949, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:35:49.099435 12010 init.cc:377] Logged in from keytab as kudu/127.26.66.130@KRBTEST.COM (short username kudu)
I20260808 11:35:49.101078 12010 webserver.cc:460] Webserver started at http://127.26.66.130:34945/ using document root <none> and password file <none>
I20260808 11:35:49.101893 12010 fs_manager.cc:359] Metadata directory not provided
I20260808 11:35:49.102062 12010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:35:49.107982 12010 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 11:35:49.110857 12026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:49.112293 12010 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 11:35:49.112481 12010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "54a776854cd045ff80d6859a22d4083d"
format_stamp: "Formatted at 2026-08-08 11:35:03 on dist-test-slave-zkpd"
server_key: "cdd45583f63efcb50bc16616617360a2"
server_key_iv: "e41b4197d7ac594b7725f02fb957a5a1"
server_key_version: "encryptionkey@0"
I20260808 11:35:49.113550 12010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:35:49.129838 12010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:35:49.134688 12010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:35:49.134991 12010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:35:49.136088 12010 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:35:49.137503 12010 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:35:49.137647 12010 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:49.137781 12010 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:35:49.137882 12010 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:49.175680 12010 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:33071
I20260808 11:35:49.175782 12146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:33071 every 8 connection(s)
I20260808 11:35:49.177255 12010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:35:49.179315 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 12010
I20260808 11:35:49.180166 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:43463
--local_ip_for_outbound_sockets=127.26.66.131
--tserver_master_addrs=127.26.66.190:39703
--webserver_port=33629
--webserver_interface=127.26.66.131
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:38123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 11:35:49.182883 12150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:49.180785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.130:49467)
0808 11:35:49.181666 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:49.181944 (+ 278us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":393,"threads_started":1}
W20260808 11:35:49.183638 12147 heartbeater.cc:644] Failed to heartbeat to 127.26.66.190:39703 (0 consecutive failures): Network error: Failed to ping master at 127.26.66.190:39703: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
I20260808 11:35:49.184652 12150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:49.184235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.130:45437)
0808 11:35:49.184421 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:49.184509 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 11:35:49.185714 12150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:49.185315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.130:45983)
0808 11:35:49.185476 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:49.185566 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 11:35:49.186020 12147 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 11:35:49.537973 12151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:35:49.538280 12151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:35:49.538455 12151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:35:49.545751 12151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:35:49.545866 12151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:35:49.546099 12151 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:35:49.555954 12151 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:38123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:43463
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=33629
--tserver_master_addrs=127.26.66.190:39703
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:35:49.557324 12151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:35:49.558624 12151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:35:49.571735 12156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:35:49.571686 12159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:35:49.571691 12157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:35:49.572991 12151 server_base.cc:1034] running on GCE node
I20260808 11:35:49.573649 12151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:35:49.574618 12151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:35:49.575874 12151 hybrid_clock.cc:648] HybridClock initialized: now 1786188949575804 us; error 62 us; skew 500 ppm
I20260808 11:35:49.576248 12151 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:35:49 dist-test-slave-zkpd krb5kdc[10587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188949, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:35:49.579337 12151 init.cc:377] Logged in from keytab as kudu/127.26.66.131@KRBTEST.COM (short username kudu)
I20260808 11:35:49.580821 12151 webserver.cc:460] Webserver started at http://127.26.66.131:33629/ using document root <none> and password file <none>
I20260808 11:35:49.581452 12151 fs_manager.cc:359] Metadata directory not provided
I20260808 11:35:49.581554 12151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:35:49.586971 12151 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.005s
I20260808 11:35:49.589740 12167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:49.591236 12151 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 11:35:49.591394 12151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "9b28c9cb4cb34090b683aebd99da66ed"
format_stamp: "Formatted at 2026-08-08 11:35:03 on dist-test-slave-zkpd"
server_key: "0760314f8b097bf1e438edb13013aa36"
server_key_iv: "edca641c20345fa5f9f04924a76ec4e3"
server_key_version: "encryptionkey@0"
I20260808 11:35:49.592557 12151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:35:49.610788 12151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:35:49.614719 12151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:35:49.614943 12151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:35:49.615863 12151 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:35:49.617192 12151 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:35:49.617290 12151 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:49.617373 12151 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:35:49.617427 12151 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:35:49.652052 12151 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:43463
I20260808 11:35:49.652148 12290 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:43463 every 8 connection(s)
I20260808 11:35:49.653517 12151 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:35:49.654862 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 12151
I20260808 11:35:49.658865 12294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:49.657071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.131:47593)
0808 11:35:49.657771 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:49.658023 (+ 252us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":273,"threads_started":1}
W20260808 11:35:49.659590 12291 heartbeater.cc:644] Failed to heartbeat to 127.26.66.190:39703 (0 consecutive failures): Network error: Failed to ping master at 127.26.66.190:39703: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
I20260808 11:35:49.660395 12294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:49.660098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.131:37855)
0808 11:35:49.660221 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:49.660289 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 11:35:49.661353 12294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:49.661068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.131:34043)
0808 11:35:49.661181 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:49.661251 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 11:35:49.661615 12291 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 11:35:49.708508 12295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:49.707661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.129:48557)
0808 11:35:49.708177 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:49.708286 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":279,"threads_started":1}
I20260808 11:35:50.187340 12296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:50.186544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.130:53811)
0808 11:35:50.187003 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:50.187106 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":235,"threads_started":1}
I20260808 11:35:50.662916 12297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:50.662129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.131:45983)
0808 11:35:50.662571 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:50.662685 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":220,"threads_started":1}
I20260808 11:35:50.710083 12298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:50.709344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.129:36381)
0808 11:35:50.709824 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:50.709911 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":232,"threads_started":1}
I20260808 11:35:51.189118 12299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:51.188378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.130:53779)
0808 11:35:51.188853 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:51.188936 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":243,"threads_started":1}
I20260808 11:35:51.664625 12300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:51.663835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.131:47681)
0808 11:35:51.664373 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:51.664456 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":304,"threads_started":1}
I20260808 11:35:51.711838 12301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:51.710961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.129:46655)
0808 11:35:51.711492 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:51.711599 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":249,"threads_started":1}
I20260808 11:35:52.190697 12302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:52.190022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.130:53055)
0808 11:35:52.190440 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:52.190521 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":224,"threads_started":1}
I20260808 11:35:52.666193 12303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:52.665458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.131:47461)
0808 11:35:52.665935 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:52.666014 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":278,"threads_started":1}
I20260808 11:35:52.713454 12304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:52.712721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.129:46217)
0808 11:35:52.713178 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:52.713267 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":245,"threads_started":1}
I20260808 11:35:53.192337 12305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:53.191536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.130:48811)
0808 11:35:53.192039 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:53.192127 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":228,"threads_started":1}
I20260808 11:35:53.667870 12306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:53.667072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.131:54683)
0808 11:35:53.667573 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:53.667657 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":252,"threads_started":1}
I20260808 11:35:53.715186 12307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:53.714418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.129:40075)
0808 11:35:53.714931 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:53.715014 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":285,"threads_started":1}
I20260808 11:35:54.194213 12308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:54.193335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.130:56441)
0808 11:35:54.193952 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:54.194035 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":341,"threads_started":1}
I20260808 11:35:54.669745 12309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:54.668888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.131:56041)
0808 11:35:54.669473 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:54.669562 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":313,"threads_started":1}
I20260808 11:35:54.716907 12310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:54.716127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.129:49435)
0808 11:35:54.716564 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:54.716654 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":221,"threads_started":1}
I20260808 11:35:55.195922 12311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:55.195146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.130:40755)
0808 11:35:55.195605 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:55.195698 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":243,"threads_started":1}
I20260808 11:35:55.671458 12312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:55.670732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.131:47991)
0808 11:35:55.671186 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:55.671296 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":236,"threads_started":1}
I20260808 11:35:55.718880 12313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:55.718000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.129:49481)
0808 11:35:55.718526 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:55.718614 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":228,"threads_started":1}
I20260808 11:35:56.197715 12314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:56.196877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.130:48763)
0808 11:35:56.197407 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:56.197489 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":268,"threads_started":1}
I20260808 11:35:56.673274 12315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:56.672448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.131:55437)
0808 11:35:56.672948 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:56.673037 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":235,"threads_started":1}
I20260808 11:35:56.720620 12316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:56.719850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.129:53699)
0808 11:35:56.720358 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:56.720446 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":285,"threads_started":1}
I20260808 11:35:57.199441 12317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:57.198696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.130:55897)
0808 11:35:57.199158 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:57.199247 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":238,"threads_started":1}
I20260808 11:35:57.675098 12318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:57.674288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.131:36007)
0808 11:35:57.674822 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:57.674923 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":243,"threads_started":1}
I20260808 11:35:57.722402 12319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:57.721620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.129:35251)
0808 11:35:57.722114 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:57.722221 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":232,"threads_started":1}
I20260808 11:35:58.201368 12320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:58.200556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.130:40325)
0808 11:35:58.201089 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:58.201179 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":269,"threads_started":1}
I20260808 11:35:58.676964 12321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:58.676154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.131:50717)
0808 11:35:58.676691 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:58.676777 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":270,"threads_started":1}
I20260808 11:35:58.724160 12322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:58.723386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.129:33653)
0808 11:35:58.723846 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:58.723991 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":260,"threads_started":1}
I20260808 11:35:59.203102 12323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:59.202364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.130:57409)
0808 11:35:59.202843 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:59.202927 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":247,"threads_started":1}
I20260808 11:35:59.678594 12324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:59.677913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.131:52427)
0808 11:35:59.678353 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:59.678434 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":237,"threads_started":1}
I20260808 11:35:59.725823 12325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:35:59.725086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.129:53265)
0808 11:35:59.725541 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0808 11:35:59.725635 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":224,"threads_started":1}
I20260808 11:36:00.205088 12326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:00.204238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.130:39907)
0808 11:36:00.204780 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:00.204892 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":268,"threads_started":1}
I20260808 11:36:00.680354 12327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:00.679538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.131:34035)
0808 11:36:00.680067 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:00.680168 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":254,"threads_started":1}
I20260808 11:36:00.727665 12328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:00.726927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.129:45273)
0808 11:36:00.727391 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:00.727486 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":237,"threads_started":1}
I20260808 11:36:01.206832 12329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:01.206081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.130:50723)
0808 11:36:01.206572 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:01.206662 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":255,"threads_started":1}
I20260808 11:36:01.682054 12330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:01.681285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.131:59999)
0808 11:36:01.681811 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:01.681895 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":233,"threads_started":1}
I20260808 11:36:01.729624 12331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:01.728814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.129:44171)
0808 11:36:01.729311 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:01.729412 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":241,"threads_started":1}
I20260808 11:36:02.208669 12332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:02.207821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.130:45873)
0808 11:36:02.208380 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:02.208476 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":325,"threads_started":1}
I20260808 11:36:02.683738 12334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:02.682937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.131:35043)
0808 11:36:02.683443 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:02.683539 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":265,"threads_started":1}
I20260808 11:36:02.731223 12336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:02.730500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.129:36487)
0808 11:36:02.730956 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:02.731039 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":243,"threads_started":1}
I20260808 11:36:03.210507 12337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:03.209744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.130:36217)
0808 11:36:03.210207 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:03.210291 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":247,"threads_started":1}
I20260808 11:36:03.685405 12338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:03.684661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.131:34149)
0808 11:36:03.685132 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:03.685212 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":253,"threads_started":1}
I20260808 11:36:03.733191 12339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:03.732428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.129:46193)
0808 11:36:03.732911 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:03.733002 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":275,"threads_started":1}
I20260808 11:36:04.212430 12340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:04.211594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.130:50983)
0808 11:36:04.212147 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:04.212241 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":333,"threads_started":1}
I20260808 11:36:04.656493 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 11823
I20260808 11:36:04.679683 12341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:04.657700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47498 (local address 127.26.66.129:37063)
0808 11:36:04.658253 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:04.658272 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:04.658330 (+ 58us) server_negotiation.cc:407] Connection header received
0808 11:36:04.660115 (+ 1785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:04.660125 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:04.660574 (+ 449us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:04.660884 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:04.662349 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:04.663604 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:04.665000 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:04.665685 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:04.665839 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:04.673305 (+ 7466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:04.673313 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:04.673330 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:04.673370 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:04.676475 (+ 3105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:04.677193 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:04.677199 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:04.677206 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:04.677384 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:04.677730 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:04.677733 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:04.677735 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:04.678282 (+ 547us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:04.678520 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:04.678949 (+ 429us) server_negotiation.cc:299] Negotiation successful
0808 11:36:04.679391 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":263,"threads_started":1}
I20260808 11:36:04.681192 12002 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:04.687372 12343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:04.686512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:39703 (local address 127.26.66.131:35191)
0808 11:36:04.687008 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:04.687120 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.190:39703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":231,"threads_started":1}
I20260808 11:36:04.767966 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 11823
I20260808 11:36:04.791237 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 12010
I20260808 11:36:04.809273 12345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:04.792263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40916 (local address 127.26.66.130:33071)
0808 11:36:04.792817 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:04.792832 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:04.792873 (+ 41us) server_negotiation.cc:407] Connection header received
0808 11:36:04.794536 (+ 1663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:04.794545 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:04.794972 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:04.795271 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:04.796687 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:04.798166 (+ 1479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:04.799399 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:04.800176 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:04.800324 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:04.802912 (+ 2588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:04.802920 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:04.802933 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:04.802969 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:04.806155 (+ 3186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:04.806830 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:04.806836 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:04.806843 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:04.807006 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:04.807334 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:04.807337 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:04.807340 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:04.807842 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:04.808158 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:04.808546 (+ 388us) server_negotiation.cc:299] Negotiation successful
0808 11:36:04.808969 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":256,"threads_started":1}
I20260808 11:36:04.810660 12142 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:04.896196 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 12010
I20260808 11:36:04.919234 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 12151
I20260808 11:36:04.937714 12347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:04.920291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37358 (local address 127.26.66.131:43463)
0808 11:36:04.920903 (+ 612us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:04.920918 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:04.920963 (+ 45us) server_negotiation.cc:407] Connection header received
0808 11:36:04.922688 (+ 1725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:04.922698 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:04.923121 (+ 423us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:04.923476 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:04.925017 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:04.926235 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:04.927477 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:04.928210 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:04.928439 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:04.931285 (+ 2846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:04.931293 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:04.931307 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:04.931356 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:04.934149 (+ 2793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:04.934890 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:04.934897 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:04.934903 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:04.935070 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:04.935484 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:04.935490 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:04.935493 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:04.936186 (+ 693us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:04.936524 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:04.936972 (+ 448us) server_negotiation.cc:299] Negotiation successful
0808 11:36:04.937398 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":273,"threads_started":1}
I20260808 11:36:04.939100 12286 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:05.024420 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 12151
2026-08-08T11:36:05Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (65086 ms)
[----------] 30 tests from SecurityITest (300850 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:36:05 dist-test-slave-zkpd krb5kdc[12352](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:36:05 dist-test-slave-zkpd krb5kdc[12352](info): set up 2 sockets
Aug 08 11:36:05 dist-test-slave-zkpd krb5kdc[12352](info): commencing operation
krb5kdc: starting...
W20260808 11:36:06.203554 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.000s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:36:06 dist-test-slave-zkpd krb5kdc[12352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188966, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:36:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:36:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:36:06.549530 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:41613
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:35055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:41613
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:36:06.898609 12366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:06.898908 12366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:06.899076 12366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:06.906379 12366 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:36:06.906476 12366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:06.906571 12366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:06.906682 12366 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:36:06.906775 12366 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:36:06.916483 12366 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:35055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:41613
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:41613
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:06.917833 12366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:06.919174 12366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:06.931452 12371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:06.931483 12374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:06.931536 12372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:06.932478 12366 server_base.cc:1034] running on GCE node
I20260808 11:36:06.933524 12366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:06.935168 12366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:06.936434 12366 hybrid_clock.cc:648] HybridClock initialized: now 1786188966936368 us; error 43 us; skew 500 ppm
I20260808 11:36:06.936870 12366 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:36:06 dist-test-slave-zkpd krb5kdc[12352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188966, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:36:06.940426 12366 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:36:06.941983 12366 webserver.cc:460] Webserver started at http://127.26.66.190:41903/ using document root <none> and password file <none>
I20260808 11:36:06.942716 12366 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:06.942830 12366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:06.943102 12366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:06.946388 12366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "19b0c9e6348641d29874f48b9f32ba91"
format_stamp: "Formatted at 2026-08-08 11:36:06 on dist-test-slave-zkpd"
server_key: "2055b3af1cf6141474e36fba9774810d"
server_key_iv: "81ab37b336fbc453a1f108ec2dd58d8b"
server_key_version: "encryptionkey@0"
I20260808 11:36:06.947154 12366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "19b0c9e6348641d29874f48b9f32ba91"
format_stamp: "Formatted at 2026-08-08 11:36:06 on dist-test-slave-zkpd"
server_key: "2055b3af1cf6141474e36fba9774810d"
server_key_iv: "81ab37b336fbc453a1f108ec2dd58d8b"
server_key_version: "encryptionkey@0"
I20260808 11:36:06.952786 12366 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 11:36:06.956362 12382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:06.957665 12366 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 11:36:06.957827 12366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "19b0c9e6348641d29874f48b9f32ba91"
format_stamp: "Formatted at 2026-08-08 11:36:06 on dist-test-slave-zkpd"
server_key: "2055b3af1cf6141474e36fba9774810d"
server_key_iv: "81ab37b336fbc453a1f108ec2dd58d8b"
server_key_version: "encryptionkey@0"
I20260808 11:36:06.957999 12366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:06.970379 12366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:06.974541 12366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:06.974840 12366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:06.992561 12366 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:41613
I20260808 11:36:06.992581 12433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:41613 every 8 connection(s)
I20260808 11:36:06.993913 12366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:36:06.997776 12434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:07.002055 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 12366
I20260808 11:36:07.002295 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:36:07.003165 26890 external_mini_cluster.cc:1428] Setting key 0a7f998536dc3e3e5ec94590bd5eab27
I20260808 11:36:07.010908 12434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19b0c9e6348641d29874f48b9f32ba91: Bootstrap starting.
I20260808 11:36:07.015009 12434 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 19b0c9e6348641d29874f48b9f32ba91: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:07.016342 12434 log.cc:824] T 00000000000000000000000000000000 P 19b0c9e6348641d29874f48b9f32ba91: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:07.019366 12434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19b0c9e6348641d29874f48b9f32ba91: No bootstrap required, opened a new log
Aug 08 11:36:07 dist-test-slave-zkpd krb5kdc[12352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188966, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:36:07.030393 12434 raft_consensus.cc:348] T 00000000000000000000000000000000 P 19b0c9e6348641d29874f48b9f32ba91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19b0c9e6348641d29874f48b9f32ba91" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 41613 } }
I20260808 11:36:07.030856 12434 raft_consensus.cc:374] T 00000000000000000000000000000000 P 19b0c9e6348641d29874f48b9f32ba91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:07.030891 12437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:07.005308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44838 (local address 127.26.66.190:41613)
0808 11:36:07.006150 (+ 842us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:07.006165 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:07.006215 (+ 50us) server_negotiation.cc:407] Connection header received
0808 11:36:07.009172 (+ 2957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:07.009199 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:07.009681 (+ 482us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:07.010117 (+ 436us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:07.011550 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:07.013617 (+ 2067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:07.015948 (+ 2331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:07.017080 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:07.017227 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:07.021646 (+ 4419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:07.021665 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:07.021688 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:07.021751 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:07.026189 (+ 4438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:07.026892 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:07.026900 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:07.026909 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:07.027150 (+ 241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:07.027537 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:07.027542 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:07.027547 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:07.028369 (+ 822us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:07.028709 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:07.029040 (+ 331us) server_negotiation.cc:299] Negotiation successful
0808 11:36:07.029492 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":351,"threads_started":1}
I20260808 11:36:07.030993 12434 raft_consensus.cc:729] T 00000000000000000000000000000000 P 19b0c9e6348641d29874f48b9f32ba91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19b0c9e6348641d29874f48b9f32ba91, State: Initialized, Role: FOLLOWER
I20260808 11:36:07.031634 12434 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19b0c9e6348641d29874f48b9f32ba91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19b0c9e6348641d29874f48b9f32ba91" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 41613 } }
I20260808 11:36:07.031888 12434 raft_consensus.cc:388] T 00000000000000000000000000000000 P 19b0c9e6348641d29874f48b9f32ba91 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:36:07.032055 12434 raft_consensus.cc:482] T 00000000000000000000000000000000 P 19b0c9e6348641d29874f48b9f32ba91 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:36:07.032255 12434 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 19b0c9e6348641d29874f48b9f32ba91 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:07.034631 12434 raft_consensus.cc:504] T 00000000000000000000000000000000 P 19b0c9e6348641d29874f48b9f32ba91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19b0c9e6348641d29874f48b9f32ba91" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 41613 } }
I20260808 11:36:07.035132 12434 leader_election.cc:302] T 00000000000000000000000000000000 P 19b0c9e6348641d29874f48b9f32ba91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 19b0c9e6348641d29874f48b9f32ba91; no voters:
I20260808 11:36:07.035742 12434 leader_election.cc:288] T 00000000000000000000000000000000 P 19b0c9e6348641d29874f48b9f32ba91 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:36:07.035981 12439 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 19b0c9e6348641d29874f48b9f32ba91 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:36:07.036755 12439 raft_consensus.cc:686] T 00000000000000000000000000000000 P 19b0c9e6348641d29874f48b9f32ba91 [term 1 LEADER]: Becoming Leader. State: Replica: 19b0c9e6348641d29874f48b9f32ba91, State: Running, Role: LEADER
I20260808 11:36:07.037292 12439 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19b0c9e6348641d29874f48b9f32ba91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19b0c9e6348641d29874f48b9f32ba91" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 41613 } }
I20260808 11:36:07.038044 12434 sys_catalog.cc:564] T 00000000000000000000000000000000 P 19b0c9e6348641d29874f48b9f32ba91 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:36:07.040344 12441 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19b0c9e6348641d29874f48b9f32ba91 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19b0c9e6348641d29874f48b9f32ba91. Latest consensus state: current_term: 1 leader_uuid: "19b0c9e6348641d29874f48b9f32ba91" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19b0c9e6348641d29874f48b9f32ba91" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 41613 } } }
I20260808 11:36:07.040515 12440 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19b0c9e6348641d29874f48b9f32ba91 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "19b0c9e6348641d29874f48b9f32ba91" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19b0c9e6348641d29874f48b9f32ba91" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 41613 } } }
I20260808 11:36:07.040843 12440 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19b0c9e6348641d29874f48b9f32ba91 [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:07.040846 12441 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19b0c9e6348641d29874f48b9f32ba91 [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:07.044162 12446 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:36:07.049809 12446 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:36:07.058617 12446 catalog_manager.cc:1347] Generated new cluster ID: 9fc254572d5142fdbae85ecdaa802124
I20260808 11:36:07.058758 12446 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:36:07.073742 12446 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:36:07.075289 12446 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:36:07.083537 12446 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 19b0c9e6348641d29874f48b9f32ba91: Generated new TSK 0
I20260808 11:36:07.084393 12446 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.66.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
I20260808 11:36:07.164060 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:0
--local_ip_for_outbound_sockets=127.26.66.129
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:41613
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:35055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:36:07.516978 12461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:07.517307 12461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:07.517477 12461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:07.524837 12461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:07.524986 12461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:07.525156 12461 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:36:07.534792 12461 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:35055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:41613
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:07.536166 12461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:07.537482 12461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:07.551229 12469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:07.551203 12466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:07.551467 12467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:07.552050 12461 server_base.cc:1034] running on GCE node
I20260808 11:36:07.552667 12461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:07.553580 12461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:07.554816 12461 hybrid_clock.cc:648] HybridClock initialized: now 1786188967554781 us; error 64 us; skew 500 ppm
I20260808 11:36:07.555142 12461 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:36:07 dist-test-slave-zkpd krb5kdc[12352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188967, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:36:07.558404 12461 init.cc:377] Logged in from keytab as kudu/127.26.66.129@KRBTEST.COM (short username kudu)
I20260808 11:36:07.559779 12461 webserver.cc:460] Webserver started at http://127.26.66.129:43679/ using document root <none> and password file <none>
I20260808 11:36:07.560505 12461 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:07.560681 12461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:07.561048 12461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:07.563941 12461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-0/data/instance:
uuid: "16bfd6968b064990af49f1793ba6c46d"
format_stamp: "Formatted at 2026-08-08 11:36:07 on dist-test-slave-zkpd"
server_key: "0c906c8a3675720683b589573da32278"
server_key_iv: "c7221c8a3c410662c349140d4c4e029c"
server_key_version: "encryptionkey@0"
I20260808 11:36:07.564733 12461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance:
uuid: "16bfd6968b064990af49f1793ba6c46d"
format_stamp: "Formatted at 2026-08-08 11:36:07 on dist-test-slave-zkpd"
server_key: "0c906c8a3675720683b589573da32278"
server_key_iv: "c7221c8a3c410662c349140d4c4e029c"
server_key_version: "encryptionkey@0"
I20260808 11:36:07.569793 12461 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 11:36:07.573230 12479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:07.574591 12461 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:36:07.574770 12461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "16bfd6968b064990af49f1793ba6c46d"
format_stamp: "Formatted at 2026-08-08 11:36:07 on dist-test-slave-zkpd"
server_key: "0c906c8a3675720683b589573da32278"
server_key_iv: "c7221c8a3c410662c349140d4c4e029c"
server_key_version: "encryptionkey@0"
I20260808 11:36:07.574982 12461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:07.590837 12461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:07.594923 12461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:07.595376 12461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:07.596429 12461 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:36:07.597810 12461 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:36:07.597911 12461 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:07.598058 12461 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:36:07.598145 12461 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:07.632717 12461 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:45001
I20260808 11:36:07.632766 12601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:45001 every 8 connection(s)
I20260808 11:36:07.634089 12461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:36:07.637725 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 12461
I20260808 11:36:07.637981 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance
I20260808 11:36:07.638897 26890 external_mini_cluster.cc:1428] Setting key 26ba46a01c5f582ca99fa37d17890852
Aug 08 11:36:07 dist-test-slave-zkpd krb5kdc[12352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188967, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:36:07.656965 12604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:07.636708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:39533 (local address 127.26.66.190:41613)
0808 11:36:07.637202 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:07.637232 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:07.638445 (+ 1213us) server_negotiation.cc:407] Connection header received
0808 11:36:07.640891 (+ 2446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:07.640900 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:07.640988 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:07.641088 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:07.642680 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:07.643979 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:07.645649 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:07.646373 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:07.646534 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:07.650192 (+ 3658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:07.650201 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:07.650209 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:07.650259 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:07.653781 (+ 3522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:07.654497 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:07.654505 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:07.654511 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:07.654665 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:07.655071 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:07.655078 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:07.655084 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:07.655469 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:07.655627 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:07.656357 (+ 730us) server_negotiation.cc:299] Negotiation successful
0808 11:36:07.656617 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":247,"threads_started":1}
I20260808 11:36:07.658056 12605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:07.637312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:41613 (local address 127.26.66.129:39533)
0808 11:36:07.638240 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:07.638305 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:07.640577 (+ 2272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:07.641364 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:07.641372 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:07.641897 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:36:07.642492 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:07.642511 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:07.644177 (+ 1666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:07.644181 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:07.645512 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:07.645524 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:07.646595 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:07.646600 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:07.646806 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:07.647500 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:36:07.647522 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:36:07.649956 (+ 2434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:36:07.653933 (+ 3977us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:36:07.653939 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:36:07.653951 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:36:07.654380 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:36:07.654776 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:36:07.654779 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:36:07.654781 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:36:07.654964 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:36:07.655590 (+ 626us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:36:07.655596 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:36:07.655957 (+ 361us) client_negotiation.cc:769] Sending connection context
0808 11:36:07.656194 (+ 237us) client_negotiation.cc:240] Negotiation successful
0808 11:36:07.656579 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":324,"threads_started":1}
I20260808 11:36:07.659703 12602 heartbeater.cc:347] Connected to a master server at 127.26.66.190:41613
I20260808 11:36:07.660071 12602 heartbeater.cc:464] Registering TS with master...
I20260808 11:36:07.660828 12602 heartbeater.cc:511] Master 127.26.66.190:41613 requested a full tablet report, sending...
I20260808 11:36:07.663367 12399 ts_manager.cc:194] Registered new tserver with Master: 16bfd6968b064990af49f1793ba6c46d (127.26.66.129:45001)
I20260808 11:36:07.665699 12399 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.129@KRBTEST.COM'} at 127.26.66.129:39533
WARNING: no policy specified for kudu/127.26.66.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
I20260808 11:36:07.712996 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:0
--local_ip_for_outbound_sockets=127.26.66.130
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:41613
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:35055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:36:08.064028 12608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:08.064417 12608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:08.064589 12608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:08.072378 12608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:08.072527 12608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:08.072693 12608 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:36:08.082427 12608 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:35055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:41613
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:08.083734 12608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:08.085103 12608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:08.098446 12614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:08.098495 12615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:08.098429 12617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:08.099596 12608 server_base.cc:1034] running on GCE node
I20260808 11:36:08.100222 12608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:08.101161 12608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:08.102366 12608 hybrid_clock.cc:648] HybridClock initialized: now 1786188968102317 us; error 43 us; skew 500 ppm
I20260808 11:36:08.102684 12608 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:36:08 dist-test-slave-zkpd krb5kdc[12352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188968, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:36:08.105937 12608 init.cc:377] Logged in from keytab as kudu/127.26.66.130@KRBTEST.COM (short username kudu)
I20260808 11:36:08.107501 12608 webserver.cc:460] Webserver started at http://127.26.66.130:43249/ using document root <none> and password file <none>
I20260808 11:36:08.108319 12608 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:08.108428 12608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:08.108700 12608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:08.111622 12608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-1/data/instance:
uuid: "c9ee896fc5cd4d478d52ee2103af999c"
format_stamp: "Formatted at 2026-08-08 11:36:08 on dist-test-slave-zkpd"
server_key: "1b722ba5770fc78433d7373d3852e9f7"
server_key_iv: "cff1951c947dc107e42a2327097d35ba"
server_key_version: "encryptionkey@0"
I20260808 11:36:08.112413 12608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance:
uuid: "c9ee896fc5cd4d478d52ee2103af999c"
format_stamp: "Formatted at 2026-08-08 11:36:08 on dist-test-slave-zkpd"
server_key: "1b722ba5770fc78433d7373d3852e9f7"
server_key_iv: "cff1951c947dc107e42a2327097d35ba"
server_key_version: "encryptionkey@0"
I20260808 11:36:08.117606 12608 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260808 11:36:08.120973 12624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:08.122273 12608 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 11:36:08.122443 12608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "c9ee896fc5cd4d478d52ee2103af999c"
format_stamp: "Formatted at 2026-08-08 11:36:08 on dist-test-slave-zkpd"
server_key: "1b722ba5770fc78433d7373d3852e9f7"
server_key_iv: "cff1951c947dc107e42a2327097d35ba"
server_key_version: "encryptionkey@0"
I20260808 11:36:08.122645 12608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:08.149865 12608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:08.154222 12608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:08.154529 12608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:08.155505 12608 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:36:08.156919 12608 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:36:08.156999 12608 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:08.157174 12608 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:36:08.157227 12608 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:08.191833 12608 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:40917
I20260808 11:36:08.191869 12742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:40917 every 8 connection(s)
I20260808 11:36:08.193145 12608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:36:08.194799 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 12608
I20260808 11:36:08.195009 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance
I20260808 11:36:08.195580 26890 external_mini_cluster.cc:1428] Setting key 3158018f5d25edae19fd1d171278c3dd
Aug 08 11:36:08 dist-test-slave-zkpd krb5kdc[12352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188968, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:36:08.216982 12746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:08.196051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:33839 (local address 127.26.66.190:41613)
0808 11:36:08.196542 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:08.196548 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:08.197736 (+ 1188us) server_negotiation.cc:407] Connection header received
0808 11:36:08.200689 (+ 2953us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:08.200693 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:08.200761 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:08.200846 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:08.202918 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:08.203630 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:08.205989 (+ 2359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:08.206422 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:08.206516 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:08.211056 (+ 4540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:08.211061 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:08.211064 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:08.211096 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:08.213818 (+ 2722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:08.214554 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:08.214558 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:08.214560 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:08.214684 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:08.215135 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:08.215140 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:08.215142 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:08.215411 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:08.215571 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:08.216360 (+ 789us) server_negotiation.cc:299] Negotiation successful
0808 11:36:08.216591 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":266,"threads_started":1}
I20260808 11:36:08.217934 12747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:08.196771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:41613 (local address 127.26.66.130:33839)
0808 11:36:08.197598 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:08.197651 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:08.200353 (+ 2702us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:08.201110 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:08.201125 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:08.201907 (+ 782us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:36:08.202734 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:08.202762 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:08.203773 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:08.203781 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:08.205821 (+ 2040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:08.205844 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:08.206647 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:08.206657 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:08.206998 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:08.207726 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:36:08.207760 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:36:08.210822 (+ 3062us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:36:08.213964 (+ 3142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:36:08.213973 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:36:08.213988 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:36:08.214415 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:36:08.214804 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:36:08.214810 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:36:08.214814 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:36:08.215004 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:36:08.215542 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:36:08.215550 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:36:08.215876 (+ 326us) client_negotiation.cc:769] Sending connection context
0808 11:36:08.216242 (+ 366us) client_negotiation.cc:240] Negotiation successful
0808 11:36:08.216756 (+ 514us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":332,"threads_started":1}
I20260808 11:36:08.219645 12743 heartbeater.cc:347] Connected to a master server at 127.26.66.190:41613
I20260808 11:36:08.220108 12743 heartbeater.cc:464] Registering TS with master...
I20260808 11:36:08.220824 12743 heartbeater.cc:511] Master 127.26.66.190:41613 requested a full tablet report, sending...
I20260808 11:36:08.222352 12399 ts_manager.cc:194] Registered new tserver with Master: c9ee896fc5cd4d478d52ee2103af999c (127.26.66.130:40917)
I20260808 11:36:08.223189 12399 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.130@KRBTEST.COM'} at 127.26.66.130:33839
WARNING: no policy specified for kudu/127.26.66.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
I20260808 11:36:08.272251 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:0
--local_ip_for_outbound_sockets=127.26.66.131
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:41613
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:35055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:36:08.618402 12750 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:08.618673 12750 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:08.618872 12750 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:08.626276 12750 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:08.626436 12750 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:08.626606 12750 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:36:08.636487 12750 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:35055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:41613
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:08.637640 12750 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:08.638980 12750 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:08.652261 12755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:08.652222 12756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:08.652307 12758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:08.652976 12750 server_base.cc:1034] running on GCE node
I20260808 11:36:08.653575 12750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:08.654553 12750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:08.655825 12750 hybrid_clock.cc:648] HybridClock initialized: now 1786188968655785 us; error 52 us; skew 500 ppm
I20260808 11:36:08.656174 12750 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:36:08 dist-test-slave-zkpd krb5kdc[12352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188968, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:36:08.659459 12750 init.cc:377] Logged in from keytab as kudu/127.26.66.131@KRBTEST.COM (short username kudu)
I20260808 11:36:08.660933 12750 webserver.cc:460] Webserver started at http://127.26.66.131:45663/ using document root <none> and password file <none>
I20260808 11:36:08.661659 12750 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:08.661772 12750 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:08.662086 12750 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:08.665129 12750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-2/data/instance:
uuid: "d6736d01d2344089b7a9a4a1a1d83b8d"
format_stamp: "Formatted at 2026-08-08 11:36:08 on dist-test-slave-zkpd"
server_key: "8e7f9a8057978909022182d5a29b3fd4"
server_key_iv: "4f98b93eaf11f54b3f9324f0f6ec2b9c"
server_key_version: "encryptionkey@0"
I20260808 11:36:08.665892 12750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance:
uuid: "d6736d01d2344089b7a9a4a1a1d83b8d"
format_stamp: "Formatted at 2026-08-08 11:36:08 on dist-test-slave-zkpd"
server_key: "8e7f9a8057978909022182d5a29b3fd4"
server_key_iv: "4f98b93eaf11f54b3f9324f0f6ec2b9c"
server_key_version: "encryptionkey@0"
I20260808 11:36:08.668733 12602 heartbeater.cc:503] Master 127.26.66.190:41613 was elected leader, sending a full tablet report...
I20260808 11:36:08.671223 12750 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 11:36:08.674746 12767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:08.676180 12750 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 11:36:08.676367 12750 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "d6736d01d2344089b7a9a4a1a1d83b8d"
format_stamp: "Formatted at 2026-08-08 11:36:08 on dist-test-slave-zkpd"
server_key: "8e7f9a8057978909022182d5a29b3fd4"
server_key_iv: "4f98b93eaf11f54b3f9324f0f6ec2b9c"
server_key_version: "encryptionkey@0"
I20260808 11:36:08.676576 12750 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:08.695765 12750 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:08.700176 12750 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:08.700474 12750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:08.701470 12750 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:36:08.702780 12750 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:36:08.702853 12750 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:08.703022 12750 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:36:08.703080 12750 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:08.736716 12750 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:43059
I20260808 11:36:08.736868 12885 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:43059 every 8 connection(s)
I20260808 11:36:08.738029 12750 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:36:08.745754 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 12750
I20260808 11:36:08.745978 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance
I20260808 11:36:08.746464 26890 external_mini_cluster.cc:1428] Setting key a455b0aa7dbda323280ba8ff88b115fe
Aug 08 11:36:08 dist-test-slave-zkpd krb5kdc[12352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188968, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:36:08.758497 12888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:08.740783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:44787 (local address 127.26.66.190:41613)
0808 11:36:08.741236 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:08.741241 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:08.742237 (+ 996us) server_negotiation.cc:407] Connection header received
0808 11:36:08.744189 (+ 1952us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:08.744193 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:08.744291 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:08.744389 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:08.746251 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:08.747139 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:08.749297 (+ 2158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:08.749852 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:08.750007 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:08.753300 (+ 3293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:08.753304 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:08.753308 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:08.753341 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:08.755801 (+ 2460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:08.756558 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:08.756561 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:08.756564 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:08.756691 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:08.757080 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:08.757083 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:08.757085 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:08.757333 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:08.757455 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:08.758075 (+ 620us) server_negotiation.cc:299] Negotiation successful
0808 11:36:08.758233 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":216,"threads_started":1}
I20260808 11:36:08.759445 12890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:08.741347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:41613 (local address 127.26.66.131:44787)
0808 11:36:08.742053 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:08.742093 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:08.743870 (+ 1777us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:08.744592 (+ 722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:08.744599 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:08.745222 (+ 623us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:36:08.746027 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:08.746056 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:08.747303 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:08.747309 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:08.749157 (+ 1848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:08.749171 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:08.750062 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:08.750067 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:08.750258 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:08.750927 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:36:08.750955 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:36:08.753107 (+ 2152us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:36:08.755984 (+ 2877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:36:08.755990 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:36:08.756001 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:36:08.756445 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:36:08.756793 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:36:08.756796 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:36:08.756799 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:36:08.756975 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:36:08.757445 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:36:08.757451 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:36:08.757728 (+ 277us) client_negotiation.cc:769] Sending connection context
0808 11:36:08.757976 (+ 248us) client_negotiation.cc:240] Negotiation successful
0808 11:36:08.758324 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":285,"threads_started":1}
I20260808 11:36:08.760932 12886 heartbeater.cc:347] Connected to a master server at 127.26.66.190:41613
I20260808 11:36:08.761221 12886 heartbeater.cc:464] Registering TS with master...
I20260808 11:36:08.762130 12886 heartbeater.cc:511] Master 127.26.66.190:41613 requested a full tablet report, sending...
I20260808 11:36:08.763481 12399 ts_manager.cc:194] Registered new tserver with Master: d6736d01d2344089b7a9a4a1a1d83b8d (127.26.66.131:43059)
I20260808 11:36:08.764353 12399 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.131@KRBTEST.COM'} at 127.26.66.131:44787
I20260808 11:36:08.774296 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 11:36:08.792481 12888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:08.779476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44852 (local address 127.26.66.190:41613)
0808 11:36:08.779719 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:08.779728 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:08.780191 (+ 463us) server_negotiation.cc:407] Connection header received
0808 11:36:08.780405 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:08.780409 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:08.780483 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:08.780565 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:08.782211 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:08.782919 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:08.784283 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:08.784677 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:08.784770 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:08.787176 (+ 2406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:08.787181 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:08.787184 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:08.787215 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:08.789949 (+ 2734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:08.790644 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:08.790647 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:08.790650 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:08.790758 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:08.791069 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:08.791072 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:08.791074 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:08.791385 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:08.791584 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:08.791999 (+ 415us) server_negotiation.cc:299] Negotiation successful
0808 11:36:08.792179 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 11:36:08.796484 12399 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44852:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 11:36:08.803339 12399 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:36:08.829195 12903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:08.815767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47882 (local address 127.26.66.131:43059)
0808 11:36:08.816989 (+ 1222us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:08.816997 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:08.817680 (+ 683us) server_negotiation.cc:407] Connection header received
0808 11:36:08.817834 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:08.817845 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:08.818177 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:08.818446 (+ 269us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:08.819670 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:08.821908 (+ 2238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:08.826201 (+ 4293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:08.827646 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:08.827819 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:08.828133 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:08.828616 (+ 483us) server_negotiation.cc:299] Negotiation successful
0808 11:36:08.828804 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1017,"thread_start_us":1571,"threads_started":1}
I20260808 11:36:08.830261 12902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:08.815626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:43059 (local address 127.0.0.1:47882)
0808 11:36:08.817428 (+ 1802us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:08.817446 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:08.817562 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:08.818841 (+ 1279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:08.818853 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:08.818895 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:08.819432 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:08.819455 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:08.822127 (+ 2672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:08.822136 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:08.825986 (+ 3850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:08.826001 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:08.827878 (+ 1877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:08.827907 (+ 29us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:08.828174 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:08.828265 (+ 91us) client_negotiation.cc:769] Sending connection context
0808 11:36:08.828471 (+ 206us) client_negotiation.cc:240] Negotiation successful
0808 11:36:08.829791 (+ 1320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1675,"mutex_wait_us":1093,"thread_start_us":1823,"threads_started":1}
I20260808 11:36:08.832929 12900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:08.815195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45001 (local address 127.0.0.1:50234)
0808 11:36:08.816122 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:08.816162 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:08.816340 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:08.825066 (+ 8726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:08.825071 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:08.825097 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:08.825552 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:08.825566 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:08.827922 (+ 2356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:08.827928 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:08.830088 (+ 2160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:08.830101 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:08.832047 (+ 1946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:08.832053 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:08.832227 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:08.832266 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 11:36:08.832397 (+ 131us) client_negotiation.cc:240] Negotiation successful
0808 11:36:08.832536 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"mutex_wait_us":4,"thread_start_us":914,"threads_started":1}
I20260808 11:36:08.833495 12901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:08.815438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50234 (local address 127.26.66.129:45001)
0808 11:36:08.824450 (+ 9012us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:08.824461 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:08.824493 (+ 32us) server_negotiation.cc:407] Connection header received
0808 11:36:08.824591 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:08.824597 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:08.824845 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:08.825829 (+ 984us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:08.826092 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:08.827732 (+ 1640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:08.830257 (+ 2525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:08.831806 (+ 1549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:08.832004 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:08.832256 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:08.832439 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 11:36:08.833162 (+ 723us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8833,"thread_start_us":8656,"threads_started":1}
I20260808 11:36:08.834038 12905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:08.818086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37140 (local address 127.26.66.130:40917)
0808 11:36:08.824729 (+ 6643us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:08.824736 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:08.825444 (+ 708us) server_negotiation.cc:407] Connection header received
0808 11:36:08.825544 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:08.825551 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:08.825829 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:08.826024 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:08.826589 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:08.827714 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:08.830525 (+ 2811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:08.831934 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:08.832064 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:08.832218 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:08.833250 (+ 1032us) server_negotiation.cc:299] Negotiation successful
0808 11:36:08.833439 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6493,"thread_start_us":6364,"threads_started":1}
I20260808 11:36:08.834478 12904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:08.817755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:40917 (local address 127.0.0.1:37140)
0808 11:36:08.825144 (+ 7389us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:08.825160 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:08.825302 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:08.826024 (+ 722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:08.826028 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:08.826054 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:08.826438 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:08.826447 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:08.827935 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:08.827939 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:08.830363 (+ 2424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:08.830381 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:08.832396 (+ 2015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:08.832403 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:08.832568 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:08.832599 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 11:36:08.832696 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 11:36:08.832840 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7267,"thread_start_us":7119,"threads_started":1}
I20260808 11:36:08.834522 12817 tablet_service.cc:1467] Processing CreateTablet for tablet 58b9d50c007d4d4680eeabbbeab8d7e1 (DEFAULT_TABLE table=test-table [id=669ff4142d6643f88faf531a2369f470]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:36:08.836203 12817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58b9d50c007d4d4680eeabbbeab8d7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:08.837185 12529 tablet_service.cc:1467] Processing CreateTablet for tablet 58b9d50c007d4d4680eeabbbeab8d7e1 (DEFAULT_TABLE table=test-table [id=669ff4142d6643f88faf531a2369f470]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:36:08.838183 12676 tablet_service.cc:1467] Processing CreateTablet for tablet 58b9d50c007d4d4680eeabbbeab8d7e1 (DEFAULT_TABLE table=test-table [id=669ff4142d6643f88faf531a2369f470]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:36:08.839030 12529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58b9d50c007d4d4680eeabbbeab8d7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:08.839529 12676 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58b9d50c007d4d4680eeabbbeab8d7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:08.852321 12906 tablet_bootstrap.cc:492] T 58b9d50c007d4d4680eeabbbeab8d7e1 P 16bfd6968b064990af49f1793ba6c46d: Bootstrap starting.
I20260808 11:36:08.852488 12907 tablet_bootstrap.cc:492] T 58b9d50c007d4d4680eeabbbeab8d7e1 P d6736d01d2344089b7a9a4a1a1d83b8d: Bootstrap starting.
I20260808 11:36:08.854180 12908 tablet_bootstrap.cc:492] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c: Bootstrap starting.
I20260808 11:36:08.856292 12907 tablet_bootstrap.cc:654] T 58b9d50c007d4d4680eeabbbeab8d7e1 P d6736d01d2344089b7a9a4a1a1d83b8d: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:08.856652 12906 tablet_bootstrap.cc:654] T 58b9d50c007d4d4680eeabbbeab8d7e1 P 16bfd6968b064990af49f1793ba6c46d: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:08.857017 12908 tablet_bootstrap.cc:654] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:08.857690 12907 log.cc:824] T 58b9d50c007d4d4680eeabbbeab8d7e1 P d6736d01d2344089b7a9a4a1a1d83b8d: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:08.857931 12906 log.cc:824] T 58b9d50c007d4d4680eeabbbeab8d7e1 P 16bfd6968b064990af49f1793ba6c46d: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:08.858052 12908 log.cc:824] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:08.861426 12906 tablet_bootstrap.cc:492] T 58b9d50c007d4d4680eeabbbeab8d7e1 P 16bfd6968b064990af49f1793ba6c46d: No bootstrap required, opened a new log
I20260808 11:36:08.861686 12906 ts_tablet_manager.cc:1397] T 58b9d50c007d4d4680eeabbbeab8d7e1 P 16bfd6968b064990af49f1793ba6c46d: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260808 11:36:08.866068 12908 tablet_bootstrap.cc:492] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c: No bootstrap required, opened a new log
I20260808 11:36:08.866334 12908 ts_tablet_manager.cc:1397] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.004s
I20260808 11:36:08.868212 12907 tablet_bootstrap.cc:492] T 58b9d50c007d4d4680eeabbbeab8d7e1 P d6736d01d2344089b7a9a4a1a1d83b8d: No bootstrap required, opened a new log
I20260808 11:36:08.868486 12907 ts_tablet_manager.cc:1397] T 58b9d50c007d4d4680eeabbbeab8d7e1 P d6736d01d2344089b7a9a4a1a1d83b8d: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.003s
I20260808 11:36:08.869041 12906 raft_consensus.cc:348] T 58b9d50c007d4d4680eeabbbeab8d7e1 P 16bfd6968b064990af49f1793ba6c46d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16bfd6968b064990af49f1793ba6c46d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45001 } } peers { permanent_uuid: "d6736d01d2344089b7a9a4a1a1d83b8d" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43059 } } peers { permanent_uuid: "c9ee896fc5cd4d478d52ee2103af999c" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 40917 } }
I20260808 11:36:08.869426 12906 raft_consensus.cc:374] T 58b9d50c007d4d4680eeabbbeab8d7e1 P 16bfd6968b064990af49f1793ba6c46d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:08.869525 12906 raft_consensus.cc:729] T 58b9d50c007d4d4680eeabbbeab8d7e1 P 16bfd6968b064990af49f1793ba6c46d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16bfd6968b064990af49f1793ba6c46d, State: Initialized, Role: FOLLOWER
I20260808 11:36:08.870138 12906 consensus_queue.cc:260] T 58b9d50c007d4d4680eeabbbeab8d7e1 P 16bfd6968b064990af49f1793ba6c46d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16bfd6968b064990af49f1793ba6c46d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45001 } } peers { permanent_uuid: "d6736d01d2344089b7a9a4a1a1d83b8d" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43059 } } peers { permanent_uuid: "c9ee896fc5cd4d478d52ee2103af999c" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 40917 } }
I20260808 11:36:08.872017 12906 ts_tablet_manager.cc:1428] T 58b9d50c007d4d4680eeabbbeab8d7e1 P 16bfd6968b064990af49f1793ba6c46d: Time spent starting tablet: real 0.010s user 0.008s sys 0.004s
I20260808 11:36:08.877269 12908 raft_consensus.cc:348] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16bfd6968b064990af49f1793ba6c46d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45001 } } peers { permanent_uuid: "d6736d01d2344089b7a9a4a1a1d83b8d" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43059 } } peers { permanent_uuid: "c9ee896fc5cd4d478d52ee2103af999c" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 40917 } }
I20260808 11:36:08.877728 12908 raft_consensus.cc:374] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:08.877839 12908 raft_consensus.cc:729] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9ee896fc5cd4d478d52ee2103af999c, State: Initialized, Role: FOLLOWER
I20260808 11:36:08.878465 12908 consensus_queue.cc:260] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16bfd6968b064990af49f1793ba6c46d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45001 } } peers { permanent_uuid: "d6736d01d2344089b7a9a4a1a1d83b8d" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43059 } } peers { permanent_uuid: "c9ee896fc5cd4d478d52ee2103af999c" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 40917 } }
I20260808 11:36:08.879787 12743 heartbeater.cc:503] Master 127.26.66.190:41613 was elected leader, sending a full tablet report...
I20260808 11:36:08.879666 12907 raft_consensus.cc:348] T 58b9d50c007d4d4680eeabbbeab8d7e1 P d6736d01d2344089b7a9a4a1a1d83b8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16bfd6968b064990af49f1793ba6c46d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45001 } } peers { permanent_uuid: "d6736d01d2344089b7a9a4a1a1d83b8d" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43059 } } peers { permanent_uuid: "c9ee896fc5cd4d478d52ee2103af999c" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 40917 } }
I20260808 11:36:08.880126 12907 raft_consensus.cc:374] T 58b9d50c007d4d4680eeabbbeab8d7e1 P d6736d01d2344089b7a9a4a1a1d83b8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:08.880239 12907 raft_consensus.cc:729] T 58b9d50c007d4d4680eeabbbeab8d7e1 P d6736d01d2344089b7a9a4a1a1d83b8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6736d01d2344089b7a9a4a1a1d83b8d, State: Initialized, Role: FOLLOWER
I20260808 11:36:08.880587 12908 ts_tablet_manager.cc:1428] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c: Time spent starting tablet: real 0.014s user 0.015s sys 0.001s
I20260808 11:36:08.880872 12907 consensus_queue.cc:260] T 58b9d50c007d4d4680eeabbbeab8d7e1 P d6736d01d2344089b7a9a4a1a1d83b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16bfd6968b064990af49f1793ba6c46d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45001 } } peers { permanent_uuid: "d6736d01d2344089b7a9a4a1a1d83b8d" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43059 } } peers { permanent_uuid: "c9ee896fc5cd4d478d52ee2103af999c" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 40917 } }
I20260808 11:36:08.882009 12886 heartbeater.cc:503] Master 127.26.66.190:41613 was elected leader, sending a full tablet report...
I20260808 11:36:08.882555 12907 ts_tablet_manager.cc:1428] T 58b9d50c007d4d4680eeabbbeab8d7e1 P d6736d01d2344089b7a9a4a1a1d83b8d: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
W20260808 11:36:08.886505 12603 tablet.cc:2369] T 58b9d50c007d4d4680eeabbbeab8d7e1 P 16bfd6968b064990af49f1793ba6c46d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 11:36:08.945441 12745 tablet.cc:2369] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 11:36:08.989812 12887 tablet.cc:2369] T 58b9d50c007d4d4680eeabbbeab8d7e1 P d6736d01d2344089b7a9a4a1a1d83b8d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:36:09.132560 12914 raft_consensus.cc:482] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:36:09.132920 12914 raft_consensus.cc:504] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16bfd6968b064990af49f1793ba6c46d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45001 } } peers { permanent_uuid: "d6736d01d2344089b7a9a4a1a1d83b8d" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43059 } } peers { permanent_uuid: "c9ee896fc5cd4d478d52ee2103af999c" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 40917 } }
I20260808 11:36:09.134693 12914 leader_election.cc:288] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16bfd6968b064990af49f1793ba6c46d (127.26.66.129:45001), d6736d01d2344089b7a9a4a1a1d83b8d (127.26.66.131:43059)
I20260808 11:36:09.142402 12901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:09.135178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:36495 (local address 127.26.66.129:45001)
0808 11:36:09.135406 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:09.135414 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:09.136195 (+ 781us) server_negotiation.cc:407] Connection header received
0808 11:36:09.136421 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:09.136429 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:09.136542 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:09.136660 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:09.137611 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:09.138430 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:09.140676 (+ 2246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:09.141446 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:09.141634 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:09.141715 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:09.141998 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 11:36:09.142131 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 11:36:09.142508 12903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:09.135550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:35899 (local address 127.26.66.131:43059)
0808 11:36:09.135767 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:09.135774 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:09.136450 (+ 676us) server_negotiation.cc:407] Connection header received
0808 11:36:09.136560 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:09.136565 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:09.136659 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:09.136793 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:09.137540 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:09.138477 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:09.140747 (+ 2270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:09.141532 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:09.141724 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:09.141804 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:09.142097 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 11:36:09.142237 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 11:36:09.142647 12916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:09.135176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45001 (local address 127.26.66.130:36495)
0808 11:36:09.136019 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:09.136045 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:09.136235 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:09.136683 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:09.136686 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:09.136706 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:09.137401 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:09.137412 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:09.138561 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:09.138568 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:09.140510 (+ 1942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:09.140523 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:09.141670 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:09.141676 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:09.141832 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:09.141859 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 11:36:09.141971 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 11:36:09.142100 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":635,"mutex_wait_us":121,"spinlock_wait_cycles":23424,"thread_start_us":424,"threads_started":1}
I20260808 11:36:09.142705 12919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:09.135233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:43059 (local address 127.26.66.130:35899)
0808 11:36:09.136320 (+ 1087us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:09.136343 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:09.136457 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:09.136781 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:09.136789 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:09.136808 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:09.137325 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:09.137344 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:09.138642 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:09.138648 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:09.140583 (+ 1935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:09.140596 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:09.141766 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:09.141773 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:09.141940 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:09.141964 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 11:36:09.142069 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 11:36:09.142188 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":961,"mutex_wait_us":62,"thread_start_us":760,"threads_started":1}
I20260808 11:36:09.143828 12838 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b9d50c007d4d4680eeabbbeab8d7e1" candidate_uuid: "c9ee896fc5cd4d478d52ee2103af999c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6736d01d2344089b7a9a4a1a1d83b8d" is_pre_election: true
I20260808 11:36:09.143863 12553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b9d50c007d4d4680eeabbbeab8d7e1" candidate_uuid: "c9ee896fc5cd4d478d52ee2103af999c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16bfd6968b064990af49f1793ba6c46d" is_pre_election: true
I20260808 11:36:09.144479 12838 raft_consensus.cc:2454] T 58b9d50c007d4d4680eeabbbeab8d7e1 P d6736d01d2344089b7a9a4a1a1d83b8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9ee896fc5cd4d478d52ee2103af999c in term 0.
I20260808 11:36:09.144487 12553 raft_consensus.cc:2454] T 58b9d50c007d4d4680eeabbbeab8d7e1 P 16bfd6968b064990af49f1793ba6c46d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9ee896fc5cd4d478d52ee2103af999c in term 0.
I20260808 11:36:09.145241 12629 leader_election.cc:302] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 16bfd6968b064990af49f1793ba6c46d, c9ee896fc5cd4d478d52ee2103af999c, d6736d01d2344089b7a9a4a1a1d83b8d; no voters:
I20260808 11:36:09.145705 12914 raft_consensus.cc:2781] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:36:09.145871 12914 raft_consensus.cc:482] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:36:09.145983 12914 raft_consensus.cc:3037] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:09.148373 12914 raft_consensus.cc:504] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16bfd6968b064990af49f1793ba6c46d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45001 } } peers { permanent_uuid: "d6736d01d2344089b7a9a4a1a1d83b8d" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43059 } } peers { permanent_uuid: "c9ee896fc5cd4d478d52ee2103af999c" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 40917 } }
I20260808 11:36:09.148968 12914 leader_election.cc:288] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c [CANDIDATE]: Term 1 election: Requested vote from peers 16bfd6968b064990af49f1793ba6c46d (127.26.66.129:45001), d6736d01d2344089b7a9a4a1a1d83b8d (127.26.66.131:43059)
I20260808 11:36:09.149544 12553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b9d50c007d4d4680eeabbbeab8d7e1" candidate_uuid: "c9ee896fc5cd4d478d52ee2103af999c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16bfd6968b064990af49f1793ba6c46d"
I20260808 11:36:09.149544 12838 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b9d50c007d4d4680eeabbbeab8d7e1" candidate_uuid: "c9ee896fc5cd4d478d52ee2103af999c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6736d01d2344089b7a9a4a1a1d83b8d"
I20260808 11:36:09.149766 12553 raft_consensus.cc:3037] T 58b9d50c007d4d4680eeabbbeab8d7e1 P 16bfd6968b064990af49f1793ba6c46d [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:09.149772 12838 raft_consensus.cc:3037] T 58b9d50c007d4d4680eeabbbeab8d7e1 P d6736d01d2344089b7a9a4a1a1d83b8d [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:09.153077 12553 raft_consensus.cc:2454] T 58b9d50c007d4d4680eeabbbeab8d7e1 P 16bfd6968b064990af49f1793ba6c46d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9ee896fc5cd4d478d52ee2103af999c in term 1.
I20260808 11:36:09.153077 12838 raft_consensus.cc:2454] T 58b9d50c007d4d4680eeabbbeab8d7e1 P d6736d01d2344089b7a9a4a1a1d83b8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9ee896fc5cd4d478d52ee2103af999c in term 1.
I20260808 11:36:09.153514 12629 leader_election.cc:302] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 16bfd6968b064990af49f1793ba6c46d, c9ee896fc5cd4d478d52ee2103af999c, d6736d01d2344089b7a9a4a1a1d83b8d; no voters:
I20260808 11:36:09.153882 12914 raft_consensus.cc:2781] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:36:09.154326 12914 raft_consensus.cc:686] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c [term 1 LEADER]: Becoming Leader. State: Replica: c9ee896fc5cd4d478d52ee2103af999c, State: Running, Role: LEADER
I20260808 11:36:09.154798 12914 consensus_queue.cc:237] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16bfd6968b064990af49f1793ba6c46d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45001 } } peers { permanent_uuid: "d6736d01d2344089b7a9a4a1a1d83b8d" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43059 } } peers { permanent_uuid: "c9ee896fc5cd4d478d52ee2103af999c" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 40917 } }
I20260808 11:36:09.159194 12398 catalog_manager.cc:5495] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c reported cstate change: term changed from 0 to 1, leader changed from <none> to c9ee896fc5cd4d478d52ee2103af999c (127.26.66.130). New cstate: current_term: 1 leader_uuid: "c9ee896fc5cd4d478d52ee2103af999c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16bfd6968b064990af49f1793ba6c46d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6736d01d2344089b7a9a4a1a1d83b8d" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9ee896fc5cd4d478d52ee2103af999c" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 40917 } health_report { overall_health: HEALTHY } } }
I20260808 11:36:09.198948 12905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:09.193158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37142 (local address 127.26.66.130:40917)
0808 11:36:09.193421 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:09.193427 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:09.193492 (+ 65us) server_negotiation.cc:407] Connection header received
0808 11:36:09.193744 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:09.193748 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:09.193838 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:09.193991 (+ 153us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:36:09.194377 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:09.195113 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:09.196743 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:09.197207 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:09.197363 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:09.197854 (+ 491us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:36:09.198323 (+ 469us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:36:09.198491 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:09.198570 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 11:36:09.198652 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260808 11:36:09.206909 12838 raft_consensus.cc:1261] T 58b9d50c007d4d4680eeabbbeab8d7e1 P d6736d01d2344089b7a9a4a1a1d83b8d [term 1 FOLLOWER]: Refusing update from remote peer c9ee896fc5cd4d478d52ee2103af999c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:36:09.206969 12553 raft_consensus.cc:1261] T 58b9d50c007d4d4680eeabbbeab8d7e1 P 16bfd6968b064990af49f1793ba6c46d [term 1 FOLLOWER]: Refusing update from remote peer c9ee896fc5cd4d478d52ee2103af999c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:36:09.207938 12920 consensus_queue.cc:1035] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6736d01d2344089b7a9a4a1a1d83b8d" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 43059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:36:09.208256 12914 consensus_queue.cc:1035] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16bfd6968b064990af49f1793ba6c46d" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:36:09.229694 12925 mvcc.cc:205] Tried to move back new op lower bound from 7316230017862496256 to 7316230017661722624. Current Snapshot: MvccSnapshot[applied={T|T < 7316230017862496256}]
I20260808 11:36:09.233830 12397 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:36:09.234160 12397 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:36:09.238119 12397 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 19b0c9e6348641d29874f48b9f32ba91: Sending DeleteTablet for 3 replicas of tablet 58b9d50c007d4d4680eeabbbeab8d7e1
I20260808 11:36:09.239356 12529 tablet_service.cc:1514] Processing DeleteTablet for tablet 58b9d50c007d4d4680eeabbbeab8d7e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:36:09 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:50234
I20260808 11:36:09.239421 12676 tablet_service.cc:1514] Processing DeleteTablet for tablet 58b9d50c007d4d4680eeabbbeab8d7e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:36:09 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:37140
I20260808 11:36:09.239446 12817 tablet_service.cc:1514] Processing DeleteTablet for tablet 58b9d50c007d4d4680eeabbbeab8d7e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:36:09 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:47882
I20260808 11:36:09.243767 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 12461
I20260808 11:36:09.248561 12934 tablet_replica.cc:330] T 58b9d50c007d4d4680eeabbbeab8d7e1 P d6736d01d2344089b7a9a4a1a1d83b8d: stopping tablet replica
I20260808 11:36:09.250036 12934 raft_consensus.cc:2229] T 58b9d50c007d4d4680eeabbbeab8d7e1 P d6736d01d2344089b7a9a4a1a1d83b8d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:36:09.252820 12934 raft_consensus.cc:2258] T 58b9d50c007d4d4680eeabbbeab8d7e1 P d6736d01d2344089b7a9a4a1a1d83b8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:36:09.255206 12934 ts_tablet_manager.cc:1905] T 58b9d50c007d4d4680eeabbbeab8d7e1 P d6736d01d2344089b7a9a4a1a1d83b8d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:36:09.255862 12932 tablet_replica.cc:330] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c: stopping tablet replica
I20260808 11:36:09.259737 12932 raft_consensus.cc:2229] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c [term 1 LEADER]: Raft consensus shutting down.
I20260808 11:36:09.260481 12932 raft_consensus.cc:2258] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:36:09.261476 12933 tablet_replica.cc:330] T 58b9d50c007d4d4680eeabbbeab8d7e1 P 16bfd6968b064990af49f1793ba6c46d: stopping tablet replica
I20260808 11:36:09.261890 12933 raft_consensus.cc:2229] T 58b9d50c007d4d4680eeabbbeab8d7e1 P 16bfd6968b064990af49f1793ba6c46d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:36:09.262456 12933 raft_consensus.cc:2258] T 58b9d50c007d4d4680eeabbbeab8d7e1 P 16bfd6968b064990af49f1793ba6c46d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:36:09.264739 12933 ts_tablet_manager.cc:1905] T 58b9d50c007d4d4680eeabbbeab8d7e1 P 16bfd6968b064990af49f1793ba6c46d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:36:09.266907 12932 ts_tablet_manager.cc:1905] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 11:36:09 dist-test-slave-zkpd krb5kdc[12352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188966, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.129@KRBTEST.COM
I20260808 11:36:09.268603 12934 ts_tablet_manager.cc:1918] T 58b9d50c007d4d4680eeabbbeab8d7e1 P d6736d01d2344089b7a9a4a1a1d83b8d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:36:09.268815 12934 log.cc:1196] T 58b9d50c007d4d4680eeabbbeab8d7e1 P d6736d01d2344089b7a9a4a1a1d83b8d: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-2/wal/wals/58b9d50c007d4d4680eeabbbeab8d7e1
I20260808 11:36:09.269461 12934 ts_tablet_manager.cc:1939] T 58b9d50c007d4d4680eeabbbeab8d7e1 P d6736d01d2344089b7a9a4a1a1d83b8d: Deleting consensus metadata
I20260808 11:36:09.271821 12386 catalog_manager.cc:4841] TS d6736d01d2344089b7a9a4a1a1d83b8d (127.26.66.131:43059): tablet 58b9d50c007d4d4680eeabbbeab8d7e1 (table test-table [id=669ff4142d6643f88faf531a2369f470]) successfully deleted
I20260808 11:36:09.272835 12933 ts_tablet_manager.cc:1918] T 58b9d50c007d4d4680eeabbbeab8d7e1 P 16bfd6968b064990af49f1793ba6c46d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:36:09.273020 12933 log.cc:1196] T 58b9d50c007d4d4680eeabbbeab8d7e1 P 16bfd6968b064990af49f1793ba6c46d: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-0/wal/wals/58b9d50c007d4d4680eeabbbeab8d7e1
I20260808 11:36:09.273541 12933 ts_tablet_manager.cc:1939] T 58b9d50c007d4d4680eeabbbeab8d7e1 P 16bfd6968b064990af49f1793ba6c46d: Deleting consensus metadata
I20260808 11:36:09.274127 12932 ts_tablet_manager.cc:1918] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:36:09.274296 12932 log.cc:1196] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786188664137852-26890-0/minicluster-data/ts-1/wal/wals/58b9d50c007d4d4680eeabbbeab8d7e1
I20260808 11:36:09.274916 12932 ts_tablet_manager.cc:1939] T 58b9d50c007d4d4680eeabbbeab8d7e1 P c9ee896fc5cd4d478d52ee2103af999c: Deleting consensus metadata
I20260808 11:36:09.275521 12384 catalog_manager.cc:4841] TS 16bfd6968b064990af49f1793ba6c46d (127.26.66.129:45001): tablet 58b9d50c007d4d4680eeabbbeab8d7e1 (table test-table [id=669ff4142d6643f88faf531a2369f470]) successfully deleted
I20260808 11:36:09.276671 12384 catalog_manager.cc:4841] TS c9ee896fc5cd4d478d52ee2103af999c (127.26.66.130:40917): tablet 58b9d50c007d4d4680eeabbbeab8d7e1 (table test-table [id=669ff4142d6643f88faf531a2369f470]) successfully deleted
I20260808 11:36:09.277788 12901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:09.248229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50242 (local address 127.26.66.129:45001)
0808 11:36:09.248463 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:09.248472 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:09.249312 (+ 840us) server_negotiation.cc:407] Connection header received
0808 11:36:09.250347 (+ 1035us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:09.250354 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:09.250438 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:09.250524 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:09.256082 (+ 5558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:09.257327 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:09.259368 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:09.260687 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:09.260863 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:09.269458 (+ 8595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:09.269476 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:09.269496 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:09.269565 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:09.274171 (+ 4606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:09.275366 (+ 1195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:09.275375 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:09.275380 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:09.275556 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:09.276140 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:09.276144 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:09.276149 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:09.276640 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:09.276966 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:09.277318 (+ 352us) server_negotiation.cc:299] Negotiation successful
0808 11:36:09.277484 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 11:36:09.278580 12597 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:09.370180 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 12461
I20260808 11:36:09.392277 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 12608
Aug 08 11:36:09 dist-test-slave-zkpd krb5kdc[12352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188966, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.130@KRBTEST.COM
I20260808 11:36:09.409951 12905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:09.393134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37144 (local address 127.26.66.130:40917)
0808 11:36:09.393307 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:09.393314 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:09.393387 (+ 73us) server_negotiation.cc:407] Connection header received
0808 11:36:09.393582 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:09.393588 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:09.393662 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:09.393797 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:09.395093 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:09.395877 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:09.397519 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:09.397979 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:09.398121 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:09.402966 (+ 4845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:09.402986 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:09.403007 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:09.403050 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:09.407145 (+ 4095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:09.407794 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:09.407804 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:09.407808 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:09.408002 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:09.408377 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:09.408383 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:09.408387 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:09.408830 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:09.409172 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:09.409325 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 11:36:09.409558 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 11:36:09.410774 12738 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:09.532191 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 12608
I20260808 11:36:09.558405 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 12750
Aug 08 11:36:09 dist-test-slave-zkpd krb5kdc[12352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188966, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.131@KRBTEST.COM
I20260808 11:36:09.574288 12903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:09.559242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47890 (local address 127.26.66.131:43059)
0808 11:36:09.559425 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:09.559429 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:09.559449 (+ 20us) server_negotiation.cc:407] Connection header received
0808 11:36:09.559589 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:09.559593 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:09.559667 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:09.559793 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:09.561357 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:09.562084 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:09.563394 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:09.563829 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:09.564142 (+ 313us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:09.568432 (+ 4290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:09.568447 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:09.568463 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:09.568503 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:09.571390 (+ 2887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:09.572306 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:09.572314 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:09.572316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:09.572458 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:09.572910 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:09.572913 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:09.572915 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:09.573285 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:09.573511 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:09.573868 (+ 357us) server_negotiation.cc:299] Negotiation successful
0808 11:36:09.574029 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 11:36:09.574939 12881 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:09.665400 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 12750
I20260808 11:36:09.687104 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 12366
I20260808 11:36:09.688396 12429 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:09.802032 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 12366
2026-08-08T11:36:09Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4779 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T11:36:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:36:09Z Disabled control of system clock
I20260808 11:36:09.900791 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:42715
--webserver_interface=127.26.66.190
--webserver_port=0
--builtin_ntp_servers=127.26.66.148:39819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:42715
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 11:36:10.246374 12945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:10.246656 12945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:10.246798 12945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:10.254216 12945 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:36:10.254354 12945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:10.254427 12945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:10.254529 12945 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:36:10.254593 12945 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:36:10.263948 12945 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:39819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:42715
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:42715
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:10.265254 12945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:10.267077 12945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:10.279364 12950 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:10.279452 12951 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:10.279413 12953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:10.280265 12945 server_base.cc:1034] running on GCE node
I20260808 11:36:10.281057 12945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:10.282521 12945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:10.283759 12945 hybrid_clock.cc:648] HybridClock initialized: now 1786188970283703 us; error 53 us; skew 500 ppm
I20260808 11:36:10.284168 12945 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:36:10.291245 12945 webserver.cc:460] Webserver started at http://127.26.66.190:32881/ using document root <none> and password file <none>
I20260808 11:36:10.292047 12945 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:10.292184 12945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:10.292536 12945 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:10.295485 12945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "ef1cce792ff94351962f5d6fb5016c66"
format_stamp: "Formatted at 2026-08-08 11:36:10 on dist-test-slave-zkpd"
server_key: "45b59ed571a9af9bd398ac41dc3bdabd"
server_key_iv: "f7250477a9bd8635000996c06e1e2fcf"
server_key_version: "encryptionkey@0"
I20260808 11:36:10.296373 12945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "ef1cce792ff94351962f5d6fb5016c66"
format_stamp: "Formatted at 2026-08-08 11:36:10 on dist-test-slave-zkpd"
server_key: "45b59ed571a9af9bd398ac41dc3bdabd"
server_key_iv: "f7250477a9bd8635000996c06e1e2fcf"
server_key_version: "encryptionkey@0"
I20260808 11:36:10.301576 12945 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260808 11:36:10.304925 12959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:10.306190 12945 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 11:36:10.306393 12945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "ef1cce792ff94351962f5d6fb5016c66"
format_stamp: "Formatted at 2026-08-08 11:36:10 on dist-test-slave-zkpd"
server_key: "45b59ed571a9af9bd398ac41dc3bdabd"
server_key_iv: "f7250477a9bd8635000996c06e1e2fcf"
server_key_version: "encryptionkey@0"
I20260808 11:36:10.306610 12945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:10.327674 12945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:10.328579 12945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:10.328881 12945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:10.348148 12945 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:42715
I20260808 11:36:10.348169 13012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:42715 every 8 connection(s)
I20260808 11:36:10.349488 12945 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:36:10.351182 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 12945
I20260808 11:36:10.351389 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:36:10.351933 26890 external_mini_cluster.cc:1428] Setting key 6f9fb4ff5b8385b1f9b2866bf611f097
I20260808 11:36:10.353878 13013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:10.367681 13016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:10.353960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57452 (local address 127.26.66.190:42715)
0808 11:36:10.355053 (+ 1093us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:10.355067 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:10.355120 (+ 53us) server_negotiation.cc:407] Connection header received
0808 11:36:10.357175 (+ 2055us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:10.357202 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:10.357820 (+ 618us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:10.358252 (+ 432us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:10.358793 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:10.360859 (+ 2066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:10.362271 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:10.363323 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:10.363502 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:10.364667 (+ 1165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:10.364679 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:10.364701 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:10.365459 (+ 758us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:10.365554 (+ 95us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:10.365587 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:10.365717 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:10.366103 (+ 386us) server_negotiation.cc:299] Negotiation successful
0808 11:36:10.366431 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":582,"thread_start_us":356,"threads_started":1}
I20260808 11:36:10.368590 13013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef1cce792ff94351962f5d6fb5016c66: Bootstrap starting.
I20260808 11:36:10.371596 13013 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef1cce792ff94351962f5d6fb5016c66: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:10.372624 13013 log.cc:824] T 00000000000000000000000000000000 P ef1cce792ff94351962f5d6fb5016c66: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:10.375463 13013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef1cce792ff94351962f5d6fb5016c66: No bootstrap required, opened a new log
I20260808 11:36:10.382769 13013 raft_consensus.cc:348] T 00000000000000000000000000000000 P ef1cce792ff94351962f5d6fb5016c66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef1cce792ff94351962f5d6fb5016c66" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42715 } }
I20260808 11:36:10.383147 13013 raft_consensus.cc:374] T 00000000000000000000000000000000 P ef1cce792ff94351962f5d6fb5016c66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:10.383263 13013 raft_consensus.cc:729] T 00000000000000000000000000000000 P ef1cce792ff94351962f5d6fb5016c66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1cce792ff94351962f5d6fb5016c66, State: Initialized, Role: FOLLOWER
I20260808 11:36:10.383805 13013 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef1cce792ff94351962f5d6fb5016c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef1cce792ff94351962f5d6fb5016c66" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42715 } }
I20260808 11:36:10.384094 13013 raft_consensus.cc:388] T 00000000000000000000000000000000 P ef1cce792ff94351962f5d6fb5016c66 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:36:10.384264 13013 raft_consensus.cc:482] T 00000000000000000000000000000000 P ef1cce792ff94351962f5d6fb5016c66 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:36:10.384451 13013 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ef1cce792ff94351962f5d6fb5016c66 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:10.386603 13013 raft_consensus.cc:504] T 00000000000000000000000000000000 P ef1cce792ff94351962f5d6fb5016c66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef1cce792ff94351962f5d6fb5016c66" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42715 } }
I20260808 11:36:10.387089 13013 leader_election.cc:302] T 00000000000000000000000000000000 P ef1cce792ff94351962f5d6fb5016c66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ef1cce792ff94351962f5d6fb5016c66; no voters:
I20260808 11:36:10.387669 13013 leader_election.cc:288] T 00000000000000000000000000000000 P ef1cce792ff94351962f5d6fb5016c66 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:36:10.387832 13018 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ef1cce792ff94351962f5d6fb5016c66 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:36:10.388676 13018 raft_consensus.cc:686] T 00000000000000000000000000000000 P ef1cce792ff94351962f5d6fb5016c66 [term 1 LEADER]: Becoming Leader. State: Replica: ef1cce792ff94351962f5d6fb5016c66, State: Running, Role: LEADER
I20260808 11:36:10.389226 13018 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef1cce792ff94351962f5d6fb5016c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef1cce792ff94351962f5d6fb5016c66" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42715 } }
I20260808 11:36:10.389818 13013 sys_catalog.cc:564] T 00000000000000000000000000000000 P ef1cce792ff94351962f5d6fb5016c66 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:36:10.392207 13020 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef1cce792ff94351962f5d6fb5016c66 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef1cce792ff94351962f5d6fb5016c66. Latest consensus state: current_term: 1 leader_uuid: "ef1cce792ff94351962f5d6fb5016c66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef1cce792ff94351962f5d6fb5016c66" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42715 } } }
I20260808 11:36:10.392210 13019 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef1cce792ff94351962f5d6fb5016c66 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ef1cce792ff94351962f5d6fb5016c66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef1cce792ff94351962f5d6fb5016c66" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 42715 } } }
I20260808 11:36:10.392779 13020 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef1cce792ff94351962f5d6fb5016c66 [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:10.392772 13019 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef1cce792ff94351962f5d6fb5016c66 [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:10.397747 13024 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:36:10.401895 13024 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:36:10.409907 13024 catalog_manager.cc:1347] Generated new cluster ID: 7a4d332baeca41609a0fba2819507ab6
I20260808 11:36:10.410091 13024 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:36:10.423122 13024 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:36:10.424674 13024 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:36:10.430718 13024 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ef1cce792ff94351962f5d6fb5016c66: Generated new TSK 0
I20260808 11:36:10.431658 13024 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:36:10.439857 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:0
--local_ip_for_outbound_sockets=127.26.66.129
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:42715
--builtin_ntp_servers=127.26.66.148:39819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 11:36:10.793834 13038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:10.794188 13038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:10.794345 13038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:10.801728 13038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:10.801841 13038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:10.801949 13038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:36:10.811151 13038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:39819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:42715
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:10.812395 13038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:10.814216 13038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:10.826856 13043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:10.826970 13047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:10.826970 13044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:10.828061 13038 server_base.cc:1034] running on GCE node
I20260808 11:36:10.828601 13038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:10.829478 13038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:10.830677 13038 hybrid_clock.cc:648] HybridClock initialized: now 1786188970830638 us; error 28 us; skew 500 ppm
I20260808 11:36:10.830986 13038 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:36:10.833326 13038 webserver.cc:460] Webserver started at http://127.26.66.129:43015/ using document root <none> and password file <none>
I20260808 11:36:10.834025 13038 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:10.834146 13038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:10.834491 13038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:10.837364 13038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-0/data/instance:
uuid: "314680af6a3841f7b37f5d6b8f6f1873"
format_stamp: "Formatted at 2026-08-08 11:36:10 on dist-test-slave-zkpd"
server_key: "7976fedb14b5b14e540796cc053a2f1f"
server_key_iv: "c65a5fb6a2bcd9fb8c7519d4808d353c"
server_key_version: "encryptionkey@0"
I20260808 11:36:10.838150 13038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance:
uuid: "314680af6a3841f7b37f5d6b8f6f1873"
format_stamp: "Formatted at 2026-08-08 11:36:10 on dist-test-slave-zkpd"
server_key: "7976fedb14b5b14e540796cc053a2f1f"
server_key_iv: "c65a5fb6a2bcd9fb8c7519d4808d353c"
server_key_version: "encryptionkey@0"
I20260808 11:36:10.843070 13038 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 11:36:10.846469 13054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:10.847815 13038 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 11:36:10.848021 13038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "314680af6a3841f7b37f5d6b8f6f1873"
format_stamp: "Formatted at 2026-08-08 11:36:10 on dist-test-slave-zkpd"
server_key: "7976fedb14b5b14e540796cc053a2f1f"
server_key_iv: "c65a5fb6a2bcd9fb8c7519d4808d353c"
server_key_version: "encryptionkey@0"
I20260808 11:36:10.848253 13038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:10.876618 13038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:10.877487 13038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:10.877794 13038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:10.878777 13038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:36:10.880290 13038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:36:10.880420 13038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:10.880553 13038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:36:10.880642 13038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:10.914480 13038 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:38625
I20260808 11:36:10.914566 13171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:38625 every 8 connection(s)
I20260808 11:36:10.915791 13038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:36:10.925791 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 13038
I20260808 11:36:10.925989 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance
I20260808 11:36:10.926513 26890 external_mini_cluster.cc:1428] Setting key 535cd4f13e9f9b647e2dbce62f100535
I20260808 11:36:10.928682 13174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:10.918378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:35221 (local address 127.26.66.190:42715)
0808 11:36:10.918860 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:10.918865 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:10.919862 (+ 997us) server_negotiation.cc:407] Connection header received
0808 11:36:10.921727 (+ 1865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:10.921733 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:10.921830 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:10.921956 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:10.923028 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:10.923772 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:10.925394 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:10.926052 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:10.926184 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:10.927685 (+ 1501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:10.927692 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:10.927736 (+ 44us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:10.927759 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:10.927813 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:10.927830 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:10.927958 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:10.928190 (+ 232us) server_negotiation.cc:299] Negotiation successful
0808 11:36:10.928287 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":274,"threads_started":1}
I20260808 11:36:10.929885 13175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:10.918812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42715 (local address 127.26.66.129:35221)
0808 11:36:10.919690 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:10.919732 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:10.921451 (+ 1719us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:10.922195 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:10.922203 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:10.922286 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:36:10.922847 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:10.922869 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:10.923968 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:10.923973 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:10.925226 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:10.925239 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:10.926299 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:10.926305 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:10.926508 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:10.927302 (+ 794us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 11:36:10.927305 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:36:10.927365 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 11:36:10.927459 (+ 94us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:36:10.927980 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:36:10.927989 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:36:10.927995 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 11:36:10.928140 (+ 145us) client_negotiation.cc:240] Negotiation successful
0808 11:36:10.928519 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":272,"threads_started":1}
I20260808 11:36:10.929886 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:0
--local_ip_for_outbound_sockets=127.26.66.130
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:42715
--builtin_ntp_servers=127.26.66.148:39819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 11:36:10.931670 13172 heartbeater.cc:347] Connected to a master server at 127.26.66.190:42715
I20260808 11:36:10.932022 13172 heartbeater.cc:464] Registering TS with master...
I20260808 11:36:10.932936 13172 heartbeater.cc:511] Master 127.26.66.190:42715 requested a full tablet report, sending...
I20260808 11:36:10.934996 12976 ts_manager.cc:194] Registered new tserver with Master: 314680af6a3841f7b37f5d6b8f6f1873 (127.26.66.129:38625)
I20260808 11:36:10.936532 12976 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.66.129:35221
W20260808 11:36:11.277747 13176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:11.278004 13176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:11.278147 13176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:11.285364 13176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:11.285454 13176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:11.285633 13176 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:36:11.294783 13176 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:39819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:42715
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:11.296159 13176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:11.297982 13176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:11.311498 13181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:11.311583 13183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:11.311499 13185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:11.312641 13176 server_base.cc:1034] running on GCE node
I20260808 11:36:11.313269 13176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:11.314189 13176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:11.315434 13176 hybrid_clock.cc:648] HybridClock initialized: now 1786188971315394 us; error 52 us; skew 500 ppm
I20260808 11:36:11.315784 13176 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:36:11.318117 13176 webserver.cc:460] Webserver started at http://127.26.66.130:37265/ using document root <none> and password file <none>
I20260808 11:36:11.318811 13176 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:11.318957 13176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:11.319293 13176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:11.322140 13176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-1/data/instance:
uuid: "b2cb5f609d974242b5d314655a1853ea"
format_stamp: "Formatted at 2026-08-08 11:36:11 on dist-test-slave-zkpd"
server_key: "c52414d9079b32726ce73e4c3f6e1f60"
server_key_iv: "c0fe75bd119b5916f540e0b816e799f1"
server_key_version: "encryptionkey@0"
I20260808 11:36:11.322955 13176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance:
uuid: "b2cb5f609d974242b5d314655a1853ea"
format_stamp: "Formatted at 2026-08-08 11:36:11 on dist-test-slave-zkpd"
server_key: "c52414d9079b32726ce73e4c3f6e1f60"
server_key_iv: "c0fe75bd119b5916f540e0b816e799f1"
server_key_version: "encryptionkey@0"
I20260808 11:36:11.328079 13176 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 11:36:11.331503 13192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:11.332871 13176 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:36:11.333050 13176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "b2cb5f609d974242b5d314655a1853ea"
format_stamp: "Formatted at 2026-08-08 11:36:11 on dist-test-slave-zkpd"
server_key: "c52414d9079b32726ce73e4c3f6e1f60"
server_key_iv: "c0fe75bd119b5916f540e0b816e799f1"
server_key_version: "encryptionkey@0"
I20260808 11:36:11.333271 13176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:11.348484 13176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:11.349309 13176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:11.349620 13176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:11.350598 13176 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:36:11.352273 13176 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:36:11.352394 13176 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:11.352527 13176 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:36:11.352623 13176 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:11.387605 13176 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:42019
I20260808 11:36:11.387661 13321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:42019 every 8 connection(s)
I20260808 11:36:11.388962 13176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:36:11.394021 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 13176
I20260808 11:36:11.394207 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance
I20260808 11:36:11.394698 26890 external_mini_cluster.cc:1428] Setting key ef0e3ef32db1185846cd14661544354a
I20260808 11:36:11.397558 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:0
--local_ip_for_outbound_sockets=127.26.66.131
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:42715
--builtin_ntp_servers=127.26.66.148:39819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 11:36:11.401784 13174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:11.391760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:48255 (local address 127.26.66.190:42715)
0808 11:36:11.392017 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:11.392022 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:11.393290 (+ 1268us) server_negotiation.cc:407] Connection header received
0808 11:36:11.395346 (+ 2056us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:11.395351 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:11.395474 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:11.395581 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:11.396691 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:11.397408 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:11.399042 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:11.399432 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:11.399569 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:11.400997 (+ 1428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:11.401002 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:11.401005 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:11.401022 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:11.401054 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:11.401065 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:11.401163 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:11.401389 (+ 226us) server_negotiation.cc:299] Negotiation successful
0808 11:36:11.401483 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 11:36:11.402783 13324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:11.392264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42715 (local address 127.26.66.130:48255)
0808 11:36:11.393129 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:11.393174 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:11.395068 (+ 1894us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:11.395816 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:11.395824 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:11.395953 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:36:11.396522 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:11.396539 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:11.397562 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:11.397568 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:11.398892 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:11.398905 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:11.399653 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:11.399659 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:11.399884 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:11.400675 (+ 791us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 11:36:11.400678 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:36:11.400712 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 11:36:11.400781 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:36:11.401164 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:36:11.401177 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:36:11.401187 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 11:36:11.401360 (+ 173us) client_negotiation.cc:240] Negotiation successful
0808 11:36:11.401712 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":279,"threads_started":1}
I20260808 11:36:11.404243 13322 heartbeater.cc:347] Connected to a master server at 127.26.66.190:42715
I20260808 11:36:11.404565 13322 heartbeater.cc:464] Registering TS with master...
I20260808 11:36:11.405285 13322 heartbeater.cc:511] Master 127.26.66.190:42715 requested a full tablet report, sending...
I20260808 11:36:11.406715 12976 ts_manager.cc:194] Registered new tserver with Master: b2cb5f609d974242b5d314655a1853ea (127.26.66.130:42019)
I20260808 11:36:11.407944 12976 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.66.130:48255
W20260808 11:36:11.744169 13325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:11.744424 13325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:11.744508 13325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:11.751518 13325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:11.751601 13325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:11.751765 13325 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:36:11.760887 13325 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:39819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:42715
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:11.762042 13325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:11.763746 13325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:11.776671 13332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:11.776744 13331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:11.776703 13334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:11.778008 13325 server_base.cc:1034] running on GCE node
I20260808 11:36:11.778609 13325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:11.779587 13325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:11.780834 13325 hybrid_clock.cc:648] HybridClock initialized: now 1786188971780734 us; error 82 us; skew 500 ppm
I20260808 11:36:11.781162 13325 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:36:11.783403 13325 webserver.cc:460] Webserver started at http://127.26.66.131:43317/ using document root <none> and password file <none>
I20260808 11:36:11.784200 13325 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:11.784336 13325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:11.784658 13325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:11.787496 13325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-2/data/instance:
uuid: "c02874173075402083c3f8bf98ee4fa6"
format_stamp: "Formatted at 2026-08-08 11:36:11 on dist-test-slave-zkpd"
server_key: "d833fc97ae74dec0f5f63f4375965945"
server_key_iv: "1f2f7a181d26a48880e2f1c286a65886"
server_key_version: "encryptionkey@0"
I20260808 11:36:11.788332 13325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance:
uuid: "c02874173075402083c3f8bf98ee4fa6"
format_stamp: "Formatted at 2026-08-08 11:36:11 on dist-test-slave-zkpd"
server_key: "d833fc97ae74dec0f5f63f4375965945"
server_key_iv: "1f2f7a181d26a48880e2f1c286a65886"
server_key_version: "encryptionkey@0"
I20260808 11:36:11.793533 13325 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 11:36:11.797279 13340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:11.798494 13325 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:36:11.798663 13325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "c02874173075402083c3f8bf98ee4fa6"
format_stamp: "Formatted at 2026-08-08 11:36:11 on dist-test-slave-zkpd"
server_key: "d833fc97ae74dec0f5f63f4375965945"
server_key_iv: "1f2f7a181d26a48880e2f1c286a65886"
server_key_version: "encryptionkey@0"
I20260808 11:36:11.798884 13325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:11.825074 13325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:11.825882 13325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:11.826197 13325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:11.827172 13325 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:36:11.828702 13325 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:36:11.828845 13325 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:11.828971 13325 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:36:11.829064 13325 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:11.863521 13325 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:35669
I20260808 11:36:11.863615 13459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:35669 every 8 connection(s)
I20260808 11:36:11.864970 13325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:36:11.871343 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 13325
I20260808 11:36:11.871554 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance
I20260808 11:36:11.872133 26890 external_mini_cluster.cc:1428] Setting key f219d6bd845ef4eadfdc15695fbc736f
I20260808 11:36:11.878075 13174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:11.867828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:35593 (local address 127.26.66.190:42715)
0808 11:36:11.868069 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:11.868075 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:11.869432 (+ 1357us) server_negotiation.cc:407] Connection header received
0808 11:36:11.871243 (+ 1811us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:11.871249 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:11.871345 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:11.871460 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:11.872795 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:11.873573 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:11.875125 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:11.875534 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:11.875670 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:11.877188 (+ 1518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:11.877194 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:11.877199 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:11.877218 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:11.877261 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:11.877278 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:11.877384 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:11.877627 (+ 243us) server_negotiation.cc:299] Negotiation successful
0808 11:36:11.877739 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260808 11:36:11.879091 13462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:11.868359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:42715 (local address 127.26.66.131:35593)
0808 11:36:11.869258 (+ 899us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:11.869296 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:11.870955 (+ 1659us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:11.871702 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:11.871713 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:11.871820 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:36:11.872614 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:11.872633 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:11.873738 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:11.873744 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:11.874970 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:11.874983 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:11.875765 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:11.875772 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:11.876074 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:11.876834 (+ 760us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 11:36:11.876837 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:36:11.876877 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 11:36:11.876956 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:36:11.877386 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:36:11.877400 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:36:11.877410 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 11:36:11.877594 (+ 184us) client_negotiation.cc:240] Negotiation successful
0808 11:36:11.877989 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":278,"threads_started":1}
I20260808 11:36:11.880415 13460 heartbeater.cc:347] Connected to a master server at 127.26.66.190:42715
I20260808 11:36:11.880730 13460 heartbeater.cc:464] Registering TS with master...
I20260808 11:36:11.881449 13460 heartbeater.cc:511] Master 127.26.66.190:42715 requested a full tablet report, sending...
I20260808 11:36:11.882853 12976 ts_manager.cc:194] Registered new tserver with Master: c02874173075402083c3f8bf98ee4fa6 (127.26.66.131:35669)
I20260808 11:36:11.883581 12976 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.66.131:35593
I20260808 11:36:11.887336 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 11:36:11.897673 13174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:11.891601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57468 (local address 127.26.66.190:42715)
0808 11:36:11.891913 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:11.891919 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:11.892248 (+ 329us) server_negotiation.cc:407] Connection header received
0808 11:36:11.892382 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:11.892386 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:11.892465 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:11.892547 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:11.893032 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:11.893715 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:11.895258 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:11.895708 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:11.895840 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:11.897005 (+ 1165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:11.897010 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:11.897014 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:11.897031 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:11.897061 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:11.897072 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:11.897143 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:11.897267 (+ 124us) server_negotiation.cc:299] Negotiation successful
0808 11:36:11.897341 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 11:36:11.901448 12976 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57468:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 11:36:11.908449 12976 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:36:11.934685 13472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:11.920768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:42019 (local address 127.0.0.1:49672)
0808 11:36:11.922275 (+ 1507us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:11.922327 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:11.922592 (+ 265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:11.923835 (+ 1243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:11.923845 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:11.923885 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:11.924481 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:11.924499 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:11.927112 (+ 2613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:11.927121 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:11.930344 (+ 3223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:11.930367 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:11.933367 (+ 3000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:11.933377 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:11.933677 (+ 300us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:11.933765 (+ 88us) client_negotiation.cc:769] Sending connection context
0808 11:36:11.933933 (+ 168us) client_negotiation.cc:240] Negotiation successful
0808 11:36:11.934185 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1260,"thread_start_us":1201,"threads_started":1}
I20260808 11:36:11.934785 13473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:11.920978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49672 (local address 127.26.66.130:42019)
0808 11:36:11.921739 (+ 761us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:11.921748 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:11.922435 (+ 687us) server_negotiation.cc:407] Connection header received
0808 11:36:11.922902 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:11.922914 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:11.923206 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:11.923417 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:11.924769 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:11.926858 (+ 2089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:11.930635 (+ 3777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:11.932663 (+ 2028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:11.932801 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:11.933106 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:11.934085 (+ 979us) server_negotiation.cc:299] Negotiation successful
0808 11:36:11.934319 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":1655,"threads_started":1}
I20260808 11:36:11.940053 13172 heartbeater.cc:503] Master 127.26.66.190:42715 was elected leader, sending a full tablet report...
I20260808 11:36:11.939493 13247 tablet_service.cc:1467] Processing CreateTablet for tablet 02b1c50900e0494c8ead5cbc907d370c (DEFAULT_TABLE table=test-table [id=67782f6dbb9447b3ab1e14ee02fcfb60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:36:11.941215 13247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02b1c50900e0494c8ead5cbc907d370c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:11.945719 13472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:11.921552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:35669 (local address 127.0.0.1:41282)
0808 11:36:11.935226 (+ 13674us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:11.935251 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:11.935383 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:11.936818 (+ 1435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:11.936823 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:11.936849 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:11.937025 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:11.937038 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:11.939304 (+ 2266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:11.939312 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:11.943237 (+ 3925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:11.943254 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:11.944880 (+ 1626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:11.944888 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:11.945114 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:11.945148 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 11:36:11.945253 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 11:36:11.945407 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13518,"thread_start_us":21837,"threads_started":1}
I20260808 11:36:11.946854 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:11.922310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41282 (local address 127.26.66.131:35669)
0808 11:36:11.936138 (+ 13828us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:11.936151 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:11.936196 (+ 45us) server_negotiation.cc:407] Connection header received
0808 11:36:11.936338 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:11.936350 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:11.936598 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:11.937277 (+ 679us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:11.937613 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:11.939114 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:11.943453 (+ 4339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:11.944636 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:11.944842 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:11.945128 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:11.946296 (+ 1168us) server_negotiation.cc:299] Negotiation successful
0808 11:36:11.946482 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13597,"thread_start_us":13371,"threads_started":1}
I20260808 11:36:11.950241 13392 tablet_service.cc:1467] Processing CreateTablet for tablet 02b1c50900e0494c8ead5cbc907d370c (DEFAULT_TABLE table=test-table [id=67782f6dbb9447b3ab1e14ee02fcfb60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:36:11.951788 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:11.921440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:38625 (local address 127.0.0.1:39602)
0808 11:36:11.932834 (+ 11394us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:11.932857 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:11.932994 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:11.944569 (+ 11575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:11.944574 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:11.944601 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:11.945012 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:11.945027 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:11.946718 (+ 1691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:11.946726 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:11.948361 (+ 1635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:11.948377 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:11.950669 (+ 2292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:11.950675 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:11.951206 (+ 531us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:11.951237 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 11:36:11.951342 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 11:36:11.951492 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11232,"thread_start_us":11649,"threads_started":1}
I20260808 11:36:11.951845 13392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02b1c50900e0494c8ead5cbc907d370c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:11.951969 13476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:11.921746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39602 (local address 127.26.66.129:38625)
0808 11:36:11.943993 (+ 22247us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:11.944001 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:11.944028 (+ 27us) server_negotiation.cc:407] Connection header received
0808 11:36:11.944113 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:11.944122 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:11.944362 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:11.944550 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:11.945233 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:11.946591 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:11.948571 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:11.950009 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:11.950165 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:11.950433 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:11.951405 (+ 972us) server_negotiation.cc:299] Negotiation successful
0808 11:36:11.951582 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22061,"thread_start_us":21914,"threads_started":1}
I20260808 11:36:11.955226 13478 tablet_bootstrap.cc:492] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea: Bootstrap starting.
I20260808 11:36:11.959062 13478 tablet_bootstrap.cc:654] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:11.958896 13104 tablet_service.cc:1467] Processing CreateTablet for tablet 02b1c50900e0494c8ead5cbc907d370c (DEFAULT_TABLE table=test-table [id=67782f6dbb9447b3ab1e14ee02fcfb60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:36:11.960390 13478 log.cc:824] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:11.960457 13104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02b1c50900e0494c8ead5cbc907d370c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:11.963503 13478 tablet_bootstrap.cc:492] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea: No bootstrap required, opened a new log
I20260808 11:36:11.963773 13478 ts_tablet_manager.cc:1397] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260808 11:36:11.965353 13480 tablet_bootstrap.cc:492] T 02b1c50900e0494c8ead5cbc907d370c P c02874173075402083c3f8bf98ee4fa6: Bootstrap starting.
I20260808 11:36:11.968294 13480 tablet_bootstrap.cc:654] T 02b1c50900e0494c8ead5cbc907d370c P c02874173075402083c3f8bf98ee4fa6: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:11.969308 13480 log.cc:824] T 02b1c50900e0494c8ead5cbc907d370c P c02874173075402083c3f8bf98ee4fa6: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:11.973970 13480 tablet_bootstrap.cc:492] T 02b1c50900e0494c8ead5cbc907d370c P c02874173075402083c3f8bf98ee4fa6: No bootstrap required, opened a new log
I20260808 11:36:11.974231 13480 ts_tablet_manager.cc:1397] T 02b1c50900e0494c8ead5cbc907d370c P c02874173075402083c3f8bf98ee4fa6: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260808 11:36:11.974610 13478 raft_consensus.cc:348] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cb5f609d974242b5d314655a1853ea" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 42019 } } peers { permanent_uuid: "c02874173075402083c3f8bf98ee4fa6" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 35669 } } peers { permanent_uuid: "314680af6a3841f7b37f5d6b8f6f1873" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 38625 } }
I20260808 11:36:11.975078 13478 raft_consensus.cc:374] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:11.975183 13478 raft_consensus.cc:729] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cb5f609d974242b5d314655a1853ea, State: Initialized, Role: FOLLOWER
I20260808 11:36:11.975406 13482 tablet_bootstrap.cc:492] T 02b1c50900e0494c8ead5cbc907d370c P 314680af6a3841f7b37f5d6b8f6f1873: Bootstrap starting.
I20260808 11:36:11.975971 13478 consensus_queue.cc:260] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cb5f609d974242b5d314655a1853ea" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 42019 } } peers { permanent_uuid: "c02874173075402083c3f8bf98ee4fa6" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 35669 } } peers { permanent_uuid: "314680af6a3841f7b37f5d6b8f6f1873" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 38625 } }
I20260808 11:36:11.977084 13322 heartbeater.cc:503] Master 127.26.66.190:42715 was elected leader, sending a full tablet report...
I20260808 11:36:11.977689 13478 ts_tablet_manager.cc:1428] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260808 11:36:11.979039 13482 tablet_bootstrap.cc:654] T 02b1c50900e0494c8ead5cbc907d370c P 314680af6a3841f7b37f5d6b8f6f1873: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:11.980363 13482 log.cc:824] T 02b1c50900e0494c8ead5cbc907d370c P 314680af6a3841f7b37f5d6b8f6f1873: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:11.983325 13482 tablet_bootstrap.cc:492] T 02b1c50900e0494c8ead5cbc907d370c P 314680af6a3841f7b37f5d6b8f6f1873: No bootstrap required, opened a new log
I20260808 11:36:11.983603 13482 ts_tablet_manager.cc:1397] T 02b1c50900e0494c8ead5cbc907d370c P 314680af6a3841f7b37f5d6b8f6f1873: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260808 11:36:11.984483 13480 raft_consensus.cc:348] T 02b1c50900e0494c8ead5cbc907d370c P c02874173075402083c3f8bf98ee4fa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cb5f609d974242b5d314655a1853ea" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 42019 } } peers { permanent_uuid: "c02874173075402083c3f8bf98ee4fa6" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 35669 } } peers { permanent_uuid: "314680af6a3841f7b37f5d6b8f6f1873" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 38625 } }
I20260808 11:36:11.984854 13480 raft_consensus.cc:374] T 02b1c50900e0494c8ead5cbc907d370c P c02874173075402083c3f8bf98ee4fa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:11.984965 13480 raft_consensus.cc:729] T 02b1c50900e0494c8ead5cbc907d370c P c02874173075402083c3f8bf98ee4fa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c02874173075402083c3f8bf98ee4fa6, State: Initialized, Role: FOLLOWER
I20260808 11:36:11.985572 13480 consensus_queue.cc:260] T 02b1c50900e0494c8ead5cbc907d370c P c02874173075402083c3f8bf98ee4fa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cb5f609d974242b5d314655a1853ea" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 42019 } } peers { permanent_uuid: "c02874173075402083c3f8bf98ee4fa6" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 35669 } } peers { permanent_uuid: "314680af6a3841f7b37f5d6b8f6f1873" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 38625 } }
I20260808 11:36:11.986698 13460 heartbeater.cc:503] Master 127.26.66.190:42715 was elected leader, sending a full tablet report...
I20260808 11:36:11.987222 13480 ts_tablet_manager.cc:1428] T 02b1c50900e0494c8ead5cbc907d370c P c02874173075402083c3f8bf98ee4fa6: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260808 11:36:11.991719 13482 raft_consensus.cc:348] T 02b1c50900e0494c8ead5cbc907d370c P 314680af6a3841f7b37f5d6b8f6f1873 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cb5f609d974242b5d314655a1853ea" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 42019 } } peers { permanent_uuid: "c02874173075402083c3f8bf98ee4fa6" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 35669 } } peers { permanent_uuid: "314680af6a3841f7b37f5d6b8f6f1873" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 38625 } }
I20260808 11:36:11.992156 13482 raft_consensus.cc:374] T 02b1c50900e0494c8ead5cbc907d370c P 314680af6a3841f7b37f5d6b8f6f1873 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:11.992261 13482 raft_consensus.cc:729] T 02b1c50900e0494c8ead5cbc907d370c P 314680af6a3841f7b37f5d6b8f6f1873 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314680af6a3841f7b37f5d6b8f6f1873, State: Initialized, Role: FOLLOWER
I20260808 11:36:11.992851 13482 consensus_queue.cc:260] T 02b1c50900e0494c8ead5cbc907d370c P 314680af6a3841f7b37f5d6b8f6f1873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cb5f609d974242b5d314655a1853ea" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 42019 } } peers { permanent_uuid: "c02874173075402083c3f8bf98ee4fa6" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 35669 } } peers { permanent_uuid: "314680af6a3841f7b37f5d6b8f6f1873" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 38625 } }
I20260808 11:36:11.994491 13482 ts_tablet_manager.cc:1428] T 02b1c50900e0494c8ead5cbc907d370c P 314680af6a3841f7b37f5d6b8f6f1873: Time spent starting tablet: real 0.011s user 0.008s sys 0.004s
W20260808 11:36:12.117026 13461 tablet.cc:2369] T 02b1c50900e0494c8ead5cbc907d370c P c02874173075402083c3f8bf98ee4fa6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 11:36:12.141124 13323 tablet.cc:2369] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:36:12.162531 13483 raft_consensus.cc:482] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:36:12.162861 13483 raft_consensus.cc:504] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cb5f609d974242b5d314655a1853ea" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 42019 } } peers { permanent_uuid: "c02874173075402083c3f8bf98ee4fa6" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 35669 } } peers { permanent_uuid: "314680af6a3841f7b37f5d6b8f6f1873" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 38625 } }
I20260808 11:36:12.164752 13483 leader_election.cc:288] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c02874173075402083c3f8bf98ee4fa6 (127.26.66.131:35669), 314680af6a3841f7b37f5d6b8f6f1873 (127.26.66.129:38625)
W20260808 11:36:12.168277 13173 tablet.cc:2369] T 02b1c50900e0494c8ead5cbc907d370c P 314680af6a3841f7b37f5d6b8f6f1873: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:36:12.172657 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:12.165235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:45305 (local address 127.26.66.131:35669)
0808 11:36:12.165518 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:12.165527 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:12.166429 (+ 902us) server_negotiation.cc:407] Connection header received
0808 11:36:12.166544 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:12.166548 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:12.166614 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:12.166745 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:12.167374 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:12.168183 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:12.170668 (+ 2485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:12.171595 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:12.171761 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:12.171812 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:12.172201 (+ 389us) server_negotiation.cc:299] Negotiation successful
0808 11:36:12.172365 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260808 11:36:12.172659 13487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:12.165012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:35669 (local address 127.26.66.130:45305)
0808 11:36:12.166290 (+ 1278us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:12.166307 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:12.166441 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:12.166829 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:12.166834 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:12.166865 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:12.167213 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:12.167223 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:12.168337 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:12.168344 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:12.170474 (+ 2130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:12.170486 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:12.171804 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:12.171819 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:12.172016 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:12.172064 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 11:36:12.172157 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 11:36:12.172294 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1175,"mutex_wait_us":45,"thread_start_us":921,"threads_started":1}
I20260808 11:36:12.172950 13476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:12.165208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:56631 (local address 127.26.66.129:38625)
0808 11:36:12.165470 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:12.165494 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:12.166789 (+ 1295us) server_negotiation.cc:407] Connection header received
0808 11:36:12.166980 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:12.166989 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:12.167060 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:12.167163 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:12.167732 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:12.168850 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:12.171053 (+ 2203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:12.171991 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:12.172162 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:12.172226 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:12.172577 (+ 351us) server_negotiation.cc:299] Negotiation successful
0808 11:36:12.172732 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 11:36:12.173171 13488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:12.165212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:38625 (local address 127.26.66.130:56631)
0808 11:36:12.166685 (+ 1473us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:12.166698 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:12.166833 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:12.167186 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:12.167190 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:12.167220 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:12.167578 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:12.167587 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:12.169065 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:12.169071 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:12.170864 (+ 1793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:12.170877 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:12.172200 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:12.172207 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:12.172384 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:12.172417 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 11:36:12.172522 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 11:36:12.172653 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1391,"mutex_wait_us":36,"thread_start_us":676,"threads_started":1}
I20260808 11:36:12.173965 13412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02b1c50900e0494c8ead5cbc907d370c" candidate_uuid: "b2cb5f609d974242b5d314655a1853ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c02874173075402083c3f8bf98ee4fa6" is_pre_election: true
I20260808 11:36:12.174136 13124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02b1c50900e0494c8ead5cbc907d370c" candidate_uuid: "b2cb5f609d974242b5d314655a1853ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314680af6a3841f7b37f5d6b8f6f1873" is_pre_election: true
I20260808 11:36:12.174484 13412 raft_consensus.cc:2454] T 02b1c50900e0494c8ead5cbc907d370c P c02874173075402083c3f8bf98ee4fa6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cb5f609d974242b5d314655a1853ea in term 0.
I20260808 11:36:12.174679 13124 raft_consensus.cc:2454] T 02b1c50900e0494c8ead5cbc907d370c P 314680af6a3841f7b37f5d6b8f6f1873 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cb5f609d974242b5d314655a1853ea in term 0.
I20260808 11:36:12.175164 13193 leader_election.cc:302] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cb5f609d974242b5d314655a1853ea, c02874173075402083c3f8bf98ee4fa6; no voters:
I20260808 11:36:12.175591 13483 raft_consensus.cc:2781] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:36:12.175740 13483 raft_consensus.cc:482] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:36:12.175845 13483 raft_consensus.cc:3037] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:12.178049 13483 raft_consensus.cc:504] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cb5f609d974242b5d314655a1853ea" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 42019 } } peers { permanent_uuid: "c02874173075402083c3f8bf98ee4fa6" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 35669 } } peers { permanent_uuid: "314680af6a3841f7b37f5d6b8f6f1873" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 38625 } }
I20260808 11:36:12.178649 13483 leader_election.cc:288] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea [CANDIDATE]: Term 1 election: Requested vote from peers c02874173075402083c3f8bf98ee4fa6 (127.26.66.131:35669), 314680af6a3841f7b37f5d6b8f6f1873 (127.26.66.129:38625)
I20260808 11:36:12.179116 13412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02b1c50900e0494c8ead5cbc907d370c" candidate_uuid: "b2cb5f609d974242b5d314655a1853ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c02874173075402083c3f8bf98ee4fa6"
I20260808 11:36:12.179155 13124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02b1c50900e0494c8ead5cbc907d370c" candidate_uuid: "b2cb5f609d974242b5d314655a1853ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "314680af6a3841f7b37f5d6b8f6f1873"
I20260808 11:36:12.179333 13412 raft_consensus.cc:3037] T 02b1c50900e0494c8ead5cbc907d370c P c02874173075402083c3f8bf98ee4fa6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:12.179353 13124 raft_consensus.cc:3037] T 02b1c50900e0494c8ead5cbc907d370c P 314680af6a3841f7b37f5d6b8f6f1873 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:12.182617 13124 raft_consensus.cc:2454] T 02b1c50900e0494c8ead5cbc907d370c P 314680af6a3841f7b37f5d6b8f6f1873 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cb5f609d974242b5d314655a1853ea in term 1.
I20260808 11:36:12.182617 13412 raft_consensus.cc:2454] T 02b1c50900e0494c8ead5cbc907d370c P c02874173075402083c3f8bf98ee4fa6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cb5f609d974242b5d314655a1853ea in term 1.
I20260808 11:36:12.183050 13193 leader_election.cc:302] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cb5f609d974242b5d314655a1853ea, c02874173075402083c3f8bf98ee4fa6; no voters:
I20260808 11:36:12.183342 13483 raft_consensus.cc:2781] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:36:12.183807 13483 raft_consensus.cc:686] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea [term 1 LEADER]: Becoming Leader. State: Replica: b2cb5f609d974242b5d314655a1853ea, State: Running, Role: LEADER
I20260808 11:36:12.184319 13483 consensus_queue.cc:237] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cb5f609d974242b5d314655a1853ea" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 42019 } } peers { permanent_uuid: "c02874173075402083c3f8bf98ee4fa6" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 35669 } } peers { permanent_uuid: "314680af6a3841f7b37f5d6b8f6f1873" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 38625 } }
I20260808 11:36:12.189246 12975 catalog_manager.cc:5495] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea reported cstate change: term changed from 0 to 1, leader changed from <none> to b2cb5f609d974242b5d314655a1853ea (127.26.66.130). New cstate: current_term: 1 leader_uuid: "b2cb5f609d974242b5d314655a1853ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cb5f609d974242b5d314655a1853ea" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 42019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02874173075402083c3f8bf98ee4fa6" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 35669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "314680af6a3841f7b37f5d6b8f6f1873" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 38625 } health_report { overall_health: UNKNOWN } } }
I20260808 11:36:12.239105 13473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:12.233626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49674 (local address 127.26.66.130:42019)
0808 11:36:12.233839 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:12.233844 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:12.233904 (+ 60us) server_negotiation.cc:407] Connection header received
0808 11:36:12.234107 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:12.234111 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:12.234200 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:12.234338 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:36:12.234685 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:12.235468 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:12.236976 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:12.237452 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:12.237556 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:12.238047 (+ 491us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:36:12.238582 (+ 535us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:36:12.238699 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:12.238826 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 11:36:12.238893 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 11:36:12.247622 13124 raft_consensus.cc:1261] T 02b1c50900e0494c8ead5cbc907d370c P 314680af6a3841f7b37f5d6b8f6f1873 [term 1 FOLLOWER]: Refusing update from remote peer b2cb5f609d974242b5d314655a1853ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:36:12.247653 13412 raft_consensus.cc:1261] T 02b1c50900e0494c8ead5cbc907d370c P c02874173075402083c3f8bf98ee4fa6 [term 1 FOLLOWER]: Refusing update from remote peer b2cb5f609d974242b5d314655a1853ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:36:12.248677 13489 consensus_queue.cc:1035] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c02874173075402083c3f8bf98ee4fa6" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 35669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:36:12.249037 13483 consensus_queue.cc:1035] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "314680af6a3841f7b37f5d6b8f6f1873" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 38625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:36:12.260578 13492 mvcc.cc:205] Tried to move back new op lower bound from 7316230030315876352 to 7316230030070562816. Current Snapshot: MvccSnapshot[applied={T|T < 7316230030315876352}]
I20260808 11:36:12.262773 13493 mvcc.cc:205] Tried to move back new op lower bound from 7316230030315876352 to 7316230030070562816. Current Snapshot: MvccSnapshot[applied={T|T < 7316230030315876352}]
I20260808 11:36:12.263302 13494 mvcc.cc:205] Tried to move back new op lower bound from 7316230030315876352 to 7316230030070562816. Current Snapshot: MvccSnapshot[applied={T|T < 7316230030315876352}]
I20260808 11:36:12.274021 12975 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57468:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:36:12.274305 12975 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57468:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:36:12.278039 12975 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ef1cce792ff94351962f5d6fb5016c66: Sending DeleteTablet for 3 replicas of tablet 02b1c50900e0494c8ead5cbc907d370c
I20260808 11:36:12.279294 13247 tablet_service.cc:1514] Processing DeleteTablet for tablet 02b1c50900e0494c8ead5cbc907d370c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:36:12 UTC) from {username='slave'} at 127.0.0.1:49672
I20260808 11:36:12.279331 13392 tablet_service.cc:1514] Processing DeleteTablet for tablet 02b1c50900e0494c8ead5cbc907d370c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:36:12 UTC) from {username='slave'} at 127.0.0.1:41282
I20260808 11:36:12.279580 13104 tablet_service.cc:1514] Processing DeleteTablet for tablet 02b1c50900e0494c8ead5cbc907d370c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:36:12 UTC) from {username='slave'} at 127.0.0.1:39602
I20260808 11:36:12.281226 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 13038
I20260808 11:36:12.291941 13501 tablet_replica.cc:330] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea: stopping tablet replica
I20260808 11:36:12.292845 13501 raft_consensus.cc:2229] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea [term 1 LEADER]: Raft consensus shutting down.
I20260808 11:36:12.293552 13503 tablet_replica.cc:330] T 02b1c50900e0494c8ead5cbc907d370c P 314680af6a3841f7b37f5d6b8f6f1873: stopping tablet replica
I20260808 11:36:12.293871 13501 raft_consensus.cc:2258] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:36:12.293996 13503 raft_consensus.cc:2229] T 02b1c50900e0494c8ead5cbc907d370c P 314680af6a3841f7b37f5d6b8f6f1873 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:36:12.294488 13503 raft_consensus.cc:2258] T 02b1c50900e0494c8ead5cbc907d370c P 314680af6a3841f7b37f5d6b8f6f1873 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:36:12.296402 13502 tablet_replica.cc:330] T 02b1c50900e0494c8ead5cbc907d370c P c02874173075402083c3f8bf98ee4fa6: stopping tablet replica
I20260808 11:36:12.296785 13503 ts_tablet_manager.cc:1905] T 02b1c50900e0494c8ead5cbc907d370c P 314680af6a3841f7b37f5d6b8f6f1873: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:36:12.297318 13501 ts_tablet_manager.cc:1905] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:36:12.297766 13502 raft_consensus.cc:2229] T 02b1c50900e0494c8ead5cbc907d370c P c02874173075402083c3f8bf98ee4fa6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:36:12.302388 13502 raft_consensus.cc:2258] T 02b1c50900e0494c8ead5cbc907d370c P c02874173075402083c3f8bf98ee4fa6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:36:12.303197 13476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:12.282910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39604 (local address 127.26.66.129:38625)
0808 11:36:12.283101 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:12.283108 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:12.288968 (+ 5860us) server_negotiation.cc:407] Connection header received
0808 11:36:12.289219 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:12.289225 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:12.289342 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:12.289463 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:12.295747 (+ 6284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:12.296956 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:12.298969 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:12.299630 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:12.299742 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:12.301351 (+ 1609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:12.301364 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:12.301380 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:12.302179 (+ 799us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:12.302245 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:12.302270 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:12.302371 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:12.302648 (+ 277us) server_negotiation.cc:299] Negotiation successful
0808 11:36:12.302772 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 11:36:12.304620 13166 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:12.305379 13502 ts_tablet_manager.cc:1905] T 02b1c50900e0494c8ead5cbc907d370c P c02874173075402083c3f8bf98ee4fa6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:36:12.309724 13501 ts_tablet_manager.cc:1918] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:36:12.309983 13501 log.cc:1196] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-1/wal/wals/02b1c50900e0494c8ead5cbc907d370c
I20260808 11:36:12.310667 13501 ts_tablet_manager.cc:1939] T 02b1c50900e0494c8ead5cbc907d370c P b2cb5f609d974242b5d314655a1853ea: Deleting consensus metadata
I20260808 11:36:12.312662 12961 catalog_manager.cc:4841] TS b2cb5f609d974242b5d314655a1853ea (127.26.66.130:42019): tablet 02b1c50900e0494c8ead5cbc907d370c (table test-table [id=67782f6dbb9447b3ab1e14ee02fcfb60]) successfully deleted
I20260808 11:36:12.313920 13502 ts_tablet_manager.cc:1918] T 02b1c50900e0494c8ead5cbc907d370c P c02874173075402083c3f8bf98ee4fa6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:36:12.314073 13502 log.cc:1196] T 02b1c50900e0494c8ead5cbc907d370c P c02874173075402083c3f8bf98ee4fa6: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-2/wal/wals/02b1c50900e0494c8ead5cbc907d370c
I20260808 11:36:12.314610 13502 ts_tablet_manager.cc:1939] T 02b1c50900e0494c8ead5cbc907d370c P c02874173075402083c3f8bf98ee4fa6: Deleting consensus metadata
I20260808 11:36:12.316412 12960 catalog_manager.cc:4841] TS c02874173075402083c3f8bf98ee4fa6 (127.26.66.131:35669): tablet 02b1c50900e0494c8ead5cbc907d370c (table test-table [id=67782f6dbb9447b3ab1e14ee02fcfb60]) successfully deleted
I20260808 11:36:12.399662 13503 ts_tablet_manager.cc:1918] T 02b1c50900e0494c8ead5cbc907d370c P 314680af6a3841f7b37f5d6b8f6f1873: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:36:12.399999 13503 log.cc:1196] T 02b1c50900e0494c8ead5cbc907d370c P 314680af6a3841f7b37f5d6b8f6f1873: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786188664137852-26890-0/minicluster-data/ts-0/wal/wals/02b1c50900e0494c8ead5cbc907d370c
I20260808 11:36:12.400492 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 13038
I20260808 11:36:12.400668 13503 ts_tablet_manager.cc:1939] T 02b1c50900e0494c8ead5cbc907d370c P 314680af6a3841f7b37f5d6b8f6f1873: Deleting consensus metadata
I20260808 11:36:12.423197 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 13176
W20260808 11:36:12.423295 12963 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.66.129:38625 (error 108)
I20260808 11:36:12.426019 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:12.425452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:38625 (local address 127.0.0.1:39608)
0808 11:36:12.425698 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:12.425844 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
W20260808 11:36:12.426311 12963 catalog_manager.cc:4584] TS 314680af6a3841f7b37f5d6b8f6f1873 (127.26.66.129:38625): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 02b1c50900e0494c8ead5cbc907d370c: Network error: Client connection negotiation failed: client connection to 127.26.66.129:38625: connect: Connection refused (error 111)
I20260808 11:36:12.431596 13473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:12.423965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49678 (local address 127.26.66.130:42019)
0808 11:36:12.424159 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:12.424168 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:12.424268 (+ 100us) server_negotiation.cc:407] Connection header received
0808 11:36:12.424510 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:12.424515 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:12.424630 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:12.424752 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:12.425290 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:12.426470 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:12.428508 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:12.428936 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:12.429036 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:12.430225 (+ 1189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:12.430233 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:12.430247 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:12.430840 (+ 593us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:12.430886 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:12.430905 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:12.430993 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:12.431148 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 11:36:12.431227 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 11:36:12.432328 13317 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:12.479957 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:12.479368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:38625 (local address 127.0.0.1:39624)
0808 11:36:12.479610 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:12.479715 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260808 11:36:12.481017 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:12.480634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:38625 (local address 127.0.0.1:39626)
0808 11:36:12.480797 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:12.480886 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260808 11:36:12.541777 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:12.541136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:38625 (local address 127.0.0.1:39632)
0808 11:36:12.541447 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:12.541565 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260808 11:36:12.542829 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:12.542474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:38625 (local address 127.0.0.1:39648)
0808 11:36:12.542623 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:12.542702 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 11:36:12.545179 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 13176
I20260808 11:36:12.568356 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 13325
I20260808 11:36:12.574913 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:12.569088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41284 (local address 127.26.66.131:35669)
0808 11:36:12.569260 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:12.569265 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:12.569335 (+ 70us) server_negotiation.cc:407] Connection header received
0808 11:36:12.569489 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:12.569493 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:12.569573 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:12.569657 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:12.570027 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:12.570721 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:12.572023 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:12.572616 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:12.572721 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:12.573713 (+ 992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:12.573722 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:12.573737 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:12.574295 (+ 558us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:12.574341 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:12.574360 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:12.574444 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:12.574560 (+ 116us) server_negotiation.cc:299] Negotiation successful
0808 11:36:12.574653 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 11:36:12.575559 13454 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:12.623581 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:12.623040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:38625 (local address 127.0.0.1:39654)
0808 11:36:12.623279 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:12.623388 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260808 11:36:12.624771 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:12.624359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:38625 (local address 127.0.0.1:39664)
0808 11:36:12.624580 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:12.624650 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260808 11:36:12.664697 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 13325
I20260808 11:36:12.685870 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 12945
I20260808 11:36:12.686993 13008 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:12.798126 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:12.797491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:38625 (local address 127.0.0.1:39672)
0808 11:36:12.797741 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:12.797881 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260808 11:36:12.798254 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 12945
2026-08-08T11:36:12Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (2995 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:36:12 dist-test-slave-zkpd krb5kdc[13513](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:36:12 dist-test-slave-zkpd krb5kdc[13513](info): set up 2 sockets
Aug 08 11:36:12 dist-test-slave-zkpd krb5kdc[13513](info): commencing operation
krb5kdc: starting...
W20260808 11:36:13.985618 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.141s user 0.000s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:36:14 dist-test-slave-zkpd krb5kdc[13513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188974, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:36:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:36:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:36:14.313326 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:45593
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:40041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:45593
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:36:14.664978 13526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:14.665273 13526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:14.665457 13526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:14.672782 13526 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:36:14.672900 13526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:14.672986 13526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:14.673086 13526 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:36:14.673167 13526 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:36:14.683056 13526 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:40041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:45593
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:45593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:14.684460 13526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:14.685855 13526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:14.698024 13531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:14.697999 13532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:14.698072 13534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:14.698495 13526 server_base.cc:1034] running on GCE node
I20260808 11:36:14.699460 13526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:14.700822 13526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:14.702021 13526 hybrid_clock.cc:648] HybridClock initialized: now 1786188974701957 us; error 54 us; skew 500 ppm
I20260808 11:36:14.702302 13526 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:36:14 dist-test-slave-zkpd krb5kdc[13513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188974, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:36:14.705447 13526 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:36:14.706840 13526 webserver.cc:460] Webserver started at http://127.26.66.190:36489/ using document root <none> and password file <none>
I20260808 11:36:14.707434 13526 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:14.707541 13526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:14.707788 13526 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:14.710721 13526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "e8e71ce293134e219aea4066951210e0"
format_stamp: "Formatted at 2026-08-08 11:36:14 on dist-test-slave-zkpd"
server_key: "64bd9bb2ec78e9c36adfa0f65757b22a"
server_key_iv: "d39783b2186fa3b152cfa496abe04c8b"
server_key_version: "encryptionkey@0"
I20260808 11:36:14.711439 13526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "e8e71ce293134e219aea4066951210e0"
format_stamp: "Formatted at 2026-08-08 11:36:14 on dist-test-slave-zkpd"
server_key: "64bd9bb2ec78e9c36adfa0f65757b22a"
server_key_iv: "d39783b2186fa3b152cfa496abe04c8b"
server_key_version: "encryptionkey@0"
I20260808 11:36:14.716614 13526 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 11:36:14.719955 13542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:14.721206 13526 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 11:36:14.721395 13526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "e8e71ce293134e219aea4066951210e0"
format_stamp: "Formatted at 2026-08-08 11:36:14 on dist-test-slave-zkpd"
server_key: "64bd9bb2ec78e9c36adfa0f65757b22a"
server_key_iv: "d39783b2186fa3b152cfa496abe04c8b"
server_key_version: "encryptionkey@0"
I20260808 11:36:14.721634 13526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:14.737697 13526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:14.741653 13526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:14.741953 13526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:14.761103 13526 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:45593
I20260808 11:36:14.761137 13595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:45593 every 8 connection(s)
I20260808 11:36:14.762403 13526 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:36:14.766319 13596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:14.766505 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 13526
I20260808 11:36:14.766705 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:36:14.767166 26890 external_mini_cluster.cc:1428] Setting key 4e97b198c652c3e940f58adc7d7d9800
I20260808 11:36:14.779685 13596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8e71ce293134e219aea4066951210e0: Bootstrap starting.
Aug 08 11:36:14 dist-test-slave-zkpd krb5kdc[13513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188974, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:36:14.782998 13596 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e8e71ce293134e219aea4066951210e0: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:14.784128 13596 log.cc:824] T 00000000000000000000000000000000 P e8e71ce293134e219aea4066951210e0: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:14.787182 13596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8e71ce293134e219aea4066951210e0: No bootstrap required, opened a new log
I20260808 11:36:14.790704 13599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:14.769026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58492 (local address 127.26.66.190:45593)
0808 11:36:14.769974 (+ 948us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:14.769991 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:14.770047 (+ 56us) server_negotiation.cc:407] Connection header received
0808 11:36:14.772068 (+ 2021us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:14.772091 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:14.772512 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:14.772946 (+ 434us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:14.774547 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:14.775857 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:14.777260 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:14.777972 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:14.778191 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:14.783160 (+ 4969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:14.783170 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:14.783184 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:14.783221 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:14.786625 (+ 3404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:14.787361 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:14.787367 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:14.787372 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:14.787536 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:14.787966 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:14.787975 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:14.787980 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:14.788462 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:14.788812 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:14.789317 (+ 505us) server_negotiation.cc:299] Negotiation successful
0808 11:36:14.789737 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":681,"thread_start_us":401,"threads_started":1}
I20260808 11:36:14.795610 13596 raft_consensus.cc:348] T 00000000000000000000000000000000 P e8e71ce293134e219aea4066951210e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8e71ce293134e219aea4066951210e0" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45593 } }
I20260808 11:36:14.796016 13596 raft_consensus.cc:374] T 00000000000000000000000000000000 P e8e71ce293134e219aea4066951210e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:14.796125 13596 raft_consensus.cc:729] T 00000000000000000000000000000000 P e8e71ce293134e219aea4066951210e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8e71ce293134e219aea4066951210e0, State: Initialized, Role: FOLLOWER
I20260808 11:36:14.796752 13596 consensus_queue.cc:260] T 00000000000000000000000000000000 P e8e71ce293134e219aea4066951210e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8e71ce293134e219aea4066951210e0" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45593 } }
I20260808 11:36:14.797039 13596 raft_consensus.cc:388] T 00000000000000000000000000000000 P e8e71ce293134e219aea4066951210e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:36:14.797187 13596 raft_consensus.cc:482] T 00000000000000000000000000000000 P e8e71ce293134e219aea4066951210e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:36:14.797372 13596 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e8e71ce293134e219aea4066951210e0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:14.799450 13596 raft_consensus.cc:504] T 00000000000000000000000000000000 P e8e71ce293134e219aea4066951210e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8e71ce293134e219aea4066951210e0" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45593 } }
I20260808 11:36:14.799969 13596 leader_election.cc:302] T 00000000000000000000000000000000 P e8e71ce293134e219aea4066951210e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e8e71ce293134e219aea4066951210e0; no voters:
I20260808 11:36:14.800616 13596 leader_election.cc:288] T 00000000000000000000000000000000 P e8e71ce293134e219aea4066951210e0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:36:14.800742 13601 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e8e71ce293134e219aea4066951210e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:36:14.801632 13601 raft_consensus.cc:686] T 00000000000000000000000000000000 P e8e71ce293134e219aea4066951210e0 [term 1 LEADER]: Becoming Leader. State: Replica: e8e71ce293134e219aea4066951210e0, State: Running, Role: LEADER
I20260808 11:36:14.802174 13601 consensus_queue.cc:237] T 00000000000000000000000000000000 P e8e71ce293134e219aea4066951210e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8e71ce293134e219aea4066951210e0" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45593 } }
I20260808 11:36:14.802807 13596 sys_catalog.cc:564] T 00000000000000000000000000000000 P e8e71ce293134e219aea4066951210e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:36:14.805192 13602 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8e71ce293134e219aea4066951210e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e8e71ce293134e219aea4066951210e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8e71ce293134e219aea4066951210e0" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45593 } } }
I20260808 11:36:14.805684 13602 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8e71ce293134e219aea4066951210e0 [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:14.806530 13603 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8e71ce293134e219aea4066951210e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e8e71ce293134e219aea4066951210e0. Latest consensus state: current_term: 1 leader_uuid: "e8e71ce293134e219aea4066951210e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8e71ce293134e219aea4066951210e0" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45593 } } }
I20260808 11:36:14.806993 13603 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8e71ce293134e219aea4066951210e0 [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:14.807260 13608 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:36:14.812587 13608 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:36:14.820955 13608 catalog_manager.cc:1347] Generated new cluster ID: 8b9c4510962d4840a823303e730178ac
I20260808 11:36:14.821058 13608 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:36:14.834975 13608 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:36:14.836791 13608 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:36:14.852659 13608 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e8e71ce293134e219aea4066951210e0: Generated new TSK 0
I20260808 11:36:14.853636 13608 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.66.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
I20260808 11:36:14.935766 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:0
--local_ip_for_outbound_sockets=127.26.66.129
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45593
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:40041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:36:15.285405 13622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:15.285686 13622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:15.285791 13622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:15.293105 13622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:15.293208 13622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:15.293437 13622 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:36:15.303228 13622 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:40041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:15.304525 13622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:15.305824 13622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:15.319162 13630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:15.319442 13627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:15.319217 13628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:15.320389 13622 server_base.cc:1034] running on GCE node
I20260808 11:36:15.321010 13622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:15.321890 13622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:15.323102 13622 hybrid_clock.cc:648] HybridClock initialized: now 1786188975323051 us; error 36 us; skew 500 ppm
I20260808 11:36:15.323396 13622 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:36:15 dist-test-slave-zkpd krb5kdc[13513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188975, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:36:15.332296 13622 init.cc:377] Logged in from keytab as kudu/127.26.66.129@KRBTEST.COM (short username kudu)
I20260808 11:36:15.333828 13622 webserver.cc:460] Webserver started at http://127.26.66.129:35573/ using document root <none> and password file <none>
I20260808 11:36:15.334542 13622 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:15.334693 13622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:15.335022 13622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:15.338025 13622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-0/data/instance:
uuid: "26fc1ca479234779baa048a757486533"
format_stamp: "Formatted at 2026-08-08 11:36:15 on dist-test-slave-zkpd"
server_key: "ff19ff19b19a02f3b577bc726f7cb960"
server_key_iv: "945ff4ca58125378a778251dfaf9e00e"
server_key_version: "encryptionkey@0"
I20260808 11:36:15.338812 13622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance:
uuid: "26fc1ca479234779baa048a757486533"
format_stamp: "Formatted at 2026-08-08 11:36:15 on dist-test-slave-zkpd"
server_key: "ff19ff19b19a02f3b577bc726f7cb960"
server_key_iv: "945ff4ca58125378a778251dfaf9e00e"
server_key_version: "encryptionkey@0"
I20260808 11:36:15.344091 13622 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260808 11:36:15.347517 13637 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:15.349260 13622 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:36:15.349442 13622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "26fc1ca479234779baa048a757486533"
format_stamp: "Formatted at 2026-08-08 11:36:15 on dist-test-slave-zkpd"
server_key: "ff19ff19b19a02f3b577bc726f7cb960"
server_key_iv: "945ff4ca58125378a778251dfaf9e00e"
server_key_version: "encryptionkey@0"
I20260808 11:36:15.349651 13622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:15.368587 13622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:15.373279 13622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:15.373569 13622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:15.374562 13622 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:36:15.375974 13622 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:36:15.376081 13622 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:15.376241 13622 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:36:15.376322 13622 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:15.411553 13622 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:45797
I20260808 11:36:15.411621 13755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:45797 every 8 connection(s)
I20260808 11:36:15.412906 13622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:36:15.418358 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 13622
I20260808 11:36:15.418551 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance
I20260808 11:36:15.419044 26890 external_mini_cluster.cc:1428] Setting key d533d5339bb028d99f5d96584556934a
Aug 08 11:36:15 dist-test-slave-zkpd krb5kdc[13513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188975, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:36:15.433786 13758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:15.415588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:43001 (local address 127.26.66.190:45593)
0808 11:36:15.416158 (+ 570us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:15.416164 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:15.417085 (+ 921us) server_negotiation.cc:407] Connection header received
0808 11:36:15.419028 (+ 1943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:15.419036 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:15.419134 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:15.419283 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:15.421029 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:15.421805 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:15.423389 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:15.423816 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:15.423989 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:15.427867 (+ 3878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:15.427872 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:15.427875 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:15.427952 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:15.430616 (+ 2664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:15.431378 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:15.431386 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:15.431391 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:15.431521 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:15.431989 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:15.431995 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:15.431998 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:15.432275 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:15.432435 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:15.433162 (+ 727us) server_negotiation.cc:299] Negotiation successful
0808 11:36:15.433389 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":277,"threads_started":1}
I20260808 11:36:15.434697 13759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:15.416170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45593 (local address 127.26.66.129:43001)
0808 11:36:15.416911 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:15.416958 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:15.418754 (+ 1796us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:15.419489 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:15.419497 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:15.420186 (+ 689us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:36:15.420835 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:15.420862 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:15.421979 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:15.421985 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:15.423225 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:15.423238 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:15.424088 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:15.424098 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:15.424347 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:15.425117 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:36:15.425168 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:36:15.427610 (+ 2442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:36:15.430768 (+ 3158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:36:15.430779 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:36:15.430794 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:36:15.431239 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:36:15.431638 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:36:15.431643 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:36:15.431647 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:36:15.431835 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:36:15.432410 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:36:15.432418 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:36:15.432780 (+ 362us) client_negotiation.cc:769] Sending connection context
0808 11:36:15.433047 (+ 267us) client_negotiation.cc:240] Negotiation successful
0808 11:36:15.433583 (+ 536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":274,"threads_started":1}
I20260808 11:36:15.436437 13756 heartbeater.cc:347] Connected to a master server at 127.26.66.190:45593
I20260808 11:36:15.436764 13756 heartbeater.cc:464] Registering TS with master...
I20260808 11:36:15.437628 13756 heartbeater.cc:511] Master 127.26.66.190:45593 requested a full tablet report, sending...
I20260808 11:36:15.440243 13559 ts_manager.cc:194] Registered new tserver with Master: 26fc1ca479234779baa048a757486533 (127.26.66.129:45797)
I20260808 11:36:15.442468 13559 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.129@KRBTEST.COM'} at 127.26.66.129:43001
WARNING: no policy specified for kudu/127.26.66.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
I20260808 11:36:15.495077 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:0
--local_ip_for_outbound_sockets=127.26.66.130
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45593
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:40041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:36:15.841992 13762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:15.842247 13762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:15.842365 13762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:15.849738 13762 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:15.849835 13762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:15.850008 13762 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:36:15.859591 13762 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:40041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:15.860807 13762 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:15.862063 13762 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:15.875298 13768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:15.875499 13770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:15.876020 13767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:15.876542 13762 server_base.cc:1034] running on GCE node
I20260808 11:36:15.877131 13762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:15.878134 13762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:15.879369 13762 hybrid_clock.cc:648] HybridClock initialized: now 1786188975879325 us; error 39 us; skew 500 ppm
I20260808 11:36:15.879714 13762 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:36:15 dist-test-slave-zkpd krb5kdc[13513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188975, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:36:15.882956 13762 init.cc:377] Logged in from keytab as kudu/127.26.66.130@KRBTEST.COM (short username kudu)
I20260808 11:36:15.884433 13762 webserver.cc:460] Webserver started at http://127.26.66.130:43029/ using document root <none> and password file <none>
I20260808 11:36:15.885130 13762 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:15.885281 13762 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:15.885607 13762 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:15.888556 13762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-1/data/instance:
uuid: "4380b55235c847d4a955766fc8339bab"
format_stamp: "Formatted at 2026-08-08 11:36:15 on dist-test-slave-zkpd"
server_key: "b2cbb4756dd207f0e63978f1cd0dcf08"
server_key_iv: "d68e2c7def9b2b9b0c017ada0b7f3d51"
server_key_version: "encryptionkey@0"
I20260808 11:36:15.889345 13762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance:
uuid: "4380b55235c847d4a955766fc8339bab"
format_stamp: "Formatted at 2026-08-08 11:36:15 on dist-test-slave-zkpd"
server_key: "b2cbb4756dd207f0e63978f1cd0dcf08"
server_key_iv: "d68e2c7def9b2b9b0c017ada0b7f3d51"
server_key_version: "encryptionkey@0"
I20260808 11:36:15.894614 13762 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 11:36:15.898097 13778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:15.899410 13762 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 11:36:15.899588 13762 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "4380b55235c847d4a955766fc8339bab"
format_stamp: "Formatted at 2026-08-08 11:36:15 on dist-test-slave-zkpd"
server_key: "b2cbb4756dd207f0e63978f1cd0dcf08"
server_key_iv: "d68e2c7def9b2b9b0c017ada0b7f3d51"
server_key_version: "encryptionkey@0"
I20260808 11:36:15.899784 13762 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:15.923754 13762 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:15.928490 13762 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:15.928795 13762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:15.929776 13762 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:36:15.931143 13762 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:36:15.931260 13762 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:15.931416 13762 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:36:15.931491 13762 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:15.965983 13762 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:33233
I20260808 11:36:15.966081 13895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:33233 every 8 connection(s)
I20260808 11:36:15.967267 13762 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:36:15.976388 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 13762
I20260808 11:36:15.976583 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance
I20260808 11:36:15.977146 26890 external_mini_cluster.cc:1428] Setting key 98e19e5f47f82ddacc1352dbe727e522
Aug 08 11:36:15 dist-test-slave-zkpd krb5kdc[13513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188975, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:36:15.989326 13898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:15.969919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:59195 (local address 127.26.66.190:45593)
0808 11:36:15.970400 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:15.970405 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:15.971212 (+ 807us) server_negotiation.cc:407] Connection header received
0808 11:36:15.973119 (+ 1907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:15.973125 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:15.973223 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:15.973344 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:15.974923 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:15.975648 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:15.978074 (+ 2426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:15.978627 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:15.978772 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:15.982312 (+ 3540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:15.982321 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:15.982328 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:15.982373 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:15.985954 (+ 3581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:15.986681 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:15.986688 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:15.986694 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:15.986869 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:15.987277 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:15.987284 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:15.987290 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:15.987677 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:15.987843 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:15.988571 (+ 728us) server_negotiation.cc:299] Negotiation successful
0808 11:36:15.988838 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":279,"threads_started":1}
I20260808 11:36:15.989884 13900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:15.970373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45593 (local address 127.26.66.130:59195)
0808 11:36:15.971052 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:15.971089 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:15.972847 (+ 1758us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:15.973578 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:15.973586 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:15.974106 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:36:15.974755 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:15.974774 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:15.975805 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:15.975814 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:15.977852 (+ 2038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:15.977869 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:15.978873 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:15.978883 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:15.979118 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:15.979813 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:36:15.979836 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:36:15.982089 (+ 2253us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:36:15.986098 (+ 4009us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:36:15.986104 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:36:15.986115 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:36:15.986541 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:36:15.986980 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:36:15.986983 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:36:15.986985 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:36:15.987163 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:36:15.987836 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:36:15.987842 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:36:15.988201 (+ 359us) client_negotiation.cc:769] Sending connection context
0808 11:36:15.988419 (+ 218us) client_negotiation.cc:240] Negotiation successful
0808 11:36:15.988784 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":262,"threads_started":1}
I20260808 11:36:15.991420 13896 heartbeater.cc:347] Connected to a master server at 127.26.66.190:45593
I20260808 11:36:15.991768 13896 heartbeater.cc:464] Registering TS with master...
I20260808 11:36:15.992640 13896 heartbeater.cc:511] Master 127.26.66.190:45593 requested a full tablet report, sending...
I20260808 11:36:15.994225 13559 ts_manager.cc:194] Registered new tserver with Master: 4380b55235c847d4a955766fc8339bab (127.26.66.130:33233)
I20260808 11:36:15.995270 13559 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.130@KRBTEST.COM'} at 127.26.66.130:59195
WARNING: no policy specified for kudu/127.26.66.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
I20260808 11:36:16.050655 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:0
--local_ip_for_outbound_sockets=127.26.66.131
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45593
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:40041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:36:16.418991 13903 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:16.419257 13903 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:16.419354 13903 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:16.426783 13903 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:16.426887 13903 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:16.427000 13903 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:36:16.436537 13903 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:40041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:45593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:16.437757 13903 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:16.439018 13903 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 11:36:16.446419 13756 heartbeater.cc:503] Master 127.26.66.190:45593 was elected leader, sending a full tablet report...
W20260808 11:36:16.453157 13911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:16.453249 13908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:16.453249 13909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:16.454077 13903 server_base.cc:1034] running on GCE node
I20260808 11:36:16.454670 13903 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:16.455576 13903 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:16.456768 13903 hybrid_clock.cc:648] HybridClock initialized: now 1786188976456712 us; error 46 us; skew 500 ppm
I20260808 11:36:16.457032 13903 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:36:16 dist-test-slave-zkpd krb5kdc[13513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188976, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:36:16.460192 13903 init.cc:377] Logged in from keytab as kudu/127.26.66.131@KRBTEST.COM (short username kudu)
I20260808 11:36:16.461596 13903 webserver.cc:460] Webserver started at http://127.26.66.131:41083/ using document root <none> and password file <none>
I20260808 11:36:16.462260 13903 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:16.462396 13903 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:16.462718 13903 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:16.465584 13903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-2/data/instance:
uuid: "6d84ef1395bf45b2afde73ec0ff39ffb"
format_stamp: "Formatted at 2026-08-08 11:36:16 on dist-test-slave-zkpd"
server_key: "a994348162b8a698cd6029c726257491"
server_key_iv: "0f979a3d8b526d25954aac3f2a0c2a15"
server_key_version: "encryptionkey@0"
I20260808 11:36:16.466348 13903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance:
uuid: "6d84ef1395bf45b2afde73ec0ff39ffb"
format_stamp: "Formatted at 2026-08-08 11:36:16 on dist-test-slave-zkpd"
server_key: "a994348162b8a698cd6029c726257491"
server_key_iv: "0f979a3d8b526d25954aac3f2a0c2a15"
server_key_version: "encryptionkey@0"
I20260808 11:36:16.471485 13903 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 11:36:16.474809 13918 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:16.476214 13903 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:36:16.476382 13903 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "6d84ef1395bf45b2afde73ec0ff39ffb"
format_stamp: "Formatted at 2026-08-08 11:36:16 on dist-test-slave-zkpd"
server_key: "a994348162b8a698cd6029c726257491"
server_key_iv: "0f979a3d8b526d25954aac3f2a0c2a15"
server_key_version: "encryptionkey@0"
I20260808 11:36:16.476578 13903 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:16.488332 13903 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:16.492449 13903 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:16.492729 13903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:16.493623 13903 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:36:16.494958 13903 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:36:16.495030 13903 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:16.495186 13903 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:36:16.495247 13903 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:16.529400 13903 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:42443
I20260808 11:36:16.529459 14039 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:42443 every 8 connection(s)
I20260808 11:36:16.530705 13903 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:36:16.532946 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 13903
I20260808 11:36:16.533156 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance
I20260808 11:36:16.533823 26890 external_mini_cluster.cc:1428] Setting key 83be1eab48928cb2e74a03ed0c0f5ebb
Aug 08 11:36:16 dist-test-slave-zkpd krb5kdc[13513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188976, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:36:16.551090 14042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:16.533523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:48393 (local address 127.26.66.190:45593)
0808 11:36:16.534050 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:16.534058 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:16.535207 (+ 1149us) server_negotiation.cc:407] Connection header received
0808 11:36:16.537331 (+ 2124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:16.537334 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:16.537416 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:16.537507 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:16.538973 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:16.539754 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:16.541341 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:16.541789 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:16.541897 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:16.545283 (+ 3386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:16.545288 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:16.545291 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:16.545321 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:16.548414 (+ 3093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:16.549134 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:16.549138 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:16.549140 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:16.549273 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:16.549640 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:16.549643 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:16.549645 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:16.549931 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:16.550049 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:16.550647 (+ 598us) server_negotiation.cc:299] Negotiation successful
0808 11:36:16.550829 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":243,"threads_started":1}
I20260808 11:36:16.552047 14043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:16.534151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:45593 (local address 127.26.66.131:48393)
0808 11:36:16.535015 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:16.535063 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:16.537071 (+ 2008us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:16.537716 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:16.537724 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:16.538237 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:36:16.538799 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:16.538818 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:16.539945 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:16.539951 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:16.541185 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:16.541201 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:16.541988 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:16.541992 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:16.542188 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:16.542825 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:36:16.542847 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:36:16.545090 (+ 2243us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:36:16.548552 (+ 3462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:36:16.548559 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:36:16.548569 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:36:16.549012 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:36:16.549358 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:36:16.549361 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:36:16.549363 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:36:16.549539 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:36:16.550039 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:36:16.550044 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:36:16.550320 (+ 276us) client_negotiation.cc:769] Sending connection context
0808 11:36:16.550532 (+ 212us) client_negotiation.cc:240] Negotiation successful
0808 11:36:16.550895 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":366,"threads_started":1}
I20260808 11:36:16.553442 14040 heartbeater.cc:347] Connected to a master server at 127.26.66.190:45593
I20260808 11:36:16.553869 14040 heartbeater.cc:464] Registering TS with master...
I20260808 11:36:16.554579 14040 heartbeater.cc:511] Master 127.26.66.190:45593 requested a full tablet report, sending...
I20260808 11:36:16.556068 13559 ts_manager.cc:194] Registered new tserver with Master: 6d84ef1395bf45b2afde73ec0ff39ffb (127.26.66.131:42443)
I20260808 11:36:16.556862 13559 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.131@KRBTEST.COM'} at 127.26.66.131:48393
I20260808 11:36:16.561379 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 11:36:16.578786 14042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:16.565534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58508 (local address 127.26.66.190:45593)
0808 11:36:16.565680 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:16.565684 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:16.566182 (+ 498us) server_negotiation.cc:407] Connection header received
0808 11:36:16.566374 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:16.566378 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:16.566446 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:16.566546 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:16.567999 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:16.568710 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:16.570073 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:16.570465 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:16.570598 (+ 133us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:16.573419 (+ 2821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:16.573424 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:16.573428 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:16.573457 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:16.575954 (+ 2497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:16.576734 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:16.576739 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:16.576743 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:16.576870 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:16.577338 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:16.577343 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:16.577346 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:16.577628 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:16.577906 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:16.578309 (+ 403us) server_negotiation.cc:299] Negotiation successful
0808 11:36:16.578515 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 11:36:16.582624 13559 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58508:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 11:36:16.590126 13559 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:36:16.615299 14058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:16.603452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43936 (local address 127.26.66.130:33233)
0808 11:36:16.604204 (+ 752us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:16.604215 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:16.604955 (+ 740us) server_negotiation.cc:407] Connection header received
0808 11:36:16.605083 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:16.605094 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:16.605395 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:16.605607 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:16.606787 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:16.608939 (+ 2152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:16.612513 (+ 3574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:16.614001 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:16.614153 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:16.614407 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:16.614793 (+ 386us) server_negotiation.cc:299] Negotiation successful
0808 11:36:16.614976 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":559,"thread_start_us":438,"threads_started":1}
I20260808 11:36:16.615332 14057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:16.602942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:33233 (local address 127.0.0.1:43936)
0808 11:36:16.604637 (+ 1695us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:16.604656 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:16.604813 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:16.605955 (+ 1142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:16.605966 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:16.606014 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:16.606551 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:16.606567 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:16.609148 (+ 2581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:16.609157 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:16.612304 (+ 3147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:16.612328 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:16.614230 (+ 1902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:16.614236 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:16.614471 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:16.614554 (+ 83us) client_negotiation.cc:769] Sending connection context
0808 11:36:16.614718 (+ 164us) client_negotiation.cc:240] Negotiation successful
0808 11:36:16.614904 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1564,"mutex_wait_us":3,"thread_start_us":1449,"threads_started":1}
I20260808 11:36:16.619352 13828 tablet_service.cc:1467] Processing CreateTablet for tablet 9b322dbede6342c4838bf2b775180167 (DEFAULT_TABLE table=test-table [id=819a43f05f6a409dacb61802c6016180]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:36:16.620707 14060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:16.603779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:42443 (local address 127.0.0.1:59566)
0808 11:36:16.612519 (+ 8740us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:16.612541 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:16.612715 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:16.613508 (+ 793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:16.613513 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:16.613538 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:16.613861 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:16.613869 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:16.616108 (+ 2239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:16.616113 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:16.618026 (+ 1913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:16.618039 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:16.619862 (+ 1823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:16.619869 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:16.620072 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:16.620109 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 11:36:16.620248 (+ 139us) client_negotiation.cc:240] Negotiation successful
0808 11:36:16.620371 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8569,"thread_start_us":8370,"threads_started":1}
I20260808 11:36:16.620775 14059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:16.604382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59566 (local address 127.26.66.131:42443)
0808 11:36:16.612115 (+ 7733us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:16.612124 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:16.612879 (+ 755us) server_negotiation.cc:407] Connection header received
0808 11:36:16.613006 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:16.613017 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:16.613292 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:16.614027 (+ 735us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:16.614352 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:16.615946 (+ 1594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:16.618189 (+ 2243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:16.619320 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:16.619457 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:16.619712 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:16.620293 (+ 581us) server_negotiation.cc:299] Negotiation successful
0808 11:36:16.620449 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7548,"thread_start_us":7378,"threads_started":1}
I20260808 11:36:16.620908 13828 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b322dbede6342c4838bf2b775180167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:16.622363 14055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:16.602424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45797 (local address 127.0.0.1:53042)
0808 11:36:16.603199 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:16.603240 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:16.603444 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:16.614290 (+ 10846us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:16.614295 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:16.614320 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:16.614735 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:16.614747 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:16.617662 (+ 2915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:16.617667 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:16.619727 (+ 2060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:16.619743 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:16.621633 (+ 1890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:16.621639 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:16.621824 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:16.621855 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 11:36:16.621957 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 11:36:16.622086 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"mutex_wait_us":2,"thread_start_us":342,"threads_started":1}
I20260808 11:36:16.624007 14056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:16.602709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53042 (local address 127.26.66.129:45797)
0808 11:36:16.613683 (+ 10974us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:16.613694 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:16.613742 (+ 48us) server_negotiation.cc:407] Connection header received
0808 11:36:16.613846 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:16.613853 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:16.614071 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:16.614936 (+ 865us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:16.615825 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:16.617501 (+ 1676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:16.619963 (+ 2462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:16.621422 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:16.621570 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:16.621779 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:16.623477 (+ 1698us) server_negotiation.cc:299] Negotiation successful
0808 11:36:16.623656 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10805,"thread_start_us":10645,"threads_started":1}
I20260808 11:36:16.624788 13968 tablet_service.cc:1467] Processing CreateTablet for tablet 9b322dbede6342c4838bf2b775180167 (DEFAULT_TABLE table=test-table [id=819a43f05f6a409dacb61802c6016180]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:36:16.626284 13968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b322dbede6342c4838bf2b775180167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:16.627291 13688 tablet_service.cc:1467] Processing CreateTablet for tablet 9b322dbede6342c4838bf2b775180167 (DEFAULT_TABLE table=test-table [id=819a43f05f6a409dacb61802c6016180]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:36:16.628650 13688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b322dbede6342c4838bf2b775180167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:16.636137 14061 tablet_bootstrap.cc:492] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab: Bootstrap starting.
I20260808 11:36:16.639840 14061 tablet_bootstrap.cc:654] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:16.640192 14062 tablet_bootstrap.cc:492] T 9b322dbede6342c4838bf2b775180167 P 6d84ef1395bf45b2afde73ec0ff39ffb: Bootstrap starting.
I20260808 11:36:16.641608 14063 tablet_bootstrap.cc:492] T 9b322dbede6342c4838bf2b775180167 P 26fc1ca479234779baa048a757486533: Bootstrap starting.
I20260808 11:36:16.642153 14061 log.cc:824] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:16.643862 14062 tablet_bootstrap.cc:654] T 9b322dbede6342c4838bf2b775180167 P 6d84ef1395bf45b2afde73ec0ff39ffb: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:16.645195 14061 tablet_bootstrap.cc:492] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab: No bootstrap required, opened a new log
I20260808 11:36:16.645210 14062 log.cc:824] T 9b322dbede6342c4838bf2b775180167 P 6d84ef1395bf45b2afde73ec0ff39ffb: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:16.645483 14061 ts_tablet_manager.cc:1397] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260808 11:36:16.645715 14063 tablet_bootstrap.cc:654] T 9b322dbede6342c4838bf2b775180167 P 26fc1ca479234779baa048a757486533: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:16.647248 14063 log.cc:824] T 9b322dbede6342c4838bf2b775180167 P 26fc1ca479234779baa048a757486533: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:16.650100 14063 tablet_bootstrap.cc:492] T 9b322dbede6342c4838bf2b775180167 P 26fc1ca479234779baa048a757486533: No bootstrap required, opened a new log
I20260808 11:36:16.650429 14063 ts_tablet_manager.cc:1397] T 9b322dbede6342c4838bf2b775180167 P 26fc1ca479234779baa048a757486533: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260808 11:36:16.650588 14062 tablet_bootstrap.cc:492] T 9b322dbede6342c4838bf2b775180167 P 6d84ef1395bf45b2afde73ec0ff39ffb: No bootstrap required, opened a new log
I20260808 11:36:16.650892 14062 ts_tablet_manager.cc:1397] T 9b322dbede6342c4838bf2b775180167 P 6d84ef1395bf45b2afde73ec0ff39ffb: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.007s
I20260808 11:36:16.655700 14061 raft_consensus.cc:348] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26fc1ca479234779baa048a757486533" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45797 } } peers { permanent_uuid: "6d84ef1395bf45b2afde73ec0ff39ffb" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 42443 } } peers { permanent_uuid: "4380b55235c847d4a955766fc8339bab" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33233 } }
I20260808 11:36:16.656190 14061 raft_consensus.cc:374] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:16.656307 14061 raft_consensus.cc:729] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4380b55235c847d4a955766fc8339bab, State: Initialized, Role: FOLLOWER
I20260808 11:36:16.656975 14061 consensus_queue.cc:260] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26fc1ca479234779baa048a757486533" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45797 } } peers { permanent_uuid: "6d84ef1395bf45b2afde73ec0ff39ffb" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 42443 } } peers { permanent_uuid: "4380b55235c847d4a955766fc8339bab" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33233 } }
I20260808 11:36:16.658092 13896 heartbeater.cc:503] Master 127.26.66.190:45593 was elected leader, sending a full tablet report...
I20260808 11:36:16.658824 14063 raft_consensus.cc:348] T 9b322dbede6342c4838bf2b775180167 P 26fc1ca479234779baa048a757486533 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26fc1ca479234779baa048a757486533" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45797 } } peers { permanent_uuid: "6d84ef1395bf45b2afde73ec0ff39ffb" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 42443 } } peers { permanent_uuid: "4380b55235c847d4a955766fc8339bab" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33233 } }
I20260808 11:36:16.659157 14063 raft_consensus.cc:374] T 9b322dbede6342c4838bf2b775180167 P 26fc1ca479234779baa048a757486533 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:16.659329 14063 raft_consensus.cc:729] T 9b322dbede6342c4838bf2b775180167 P 26fc1ca479234779baa048a757486533 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26fc1ca479234779baa048a757486533, State: Initialized, Role: FOLLOWER
I20260808 11:36:16.660075 14061 ts_tablet_manager.cc:1428] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab: Time spent starting tablet: real 0.014s user 0.012s sys 0.003s
I20260808 11:36:16.660106 14063 consensus_queue.cc:260] T 9b322dbede6342c4838bf2b775180167 P 26fc1ca479234779baa048a757486533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26fc1ca479234779baa048a757486533" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45797 } } peers { permanent_uuid: "6d84ef1395bf45b2afde73ec0ff39ffb" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 42443 } } peers { permanent_uuid: "4380b55235c847d4a955766fc8339bab" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33233 } }
I20260808 11:36:16.661242 14062 raft_consensus.cc:348] T 9b322dbede6342c4838bf2b775180167 P 6d84ef1395bf45b2afde73ec0ff39ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26fc1ca479234779baa048a757486533" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45797 } } peers { permanent_uuid: "6d84ef1395bf45b2afde73ec0ff39ffb" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 42443 } } peers { permanent_uuid: "4380b55235c847d4a955766fc8339bab" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33233 } }
I20260808 11:36:16.661753 14062 raft_consensus.cc:374] T 9b322dbede6342c4838bf2b775180167 P 6d84ef1395bf45b2afde73ec0ff39ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:16.661891 14062 raft_consensus.cc:729] T 9b322dbede6342c4838bf2b775180167 P 6d84ef1395bf45b2afde73ec0ff39ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d84ef1395bf45b2afde73ec0ff39ffb, State: Initialized, Role: FOLLOWER
I20260808 11:36:16.662637 14062 consensus_queue.cc:260] T 9b322dbede6342c4838bf2b775180167 P 6d84ef1395bf45b2afde73ec0ff39ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26fc1ca479234779baa048a757486533" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45797 } } peers { permanent_uuid: "6d84ef1395bf45b2afde73ec0ff39ffb" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 42443 } } peers { permanent_uuid: "4380b55235c847d4a955766fc8339bab" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33233 } }
I20260808 11:36:16.663304 14063 ts_tablet_manager.cc:1428] T 9b322dbede6342c4838bf2b775180167 P 26fc1ca479234779baa048a757486533: Time spent starting tablet: real 0.013s user 0.008s sys 0.004s
I20260808 11:36:16.664215 14040 heartbeater.cc:503] Master 127.26.66.190:45593 was elected leader, sending a full tablet report...
I20260808 11:36:16.664955 14062 ts_tablet_manager.cc:1428] T 9b322dbede6342c4838bf2b775180167 P 6d84ef1395bf45b2afde73ec0ff39ffb: Time spent starting tablet: real 0.014s user 0.008s sys 0.004s
W20260808 11:36:16.665549 13757 tablet.cc:2369] T 9b322dbede6342c4838bf2b775180167 P 26fc1ca479234779baa048a757486533: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 11:36:16.719489 13897 tablet.cc:2369] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 11:36:16.782435 14041 tablet.cc:2369] T 9b322dbede6342c4838bf2b775180167 P 6d84ef1395bf45b2afde73ec0ff39ffb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:36:17.037452 14067 raft_consensus.cc:482] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:36:17.037811 14067 raft_consensus.cc:504] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26fc1ca479234779baa048a757486533" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45797 } } peers { permanent_uuid: "6d84ef1395bf45b2afde73ec0ff39ffb" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 42443 } } peers { permanent_uuid: "4380b55235c847d4a955766fc8339bab" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33233 } }
I20260808 11:36:17.039837 14067 leader_election.cc:288] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26fc1ca479234779baa048a757486533 (127.26.66.129:45797), 6d84ef1395bf45b2afde73ec0ff39ffb (127.26.66.131:42443)
I20260808 11:36:17.048094 14056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:17.040508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:55763 (local address 127.26.66.129:45797)
0808 11:36:17.040757 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:17.040766 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:17.041267 (+ 501us) server_negotiation.cc:407] Connection header received
0808 11:36:17.041559 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:17.041569 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:17.041680 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:17.041807 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:17.042455 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:17.043432 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:17.045962 (+ 2530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:17.047138 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:17.047320 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:17.047396 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:17.047685 (+ 289us) server_negotiation.cc:299] Negotiation successful
0808 11:36:17.047816 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 11:36:17.048256 14072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:17.040517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45797 (local address 127.26.66.130:55763)
0808 11:36:17.041153 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:17.041169 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:17.041363 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:17.041858 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:17.041863 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:17.041897 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:17.042298 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:17.042309 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:17.043602 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:17.043605 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:17.045794 (+ 2189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:17.045811 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:17.047363 (+ 1552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:17.047369 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:17.047519 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:17.047544 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 11:36:17.047620 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 11:36:17.047771 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"mutex_wait_us":25,"thread_start_us":345,"threads_started":1}
I20260808 11:36:17.048906 14073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:17.041352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:42443 (local address 127.26.66.130:55369)
0808 11:36:17.042123 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:17.042140 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:17.042285 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:17.042664 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:17.042667 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:17.042685 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:17.042984 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:17.042991 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:17.044191 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:17.044196 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:17.046179 (+ 1983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:17.046189 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:17.047809 (+ 1620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:17.047826 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:17.048053 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:17.048088 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 11:36:17.048209 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 11:36:17.048460 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":629,"mutex_wait_us":1,"thread_start_us":367,"threads_started":1}
I20260808 11:36:17.049383 14059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:17.041474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:55369 (local address 127.26.66.131:42443)
0808 11:36:17.041686 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:17.041693 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:17.042241 (+ 548us) server_negotiation.cc:407] Connection header received
0808 11:36:17.042455 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:17.042460 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:17.042542 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:17.042643 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:17.043145 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:17.044056 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:17.046350 (+ 2294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:17.047571 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:17.047750 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:17.047813 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:17.048989 (+ 1176us) server_negotiation.cc:299] Negotiation successful
0808 11:36:17.049130 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 11:36:17.049604 13709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b322dbede6342c4838bf2b775180167" candidate_uuid: "4380b55235c847d4a955766fc8339bab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26fc1ca479234779baa048a757486533" is_pre_election: true
I20260808 11:36:17.050271 13709 raft_consensus.cc:2454] T 9b322dbede6342c4838bf2b775180167 P 26fc1ca479234779baa048a757486533 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4380b55235c847d4a955766fc8339bab in term 0.
I20260808 11:36:17.050282 13992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b322dbede6342c4838bf2b775180167" candidate_uuid: "4380b55235c847d4a955766fc8339bab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d84ef1395bf45b2afde73ec0ff39ffb" is_pre_election: true
I20260808 11:36:17.050805 13992 raft_consensus.cc:2454] T 9b322dbede6342c4838bf2b775180167 P 6d84ef1395bf45b2afde73ec0ff39ffb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4380b55235c847d4a955766fc8339bab in term 0.
I20260808 11:36:17.051076 13780 leader_election.cc:302] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26fc1ca479234779baa048a757486533, 4380b55235c847d4a955766fc8339bab; no voters:
I20260808 11:36:17.051412 14068 raft_consensus.cc:482] T 9b322dbede6342c4838bf2b775180167 P 26fc1ca479234779baa048a757486533 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:36:17.051628 14067 raft_consensus.cc:2781] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:36:17.051808 14067 raft_consensus.cc:482] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:36:17.051937 14067 raft_consensus.cc:3037] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:17.051780 14068 raft_consensus.cc:504] T 9b322dbede6342c4838bf2b775180167 P 26fc1ca479234779baa048a757486533 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26fc1ca479234779baa048a757486533" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45797 } } peers { permanent_uuid: "6d84ef1395bf45b2afde73ec0ff39ffb" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 42443 } } peers { permanent_uuid: "4380b55235c847d4a955766fc8339bab" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33233 } }
I20260808 11:36:17.053366 14068 leader_election.cc:288] T 9b322dbede6342c4838bf2b775180167 P 26fc1ca479234779baa048a757486533 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d84ef1395bf45b2afde73ec0ff39ffb (127.26.66.131:42443), 4380b55235c847d4a955766fc8339bab (127.26.66.130:33233)
I20260808 11:36:17.055430 14067 raft_consensus.cc:504] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26fc1ca479234779baa048a757486533" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45797 } } peers { permanent_uuid: "6d84ef1395bf45b2afde73ec0ff39ffb" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 42443 } } peers { permanent_uuid: "4380b55235c847d4a955766fc8339bab" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33233 } }
I20260808 11:36:17.056777 14067 leader_election.cc:288] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab [CANDIDATE]: Term 1 election: Requested vote from peers 26fc1ca479234779baa048a757486533 (127.26.66.129:45797), 6d84ef1395bf45b2afde73ec0ff39ffb (127.26.66.131:42443)
I20260808 11:36:17.056893 13992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b322dbede6342c4838bf2b775180167" candidate_uuid: "4380b55235c847d4a955766fc8339bab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d84ef1395bf45b2afde73ec0ff39ffb"
I20260808 11:36:17.056937 13709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b322dbede6342c4838bf2b775180167" candidate_uuid: "4380b55235c847d4a955766fc8339bab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26fc1ca479234779baa048a757486533"
I20260808 11:36:17.057176 13709 raft_consensus.cc:3037] T 9b322dbede6342c4838bf2b775180167 P 26fc1ca479234779baa048a757486533 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:17.057166 13992 raft_consensus.cc:3037] T 9b322dbede6342c4838bf2b775180167 P 6d84ef1395bf45b2afde73ec0ff39ffb [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:17.060613 13992 raft_consensus.cc:2454] T 9b322dbede6342c4838bf2b775180167 P 6d84ef1395bf45b2afde73ec0ff39ffb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4380b55235c847d4a955766fc8339bab in term 1.
I20260808 11:36:17.060719 13709 raft_consensus.cc:2454] T 9b322dbede6342c4838bf2b775180167 P 26fc1ca479234779baa048a757486533 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4380b55235c847d4a955766fc8339bab in term 1.
I20260808 11:36:17.061123 13780 leader_election.cc:302] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4380b55235c847d4a955766fc8339bab, 6d84ef1395bf45b2afde73ec0ff39ffb; no voters:
I20260808 11:36:17.061478 14067 raft_consensus.cc:2781] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:36:17.062111 14067 raft_consensus.cc:686] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab [term 1 LEADER]: Becoming Leader. State: Replica: 4380b55235c847d4a955766fc8339bab, State: Running, Role: LEADER
I20260808 11:36:17.062747 14058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:17.054159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:56137 (local address 127.26.66.130:33233)
0808 11:36:17.054340 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:17.054347 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:17.055131 (+ 784us) server_negotiation.cc:407] Connection header received
0808 11:36:17.055330 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:17.055337 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:17.055447 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:17.055543 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:17.056400 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:17.057457 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:17.060322 (+ 2865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:17.061577 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:17.061699 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:17.061763 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:17.062328 (+ 565us) server_negotiation.cc:299] Negotiation successful
0808 11:36:17.062458 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 11:36:17.062764 14067 consensus_queue.cc:237] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26fc1ca479234779baa048a757486533" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45797 } } peers { permanent_uuid: "6d84ef1395bf45b2afde73ec0ff39ffb" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 42443 } } peers { permanent_uuid: "4380b55235c847d4a955766fc8339bab" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33233 } }
I20260808 11:36:17.063542 14075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:17.053612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:33233 (local address 127.26.66.129:56137)
0808 11:36:17.054989 (+ 1377us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:17.055025 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:17.055181 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:17.055718 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:17.055722 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:17.055752 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:17.056230 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:17.056245 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:17.057652 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:17.057657 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:17.060152 (+ 2495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:17.060166 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:17.061960 (+ 1794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:17.061966 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:17.062142 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:17.062175 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 11:36:17.062961 (+ 786us) client_negotiation.cc:240] Negotiation successful
0808 11:36:17.063098 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1212,"mutex_wait_us":49,"thread_start_us":1890,"threads_started":1}
I20260808 11:36:17.063612 14059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:17.053971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:37413 (local address 127.26.66.131:42443)
0808 11:36:17.054390 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:17.054399 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:17.055922 (+ 1523us) server_negotiation.cc:407] Connection header received
0808 11:36:17.056161 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:17.056166 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:17.056251 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:17.056334 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:17.057422 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:17.058582 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:17.061285 (+ 2703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:17.062485 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:17.062636 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:17.062698 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:17.063230 (+ 532us) server_negotiation.cc:299] Negotiation successful
0808 11:36:17.063353 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270}
I20260808 11:36:17.063735 14074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:17.053768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:42443 (local address 127.26.66.129:37413)
0808 11:36:17.055780 (+ 2012us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:17.055794 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:17.056023 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:17.056471 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:17.056475 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:17.056506 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:17.057199 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:17.057214 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:17.058808 (+ 1594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:17.058815 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:17.061112 (+ 2297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:17.061129 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:17.062883 (+ 1754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:17.062890 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:17.063071 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:17.063095 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 11:36:17.063205 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 11:36:17.063343 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1893,"mutex_wait_us":28,"thread_start_us":781,"threads_started":1}
I20260808 11:36:17.064747 13849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b322dbede6342c4838bf2b775180167" candidate_uuid: "26fc1ca479234779baa048a757486533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4380b55235c847d4a955766fc8339bab" is_pre_election: true
I20260808 11:36:17.064909 13992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b322dbede6342c4838bf2b775180167" candidate_uuid: "26fc1ca479234779baa048a757486533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d84ef1395bf45b2afde73ec0ff39ffb" is_pre_election: true
I20260808 11:36:17.065197 13992 raft_consensus.cc:2379] T 9b322dbede6342c4838bf2b775180167 P 6d84ef1395bf45b2afde73ec0ff39ffb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26fc1ca479234779baa048a757486533 in current term 1: Already voted for candidate 4380b55235c847d4a955766fc8339bab in this term.
I20260808 11:36:17.066058 13639 leader_election.cc:302] T 9b322dbede6342c4838bf2b775180167 P 26fc1ca479234779baa048a757486533 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26fc1ca479234779baa048a757486533; no voters: 4380b55235c847d4a955766fc8339bab, 6d84ef1395bf45b2afde73ec0ff39ffb
I20260808 11:36:17.066430 14068 raft_consensus.cc:2726] T 9b322dbede6342c4838bf2b775180167 P 26fc1ca479234779baa048a757486533 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 11:36:17.069224 13558 catalog_manager.cc:5495] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab reported cstate change: term changed from 0 to 1, leader changed from <none> to 4380b55235c847d4a955766fc8339bab (127.26.66.130). New cstate: current_term: 1 leader_uuid: "4380b55235c847d4a955766fc8339bab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26fc1ca479234779baa048a757486533" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d84ef1395bf45b2afde73ec0ff39ffb" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 42443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4380b55235c847d4a955766fc8339bab" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 33233 } health_report { overall_health: HEALTHY } } }
I20260808 11:36:17.188755 14058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:17.182655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43950 (local address 127.26.66.130:33233)
0808 11:36:17.182896 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:17.182904 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:17.183180 (+ 276us) server_negotiation.cc:407] Connection header received
0808 11:36:17.183437 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:17.183441 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:17.183521 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:17.183676 (+ 155us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:36:17.184183 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:17.184934 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:17.186355 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:17.186744 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:17.186894 (+ 150us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:17.187510 (+ 616us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:36:17.188107 (+ 597us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:36:17.188310 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:17.188432 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 11:36:17.188477 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 11:36:17.196362 13992 raft_consensus.cc:1261] T 9b322dbede6342c4838bf2b775180167 P 6d84ef1395bf45b2afde73ec0ff39ffb [term 1 FOLLOWER]: Refusing update from remote peer 4380b55235c847d4a955766fc8339bab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:36:17.196525 13709 raft_consensus.cc:1261] T 9b322dbede6342c4838bf2b775180167 P 26fc1ca479234779baa048a757486533 [term 1 FOLLOWER]: Refusing update from remote peer 4380b55235c847d4a955766fc8339bab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:36:17.197266 14076 consensus_queue.cc:1035] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d84ef1395bf45b2afde73ec0ff39ffb" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 42443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:36:17.197638 14067 consensus_queue.cc:1035] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab [LEADER]: Connected to new peer: Peer: permanent_uuid: "26fc1ca479234779baa048a757486533" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:36:17.208818 14080 mvcc.cc:205] Tried to move back new op lower bound from 7316230050586755072 to 7316230050056601600. Current Snapshot: MvccSnapshot[applied={T|T < 7316230050586755072}]
I20260808 11:36:17.224490 13559 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58508:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:36:17.224864 13559 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58508:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:36:17.228658 13559 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e8e71ce293134e219aea4066951210e0: Sending DeleteTablet for 3 replicas of tablet 9b322dbede6342c4838bf2b775180167
I20260808 11:36:17.229853 13968 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b322dbede6342c4838bf2b775180167 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:36:17 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:59566
I20260808 11:36:17.229822 13688 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b322dbede6342c4838bf2b775180167 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:36:17 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:53042
I20260808 11:36:17.230002 13828 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b322dbede6342c4838bf2b775180167 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:36:17 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:43936
I20260808 11:36:17.232798 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 13622
I20260808 11:36:17.245671 14091 tablet_replica.cc:330] T 9b322dbede6342c4838bf2b775180167 P 6d84ef1395bf45b2afde73ec0ff39ffb: stopping tablet replica
I20260808 11:36:17.246196 14091 raft_consensus.cc:2229] T 9b322dbede6342c4838bf2b775180167 P 6d84ef1395bf45b2afde73ec0ff39ffb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:36:17.246798 14091 raft_consensus.cc:2258] T 9b322dbede6342c4838bf2b775180167 P 6d84ef1395bf45b2afde73ec0ff39ffb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:36:17.251211 14091 ts_tablet_manager.cc:1905] T 9b322dbede6342c4838bf2b775180167 P 6d84ef1395bf45b2afde73ec0ff39ffb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:36:17.252764 14092 tablet_replica.cc:330] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab: stopping tablet replica
I20260808 11:36:17.253356 14092 raft_consensus.cc:2229] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab [term 1 LEADER]: Raft consensus shutting down.
I20260808 11:36:17.254274 14092 raft_consensus.cc:2258] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:36:17.256285 14092 ts_tablet_manager.cc:1905] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:36:17.256596 14090 tablet_replica.cc:330] T 9b322dbede6342c4838bf2b775180167 P 26fc1ca479234779baa048a757486533: stopping tablet replica
I20260808 11:36:17.257031 14090 raft_consensus.cc:2229] T 9b322dbede6342c4838bf2b775180167 P 26fc1ca479234779baa048a757486533 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:36:17.257551 14090 raft_consensus.cc:2258] T 9b322dbede6342c4838bf2b775180167 P 26fc1ca479234779baa048a757486533 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:36:17.259738 14090 ts_tablet_manager.cc:1905] T 9b322dbede6342c4838bf2b775180167 P 26fc1ca479234779baa048a757486533: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 11:36:17 dist-test-slave-zkpd krb5kdc[13513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188974, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.129@KRBTEST.COM
I20260808 11:36:17.264644 14092 ts_tablet_manager.cc:1918] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:36:17.264938 14092 log.cc:1196] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-1/wal/wals/9b322dbede6342c4838bf2b775180167
I20260808 11:36:17.265645 14092 ts_tablet_manager.cc:1939] T 9b322dbede6342c4838bf2b775180167 P 4380b55235c847d4a955766fc8339bab: Deleting consensus metadata
I20260808 11:36:17.265753 14091 ts_tablet_manager.cc:1918] T 9b322dbede6342c4838bf2b775180167 P 6d84ef1395bf45b2afde73ec0ff39ffb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:36:17.265955 14091 log.cc:1196] T 9b322dbede6342c4838bf2b775180167 P 6d84ef1395bf45b2afde73ec0ff39ffb: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-2/wal/wals/9b322dbede6342c4838bf2b775180167
I20260808 11:36:17.266528 14091 ts_tablet_manager.cc:1939] T 9b322dbede6342c4838bf2b775180167 P 6d84ef1395bf45b2afde73ec0ff39ffb: Deleting consensus metadata
I20260808 11:36:17.268100 13545 catalog_manager.cc:4841] TS 4380b55235c847d4a955766fc8339bab (127.26.66.130:33233): tablet 9b322dbede6342c4838bf2b775180167 (table test-table [id=819a43f05f6a409dacb61802c6016180]) successfully deleted
I20260808 11:36:17.268399 13544 catalog_manager.cc:4841] TS 6d84ef1395bf45b2afde73ec0ff39ffb (127.26.66.131:42443): tablet 9b322dbede6342c4838bf2b775180167 (table test-table [id=819a43f05f6a409dacb61802c6016180]) successfully deleted
I20260808 11:36:17.272148 14056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:17.234548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53056 (local address 127.26.66.129:45797)
0808 11:36:17.234771 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:17.234779 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:17.252036 (+ 17257us) server_negotiation.cc:407] Connection header received
0808 11:36:17.252263 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:17.252271 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:17.252392 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:17.252504 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:17.254668 (+ 2164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:17.255848 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:17.257821 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:17.258515 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:17.258615 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:17.264570 (+ 5955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:17.264588 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:17.264610 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:17.264669 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:17.268727 (+ 4058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:17.269463 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:17.269477 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:17.269479 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:17.269633 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:17.270054 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:17.270060 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:17.270063 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:17.270476 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:17.270800 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:17.271124 (+ 324us) server_negotiation.cc:299] Negotiation successful
0808 11:36:17.271455 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 11:36:17.272820 13751 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:17.382403 14090 ts_tablet_manager.cc:1918] T 9b322dbede6342c4838bf2b775180167 P 26fc1ca479234779baa048a757486533: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:36:17.382679 14090 log.cc:1196] T 9b322dbede6342c4838bf2b775180167 P 26fc1ca479234779baa048a757486533: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786188664137852-26890-0/minicluster-data/ts-0/wal/wals/9b322dbede6342c4838bf2b775180167
I20260808 11:36:17.383212 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 13622
W20260808 11:36:17.405967 13544 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.66.129:45797 (error 108)
I20260808 11:36:17.406106 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 13762
I20260808 11:36:17.408800 14096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:17.407583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45797 (local address 127.0.0.1:53064)
0808 11:36:17.408472 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:17.408584 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:45797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":765,"thread_start_us":626,"threads_started":1}
W20260808 11:36:17.409113 13544 catalog_manager.cc:4584] TS 26fc1ca479234779baa048a757486533 (127.26.66.129:45797): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9b322dbede6342c4838bf2b775180167: Network error: Client connection negotiation failed: client connection to 127.26.66.129:45797: connect: Connection refused (error 111)
Aug 08 11:36:17 dist-test-slave-zkpd krb5kdc[13513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188974, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.130@KRBTEST.COM
I20260808 11:36:17.424525 14058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:17.407265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43964 (local address 127.26.66.130:33233)
0808 11:36:17.407466 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:17.407472 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:17.407492 (+ 20us) server_negotiation.cc:407] Connection header received
0808 11:36:17.407565 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:17.407570 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:17.407711 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:17.407858 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:17.409586 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:17.410324 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:17.412427 (+ 2103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:17.412903 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:17.413007 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:17.418307 (+ 5300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:17.418321 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:17.418336 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:17.418367 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:17.421602 (+ 3235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:17.422316 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:17.422322 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:17.422325 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:17.422448 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:17.422872 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:17.422875 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:17.422877 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:17.423254 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:17.423572 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:17.423919 (+ 347us) server_negotiation.cc:299] Negotiation successful
0808 11:36:17.424150 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 11:36:17.425246 13890 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:17.463021 14096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:17.462447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45797 (local address 127.0.0.1:53078)
0808 11:36:17.462747 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:17.462857 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:45797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162}
I20260808 11:36:17.464651 14096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:17.463638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45797 (local address 127.0.0.1:53088)
0808 11:36:17.464387 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:17.464467 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:45797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":658,"thread_start_us":486,"threads_started":1}
I20260808 11:36:17.525135 14096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:17.524630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45797 (local address 127.0.0.1:53104)
0808 11:36:17.524870 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:17.524988 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:45797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260808 11:36:17.526191 14096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:17.525843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45797 (local address 127.0.0.1:53118)
0808 11:36:17.525979 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:17.526050 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:45797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 11:36:17.545797 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 13762
I20260808 11:36:17.569478 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 13903
Aug 08 11:36:17 dist-test-slave-zkpd krb5kdc[13513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188974, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.131@KRBTEST.COM
I20260808 11:36:17.585824 14099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:17.570303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59580 (local address 127.26.66.131:42443)
0808 11:36:17.570862 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:17.570866 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:17.570881 (+ 15us) server_negotiation.cc:407] Connection header received
0808 11:36:17.570934 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:17.570937 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:17.570993 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:17.571110 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:17.572660 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:17.573435 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:17.574732 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:17.575159 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:17.575307 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:17.579826 (+ 4519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:17.579843 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:17.579860 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:17.579944 (+ 84us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:17.582933 (+ 2989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:17.583607 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:17.583615 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:17.583617 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:17.583746 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:17.584243 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:17.584249 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:17.584253 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:17.584628 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:17.584959 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:17.585254 (+ 295us) server_negotiation.cc:299] Negotiation successful
0808 11:36:17.585504 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":282,"threads_started":1}
I20260808 11:36:17.586530 14035 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:17.606750 14096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:17.606197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45797 (local address 127.0.0.1:53134)
0808 11:36:17.606513 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:17.606614 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:45797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180}
I20260808 11:36:17.607864 14096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:17.607461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45797 (local address 127.0.0.1:53138)
0808 11:36:17.607664 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:17.607740 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:45797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260808 11:36:17.676276 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 13903
I20260808 11:36:17.697263 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 13526
I20260808 11:36:17.698395 13591 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:17.809715 14096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:17.809053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45797 (local address 127.0.0.1:53142)
0808 11:36:17.809315 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:17.809433 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:45797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260808 11:36:17.810043 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 13526
2026-08-08T11:36:17Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (5011 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T11:36:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:36:17Z Disabled control of system clock
I20260808 11:36:17.907148 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:46781
--webserver_interface=127.26.66.190
--webserver_port=0
--builtin_ntp_servers=127.26.66.148:45859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:46781
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 11:36:18.248724 14106 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:18.248999 14106 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:18.249083 14106 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:18.256222 14106 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:36:18.256320 14106 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:18.256366 14106 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:18.256424 14106 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:36:18.256469 14106 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:36:18.265220 14106 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:46781
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:46781
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:18.266391 14106 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:18.268172 14106 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:18.279731 14111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:18.279942 14112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:18.280484 14114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:18.280709 14106 server_base.cc:1034] running on GCE node
I20260808 11:36:18.281556 14106 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:18.283217 14106 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:18.284438 14106 hybrid_clock.cc:648] HybridClock initialized: now 1786188978284381 us; error 56 us; skew 500 ppm
I20260808 11:36:18.284854 14106 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:36:18.287175 14106 webserver.cc:460] Webserver started at http://127.26.66.190:40901/ using document root <none> and password file <none>
I20260808 11:36:18.287933 14106 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:18.288089 14106 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:18.288434 14106 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:18.291363 14106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "ae006cff90034c33b43d7574023c74fc"
format_stamp: "Formatted at 2026-08-08 11:36:18 on dist-test-slave-zkpd"
server_key: "fac004b6e96482d683c3cea66b81d481"
server_key_iv: "05f445c582a26c0d59f60926aa1be6f5"
server_key_version: "encryptionkey@0"
I20260808 11:36:18.292320 14106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "ae006cff90034c33b43d7574023c74fc"
format_stamp: "Formatted at 2026-08-08 11:36:18 on dist-test-slave-zkpd"
server_key: "fac004b6e96482d683c3cea66b81d481"
server_key_iv: "05f445c582a26c0d59f60926aa1be6f5"
server_key_version: "encryptionkey@0"
I20260808 11:36:18.298080 14106 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 11:36:18.301611 14120 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:18.302882 14106 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 11:36:18.303079 14106 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "ae006cff90034c33b43d7574023c74fc"
format_stamp: "Formatted at 2026-08-08 11:36:18 on dist-test-slave-zkpd"
server_key: "fac004b6e96482d683c3cea66b81d481"
server_key_iv: "05f445c582a26c0d59f60926aa1be6f5"
server_key_version: "encryptionkey@0"
I20260808 11:36:18.303321 14106 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:18.324939 14106 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:18.325763 14106 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:18.326058 14106 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:18.344998 14106 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:46781
I20260808 11:36:18.345018 14176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:46781 every 8 connection(s)
I20260808 11:36:18.346365 14106 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:36:18.350056 14177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:18.355973 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 14106
I20260808 11:36:18.356177 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:36:18.356727 26890 external_mini_cluster.cc:1428] Setting key d0ea2e9cc34ea8fca9e9e48c41abfeab
I20260808 11:36:18.361481 14177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae006cff90034c33b43d7574023c74fc: Bootstrap starting.
I20260808 11:36:18.364645 14177 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ae006cff90034c33b43d7574023c74fc: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:18.365617 14177 log.cc:824] T 00000000000000000000000000000000 P ae006cff90034c33b43d7574023c74fc: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:18.368556 14177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae006cff90034c33b43d7574023c74fc: No bootstrap required, opened a new log
I20260808 11:36:18.370908 14180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:18.358825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44080 (local address 127.26.66.190:46781)
0808 11:36:18.359834 (+ 1009us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:18.359845 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:18.359884 (+ 39us) server_negotiation.cc:407] Connection header received
0808 11:36:18.361690 (+ 1806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:18.361714 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:18.362186 (+ 472us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:18.362560 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:18.363134 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:18.364468 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:18.365937 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:18.367081 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:18.367279 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:18.368597 (+ 1318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:18.368604 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:18.368617 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:18.369195 (+ 578us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:18.369281 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:18.369301 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:18.369445 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:18.369666 (+ 221us) server_negotiation.cc:299] Negotiation successful
0808 11:36:18.369973 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":356,"threads_started":1}
I20260808 11:36:18.376782 14177 raft_consensus.cc:348] T 00000000000000000000000000000000 P ae006cff90034c33b43d7574023c74fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae006cff90034c33b43d7574023c74fc" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46781 } }
I20260808 11:36:18.377141 14177 raft_consensus.cc:374] T 00000000000000000000000000000000 P ae006cff90034c33b43d7574023c74fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:18.377249 14177 raft_consensus.cc:729] T 00000000000000000000000000000000 P ae006cff90034c33b43d7574023c74fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae006cff90034c33b43d7574023c74fc, State: Initialized, Role: FOLLOWER
I20260808 11:36:18.377754 14177 consensus_queue.cc:260] T 00000000000000000000000000000000 P ae006cff90034c33b43d7574023c74fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae006cff90034c33b43d7574023c74fc" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46781 } }
I20260808 11:36:18.378008 14177 raft_consensus.cc:388] T 00000000000000000000000000000000 P ae006cff90034c33b43d7574023c74fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:36:18.378158 14177 raft_consensus.cc:482] T 00000000000000000000000000000000 P ae006cff90034c33b43d7574023c74fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:36:18.378334 14177 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ae006cff90034c33b43d7574023c74fc [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:18.380584 14177 raft_consensus.cc:504] T 00000000000000000000000000000000 P ae006cff90034c33b43d7574023c74fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae006cff90034c33b43d7574023c74fc" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46781 } }
I20260808 11:36:18.381083 14177 leader_election.cc:302] T 00000000000000000000000000000000 P ae006cff90034c33b43d7574023c74fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ae006cff90034c33b43d7574023c74fc; no voters:
I20260808 11:36:18.381628 14177 leader_election.cc:288] T 00000000000000000000000000000000 P ae006cff90034c33b43d7574023c74fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:36:18.381817 14182 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ae006cff90034c33b43d7574023c74fc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:36:18.382587 14182 raft_consensus.cc:686] T 00000000000000000000000000000000 P ae006cff90034c33b43d7574023c74fc [term 1 LEADER]: Becoming Leader. State: Replica: ae006cff90034c33b43d7574023c74fc, State: Running, Role: LEADER
I20260808 11:36:18.383092 14182 consensus_queue.cc:237] T 00000000000000000000000000000000 P ae006cff90034c33b43d7574023c74fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae006cff90034c33b43d7574023c74fc" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46781 } }
I20260808 11:36:18.383706 14177 sys_catalog.cc:564] T 00000000000000000000000000000000 P ae006cff90034c33b43d7574023c74fc [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:36:18.385953 14184 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae006cff90034c33b43d7574023c74fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader ae006cff90034c33b43d7574023c74fc. Latest consensus state: current_term: 1 leader_uuid: "ae006cff90034c33b43d7574023c74fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae006cff90034c33b43d7574023c74fc" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46781 } } }
I20260808 11:36:18.385983 14183 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae006cff90034c33b43d7574023c74fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ae006cff90034c33b43d7574023c74fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae006cff90034c33b43d7574023c74fc" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46781 } } }
I20260808 11:36:18.386495 14183 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae006cff90034c33b43d7574023c74fc [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:18.387189 14184 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae006cff90034c33b43d7574023c74fc [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:18.388090 14187 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:36:18.392824 14187 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:36:18.400880 14187 catalog_manager.cc:1347] Generated new cluster ID: ce1b3a742a104c75b5c4b4a9ac4c3017
I20260808 11:36:18.400993 14187 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:36:18.423163 14187 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:36:18.424973 14187 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:36:18.435555 14187 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ae006cff90034c33b43d7574023c74fc: Generated new TSK 0
I20260808 11:36:18.436583 14187 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:36:18.449110 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:0
--local_ip_for_outbound_sockets=127.26.66.129
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46781
--builtin_ntp_servers=127.26.66.148:45859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 11:36:18.795498 14201 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:18.795768 14201 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:18.795853 14201 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:18.803117 14201 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:18.803211 14201 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:18.803321 14201 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:36:18.812322 14201 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46781
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:18.813444 14201 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:18.815104 14201 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:18.832952 14206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:18.832854 14207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:18.832914 14210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:18.833986 14201 server_base.cc:1034] running on GCE node
I20260808 11:36:18.834499 14201 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:18.835397 14201 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:18.836622 14201 hybrid_clock.cc:648] HybridClock initialized: now 1786188978836583 us; error 30 us; skew 500 ppm
I20260808 11:36:18.836927 14201 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:36:18.839169 14201 webserver.cc:460] Webserver started at http://127.26.66.129:40811/ using document root <none> and password file <none>
I20260808 11:36:18.839810 14201 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:18.839978 14201 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:18.840270 14201 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:18.843075 14201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-0/data/instance:
uuid: "8af335f9d4ad4f3b90f9b8839eb49dd6"
format_stamp: "Formatted at 2026-08-08 11:36:18 on dist-test-slave-zkpd"
server_key: "cb209a2dc97e64e331f6d16060c7acec"
server_key_iv: "330d2e1ef18c968e913fa6b78e36c1d9"
server_key_version: "encryptionkey@0"
I20260808 11:36:18.843827 14201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance:
uuid: "8af335f9d4ad4f3b90f9b8839eb49dd6"
format_stamp: "Formatted at 2026-08-08 11:36:18 on dist-test-slave-zkpd"
server_key: "cb209a2dc97e64e331f6d16060c7acec"
server_key_iv: "330d2e1ef18c968e913fa6b78e36c1d9"
server_key_version: "encryptionkey@0"
I20260808 11:36:18.848824 14201 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 11:36:18.852253 14216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:18.853574 14201 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 11:36:18.853734 14201 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "8af335f9d4ad4f3b90f9b8839eb49dd6"
format_stamp: "Formatted at 2026-08-08 11:36:18 on dist-test-slave-zkpd"
server_key: "cb209a2dc97e64e331f6d16060c7acec"
server_key_iv: "330d2e1ef18c968e913fa6b78e36c1d9"
server_key_version: "encryptionkey@0"
I20260808 11:36:18.853910 14201 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:18.877188 14201 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:18.878002 14201 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:18.878265 14201 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:18.879170 14201 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:36:18.880822 14201 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:36:18.880913 14201 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:18.880995 14201 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:36:18.881055 14201 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:18.915334 14201 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:45539
I20260808 11:36:18.915433 14335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:45539 every 8 connection(s)
I20260808 11:36:18.916949 14201 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:36:18.923660 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 14201
I20260808 11:36:18.923871 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance
I20260808 11:36:18.924446 26890 external_mini_cluster.cc:1428] Setting key e10ab007e3544ec91bdcfb4a4aed86c6
I20260808 11:36:18.927412 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:0
--local_ip_for_outbound_sockets=127.26.66.130
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46781
--builtin_ntp_servers=127.26.66.148:45859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 11:36:18.930794 14338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:18.919648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:53111 (local address 127.26.66.190:46781)
0808 11:36:18.920165 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:18.920170 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:18.921334 (+ 1164us) server_negotiation.cc:407] Connection header received
0808 11:36:18.923166 (+ 1832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:18.923172 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:18.923269 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:18.923396 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:18.924641 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:18.925746 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:18.927609 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:18.928383 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:18.928540 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:18.929845 (+ 1305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:18.929854 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:18.929861 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:18.929886 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:18.929943 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:18.929961 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:18.930061 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:18.930255 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 11:36:18.930362 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":302,"threads_started":1}
I20260808 11:36:18.931568 14339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:18.920277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:46781 (local address 127.26.66.129:53111)
0808 11:36:18.921182 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:18.921218 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:18.922887 (+ 1669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:18.923620 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:18.923628 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:18.923718 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:36:18.924423 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:18.924440 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:18.925942 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:18.925948 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:18.927416 (+ 1468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:18.927429 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:18.928596 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:18.928601 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:18.928803 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:18.929525 (+ 722us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 11:36:18.929528 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:36:18.929567 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 11:36:18.929646 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:36:18.930064 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:36:18.930072 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:36:18.930078 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 11:36:18.930212 (+ 134us) client_negotiation.cc:240] Negotiation successful
0808 11:36:18.930494 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":282,"threads_started":1}
I20260808 11:36:18.933095 14336 heartbeater.cc:347] Connected to a master server at 127.26.66.190:46781
I20260808 11:36:18.933410 14336 heartbeater.cc:464] Registering TS with master...
I20260808 11:36:18.934127 14336 heartbeater.cc:511] Master 127.26.66.190:46781 requested a full tablet report, sending...
I20260808 11:36:18.936358 14138 ts_manager.cc:194] Registered new tserver with Master: 8af335f9d4ad4f3b90f9b8839eb49dd6 (127.26.66.129:45539)
I20260808 11:36:18.937762 14138 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.66.129:53111
W20260808 11:36:19.274508 14340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:19.274791 14340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:19.274945 14340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:19.282147 14340 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:19.282238 14340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:19.282424 14340 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:36:19.291613 14340 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46781
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:19.292994 14340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:19.294785 14340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:19.308339 14347 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:19.308393 14350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:19.308320 14348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:19.309165 14340 server_base.cc:1034] running on GCE node
I20260808 11:36:19.309698 14340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:19.310552 14340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:19.311756 14340 hybrid_clock.cc:648] HybridClock initialized: now 1786188979311672 us; error 71 us; skew 500 ppm
I20260808 11:36:19.312109 14340 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:36:19.314363 14340 webserver.cc:460] Webserver started at http://127.26.66.130:33073/ using document root <none> and password file <none>
I20260808 11:36:19.314975 14340 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:19.315060 14340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:19.315317 14340 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:19.318182 14340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-1/data/instance:
uuid: "388768b564094b3ba54f09afd1c81c8f"
format_stamp: "Formatted at 2026-08-08 11:36:19 on dist-test-slave-zkpd"
server_key: "3ce1256be8ee15bd43ba5f762f6d2049"
server_key_iv: "8d19345bc8e3ac38674263f1b80e3246"
server_key_version: "encryptionkey@0"
I20260808 11:36:19.318913 14340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance:
uuid: "388768b564094b3ba54f09afd1c81c8f"
format_stamp: "Formatted at 2026-08-08 11:36:19 on dist-test-slave-zkpd"
server_key: "3ce1256be8ee15bd43ba5f762f6d2049"
server_key_iv: "8d19345bc8e3ac38674263f1b80e3246"
server_key_version: "encryptionkey@0"
I20260808 11:36:19.323731 14340 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 11:36:19.327190 14356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:19.328727 14340 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:36:19.328874 14340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "388768b564094b3ba54f09afd1c81c8f"
format_stamp: "Formatted at 2026-08-08 11:36:19 on dist-test-slave-zkpd"
server_key: "3ce1256be8ee15bd43ba5f762f6d2049"
server_key_iv: "8d19345bc8e3ac38674263f1b80e3246"
server_key_version: "encryptionkey@0"
I20260808 11:36:19.329058 14340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:19.352175 14340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:19.353096 14340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:19.353443 14340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:19.354599 14340 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:36:19.356460 14340 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:36:19.356565 14340 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:19.356660 14340 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:36:19.356729 14340 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:19.393594 14340 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:32827
I20260808 11:36:19.393683 14475 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:32827 every 8 connection(s)
I20260808 11:36:19.394915 14340 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:36:19.402577 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 14340
I20260808 11:36:19.402781 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance
I20260808 11:36:19.403344 26890 external_mini_cluster.cc:1428] Setting key 16cb0f41c2c43f976990755c05470a63
I20260808 11:36:19.406457 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:0
--local_ip_for_outbound_sockets=127.26.66.131
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46781
--builtin_ntp_servers=127.26.66.148:45859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 11:36:19.408566 14338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:19.397738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:39889 (local address 127.26.66.190:46781)
0808 11:36:19.397944 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:19.397949 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:19.399411 (+ 1462us) server_negotiation.cc:407] Connection header received
0808 11:36:19.401291 (+ 1880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:19.401296 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:19.401364 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:19.401454 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:19.402518 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:19.403669 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:19.405567 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:19.405960 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:19.406100 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:19.407682 (+ 1582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:19.407706 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:19.407713 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:19.407738 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:19.407778 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:19.407799 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:19.407916 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:19.408159 (+ 243us) server_negotiation.cc:299] Negotiation successful
0808 11:36:19.408252 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 11:36:19.409600 14478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:19.398263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:46781 (local address 127.26.66.130:39889)
0808 11:36:19.399208 (+ 945us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:19.399246 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:19.401024 (+ 1778us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:19.401658 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:19.401666 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:19.401752 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:36:19.402340 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:19.402357 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:19.403844 (+ 1487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:19.403848 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:19.405421 (+ 1573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:19.405434 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:19.406187 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:19.406194 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:19.406474 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:19.407327 (+ 853us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 11:36:19.407330 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:36:19.407368 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 11:36:19.407478 (+ 110us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:36:19.407922 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:36:19.407935 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:36:19.407944 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 11:36:19.408144 (+ 200us) client_negotiation.cc:240] Negotiation successful
0808 11:36:19.408516 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":294,"threads_started":1}
I20260808 11:36:19.411056 14476 heartbeater.cc:347] Connected to a master server at 127.26.66.190:46781
I20260808 11:36:19.411391 14476 heartbeater.cc:464] Registering TS with master...
I20260808 11:36:19.412385 14476 heartbeater.cc:511] Master 127.26.66.190:46781 requested a full tablet report, sending...
I20260808 11:36:19.414050 14138 ts_manager.cc:194] Registered new tserver with Master: 388768b564094b3ba54f09afd1c81c8f (127.26.66.130:32827)
I20260808 11:36:19.415370 14138 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.66.130:39889
W20260808 11:36:19.758759 14479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:19.759068 14479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:19.759239 14479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:19.766296 14479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:19.766422 14479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:19.766592 14479 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:36:19.775269 14479 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46781
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:19.776566 14479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:19.778501 14479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:19.792114 14485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:19.792152 14484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:19.792738 14487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:19.793054 14479 server_base.cc:1034] running on GCE node
I20260808 11:36:19.793641 14479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:19.794606 14479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:19.795840 14479 hybrid_clock.cc:648] HybridClock initialized: now 1786188979795809 us; error 84 us; skew 500 ppm
I20260808 11:36:19.796162 14479 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:36:19.798277 14479 webserver.cc:460] Webserver started at http://127.26.66.131:45579/ using document root <none> and password file <none>
I20260808 11:36:19.798915 14479 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:19.799002 14479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:19.799257 14479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:19.802242 14479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-2/data/instance:
uuid: "fbfde83b4c4747109dcc6348fec574fc"
format_stamp: "Formatted at 2026-08-08 11:36:19 on dist-test-slave-zkpd"
server_key: "ce097d1a082f37339a48654ce9bd8e01"
server_key_iv: "89125230a90e0e21ff390f83f62a001e"
server_key_version: "encryptionkey@0"
I20260808 11:36:19.802970 14479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance:
uuid: "fbfde83b4c4747109dcc6348fec574fc"
format_stamp: "Formatted at 2026-08-08 11:36:19 on dist-test-slave-zkpd"
server_key: "ce097d1a082f37339a48654ce9bd8e01"
server_key_iv: "89125230a90e0e21ff390f83f62a001e"
server_key_version: "encryptionkey@0"
I20260808 11:36:19.808101 14479 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.007s
I20260808 11:36:19.811331 14493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:19.812620 14479 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 11:36:19.812796 14479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "fbfde83b4c4747109dcc6348fec574fc"
format_stamp: "Formatted at 2026-08-08 11:36:19 on dist-test-slave-zkpd"
server_key: "ce097d1a082f37339a48654ce9bd8e01"
server_key_iv: "89125230a90e0e21ff390f83f62a001e"
server_key_version: "encryptionkey@0"
I20260808 11:36:19.813014 14479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:19.841923 14479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:19.842731 14479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:19.843026 14479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:19.844044 14479 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:36:19.845520 14479 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:36:19.845645 14479 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:19.845784 14479 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:36:19.845875 14479 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:19.881057 14479 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:34809
I20260808 11:36:19.881147 14611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:34809 every 8 connection(s)
I20260808 11:36:19.882385 14479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:36:19.892520 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 14479
I20260808 11:36:19.892712 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance
I20260808 11:36:19.893329 26890 external_mini_cluster.cc:1428] Setting key e423573022051d19b0624f66c397a42b
I20260808 11:36:19.895241 14338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:19.885174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:47739 (local address 127.26.66.190:46781)
0808 11:36:19.885402 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:19.885408 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:19.886884 (+ 1476us) server_negotiation.cc:407] Connection header received
0808 11:36:19.888739 (+ 1855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:19.888743 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:19.888819 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:19.888911 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:19.889952 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:19.890672 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:19.892231 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:19.892670 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:19.892802 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:19.894284 (+ 1482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:19.894291 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:19.894295 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:19.894316 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:19.894360 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:19.894377 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:19.894499 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:19.894805 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 11:36:19.894900 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 11:36:19.896308 14615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:19.885782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:46781 (local address 127.26.66.131:47739)
0808 11:36:19.886723 (+ 941us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:19.886762 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:19.888483 (+ 1721us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:19.889159 (+ 676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:19.889166 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:19.889247 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:36:19.889790 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:19.889810 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:19.890801 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:19.890804 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:19.892080 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:19.892092 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:19.892932 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:19.892940 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:19.893231 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:19.893980 (+ 749us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 11:36:19.893983 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:36:19.894024 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 11:36:19.894091 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:36:19.894513 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:36:19.894527 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:36:19.894534 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 11:36:19.894747 (+ 213us) client_negotiation.cc:240] Negotiation successful
0808 11:36:19.895079 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":276,"threads_started":1}
I20260808 11:36:19.897622 14613 heartbeater.cc:347] Connected to a master server at 127.26.66.190:46781
I20260808 11:36:19.897915 14613 heartbeater.cc:464] Registering TS with master...
I20260808 11:36:19.898628 14613 heartbeater.cc:511] Master 127.26.66.190:46781 requested a full tablet report, sending...
I20260808 11:36:19.900034 14138 ts_manager.cc:194] Registered new tserver with Master: fbfde83b4c4747109dcc6348fec574fc (127.26.66.131:34809)
I20260808 11:36:19.900872 14138 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.66.131:47739
I20260808 11:36:19.908581 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 11:36:19.918813 14338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:19.912594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44088 (local address 127.26.66.190:46781)
0808 11:36:19.912827 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:19.912834 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:19.913177 (+ 343us) server_negotiation.cc:407] Connection header received
0808 11:36:19.913370 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:19.913375 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:19.913451 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:19.913556 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:19.914045 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:19.914724 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:19.916170 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:19.916708 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:19.916841 (+ 133us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:19.918083 (+ 1242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:19.918093 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:19.918096 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:19.918114 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:19.918144 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:19.918155 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:19.918307 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:19.918520 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 11:36:19.918575 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 11:36:19.922573 14138 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44088:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 11:36:19.929311 14138 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:36:19.940636 14336 heartbeater.cc:503] Master 127.26.66.190:46781 was elected leader, sending a full tablet report...
I20260808 11:36:19.964093 14625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:19.941563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45539 (local address 127.0.0.1:42932)
0808 11:36:19.953789 (+ 12226us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:19.953852 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:19.954044 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:19.955102 (+ 1058us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:19.955109 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:19.955139 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:19.955834 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:19.955856 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:19.957862 (+ 2006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:19.957867 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:19.960763 (+ 2896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:19.960780 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:19.962925 (+ 2145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:19.962933 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:19.963163 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:19.963297 (+ 134us) client_negotiation.cc:769] Sending connection context
0808 11:36:19.963420 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 11:36:19.963618 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11960,"mutex_wait_us":139,"spinlock_wait_cycles":2816,"thread_start_us":11756,"threads_started":1}
I20260808 11:36:19.964367 14629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:19.942418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36412 (local address 127.26.66.131:34809)
0808 11:36:19.952584 (+ 10166us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:19.952598 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:19.954249 (+ 1651us) server_negotiation.cc:407] Connection header received
0808 11:36:19.954374 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:19.954384 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:19.954641 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:19.954829 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:19.956214 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:19.958013 (+ 1799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:19.960829 (+ 2816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:19.962341 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:19.962479 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:19.962773 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:19.963759 (+ 986us) server_negotiation.cc:299] Negotiation successful
0808 11:36:19.963969 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9930,"thread_start_us":10174,"threads_started":1}
I20260808 11:36:19.964557 14630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:19.942814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49054 (local address 127.26.66.130:32827)
0808 11:36:19.955593 (+ 12779us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:19.955603 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:19.956527 (+ 924us) server_negotiation.cc:407] Connection header received
0808 11:36:19.956631 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:19.956640 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:19.956849 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:19.957100 (+ 251us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:19.957792 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:19.959796 (+ 2004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:19.961917 (+ 2121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:19.963152 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:19.963294 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:19.963540 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:19.964019 (+ 479us) server_negotiation.cc:299] Negotiation successful
0808 11:36:19.964184 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12600,"thread_start_us":12464,"threads_started":1}
I20260808 11:36:19.964892 14628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:19.942298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:32827 (local address 127.0.0.1:49054)
0808 11:36:19.956247 (+ 13949us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:19.956272 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:19.956403 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:19.957088 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:19.957093 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:19.957118 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:19.957601 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:19.957612 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:19.959939 (+ 2327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:19.959945 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:19.961710 (+ 1765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:19.961722 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:19.963671 (+ 1949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:19.963675 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:19.963799 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:19.963821 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 11:36:19.963973 (+ 152us) client_negotiation.cc:240] Negotiation successful
0808 11:36:19.964109 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13836,"mutex_wait_us":30,"thread_start_us":13582,"threads_started":1}
I20260808 11:36:19.965113 14626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:19.941745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42932 (local address 127.26.66.129:45539)
0808 11:36:19.953302 (+ 11557us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:19.953314 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:19.954247 (+ 933us) server_negotiation.cc:407] Connection header received
0808 11:36:19.954359 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:19.954366 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:19.954594 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:19.954801 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:19.956211 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:19.957696 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:19.960982 (+ 3286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:19.962344 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:19.962479 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:19.962767 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:19.964556 (+ 1789us) server_negotiation.cc:299] Negotiation successful
0808 11:36:19.964727 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11350,"thread_start_us":11188,"threads_started":1}
I20260808 11:36:19.966213 14627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:19.941858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:34809 (local address 127.0.0.1:36412)
0808 11:36:19.953813 (+ 11955us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:19.953853 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:19.954045 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:19.955176 (+ 1131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:19.955183 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:19.955236 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:19.955955 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:19.955972 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:19.958201 (+ 2229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:19.958207 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:19.960615 (+ 2408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:19.960628 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:19.963240 (+ 2612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:19.963246 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:19.963426 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:19.963455 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 11:36:19.963516 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 11:36:19.963618 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11790,"mutex_wait_us":59,"spinlock_wait_cycles":15744,"thread_start_us":11641,"threads_started":1}
I20260808 11:36:19.968953 14405 tablet_service.cc:1467] Processing CreateTablet for tablet 15bd479e81424aab98302a86633a840a (DEFAULT_TABLE table=test-table [id=e8450c1d4e674585b1b45009e93a1cbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:36:19.968950 14266 tablet_service.cc:1467] Processing CreateTablet for tablet 15bd479e81424aab98302a86633a840a (DEFAULT_TABLE table=test-table [id=e8450c1d4e674585b1b45009e93a1cbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:36:19.970446 14405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15bd479e81424aab98302a86633a840a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:19.970460 14266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15bd479e81424aab98302a86633a840a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:19.970886 14541 tablet_service.cc:1467] Processing CreateTablet for tablet 15bd479e81424aab98302a86633a840a (DEFAULT_TABLE table=test-table [id=e8450c1d4e674585b1b45009e93a1cbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:36:19.972271 14541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15bd479e81424aab98302a86633a840a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:19.984916 14631 tablet_bootstrap.cc:492] T 15bd479e81424aab98302a86633a840a P fbfde83b4c4747109dcc6348fec574fc: Bootstrap starting.
I20260808 11:36:19.988669 14633 tablet_bootstrap.cc:492] T 15bd479e81424aab98302a86633a840a P 388768b564094b3ba54f09afd1c81c8f: Bootstrap starting.
I20260808 11:36:19.989420 14631 tablet_bootstrap.cc:654] T 15bd479e81424aab98302a86633a840a P fbfde83b4c4747109dcc6348fec574fc: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:19.990892 14631 log.cc:824] T 15bd479e81424aab98302a86633a840a P fbfde83b4c4747109dcc6348fec574fc: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:19.992611 14633 tablet_bootstrap.cc:654] T 15bd479e81424aab98302a86633a840a P 388768b564094b3ba54f09afd1c81c8f: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:19.992672 14632 tablet_bootstrap.cc:492] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6: Bootstrap starting.
I20260808 11:36:19.994042 14633 log.cc:824] T 15bd479e81424aab98302a86633a840a P 388768b564094b3ba54f09afd1c81c8f: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:19.995803 14632 tablet_bootstrap.cc:654] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:19.996784 14632 log.cc:824] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:19.996845 14631 tablet_bootstrap.cc:492] T 15bd479e81424aab98302a86633a840a P fbfde83b4c4747109dcc6348fec574fc: No bootstrap required, opened a new log
I20260808 11:36:19.997179 14631 ts_tablet_manager.cc:1397] T 15bd479e81424aab98302a86633a840a P fbfde83b4c4747109dcc6348fec574fc: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.003s
I20260808 11:36:19.999547 14632 tablet_bootstrap.cc:492] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6: No bootstrap required, opened a new log
I20260808 11:36:19.999820 14632 ts_tablet_manager.cc:1397] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260808 11:36:20.006740 14633 tablet_bootstrap.cc:492] T 15bd479e81424aab98302a86633a840a P 388768b564094b3ba54f09afd1c81c8f: No bootstrap required, opened a new log
I20260808 11:36:20.007033 14633 ts_tablet_manager.cc:1397] T 15bd479e81424aab98302a86633a840a P 388768b564094b3ba54f09afd1c81c8f: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.008s
I20260808 11:36:20.008150 14632 raft_consensus.cc:348] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af335f9d4ad4f3b90f9b8839eb49dd6" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45539 } } peers { permanent_uuid: "fbfde83b4c4747109dcc6348fec574fc" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34809 } } peers { permanent_uuid: "388768b564094b3ba54f09afd1c81c8f" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 32827 } }
I20260808 11:36:20.008538 14632 raft_consensus.cc:374] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:20.008642 14632 raft_consensus.cc:729] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8af335f9d4ad4f3b90f9b8839eb49dd6, State: Initialized, Role: FOLLOWER
I20260808 11:36:20.009281 14632 consensus_queue.cc:260] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af335f9d4ad4f3b90f9b8839eb49dd6" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45539 } } peers { permanent_uuid: "fbfde83b4c4747109dcc6348fec574fc" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34809 } } peers { permanent_uuid: "388768b564094b3ba54f09afd1c81c8f" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 32827 } }
I20260808 11:36:20.009534 14631 raft_consensus.cc:348] T 15bd479e81424aab98302a86633a840a P fbfde83b4c4747109dcc6348fec574fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af335f9d4ad4f3b90f9b8839eb49dd6" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45539 } } peers { permanent_uuid: "fbfde83b4c4747109dcc6348fec574fc" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34809 } } peers { permanent_uuid: "388768b564094b3ba54f09afd1c81c8f" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 32827 } }
I20260808 11:36:20.010033 14631 raft_consensus.cc:374] T 15bd479e81424aab98302a86633a840a P fbfde83b4c4747109dcc6348fec574fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:20.010138 14631 raft_consensus.cc:729] T 15bd479e81424aab98302a86633a840a P fbfde83b4c4747109dcc6348fec574fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbfde83b4c4747109dcc6348fec574fc, State: Initialized, Role: FOLLOWER
I20260808 11:36:20.010824 14631 consensus_queue.cc:260] T 15bd479e81424aab98302a86633a840a P fbfde83b4c4747109dcc6348fec574fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af335f9d4ad4f3b90f9b8839eb49dd6" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45539 } } peers { permanent_uuid: "fbfde83b4c4747109dcc6348fec574fc" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34809 } } peers { permanent_uuid: "388768b564094b3ba54f09afd1c81c8f" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 32827 } }
I20260808 11:36:20.012820 14613 heartbeater.cc:503] Master 127.26.66.190:46781 was elected leader, sending a full tablet report...
I20260808 11:36:20.014118 14632 ts_tablet_manager.cc:1428] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6: Time spent starting tablet: real 0.014s user 0.003s sys 0.009s
I20260808 11:36:20.014771 14631 ts_tablet_manager.cc:1428] T 15bd479e81424aab98302a86633a840a P fbfde83b4c4747109dcc6348fec574fc: Time spent starting tablet: real 0.017s user 0.016s sys 0.001s
I20260808 11:36:20.017441 14633 raft_consensus.cc:348] T 15bd479e81424aab98302a86633a840a P 388768b564094b3ba54f09afd1c81c8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af335f9d4ad4f3b90f9b8839eb49dd6" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45539 } } peers { permanent_uuid: "fbfde83b4c4747109dcc6348fec574fc" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34809 } } peers { permanent_uuid: "388768b564094b3ba54f09afd1c81c8f" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 32827 } }
I20260808 11:36:20.017902 14633 raft_consensus.cc:374] T 15bd479e81424aab98302a86633a840a P 388768b564094b3ba54f09afd1c81c8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:20.018010 14633 raft_consensus.cc:729] T 15bd479e81424aab98302a86633a840a P 388768b564094b3ba54f09afd1c81c8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 388768b564094b3ba54f09afd1c81c8f, State: Initialized, Role: FOLLOWER
I20260808 11:36:20.018718 14633 consensus_queue.cc:260] T 15bd479e81424aab98302a86633a840a P 388768b564094b3ba54f09afd1c81c8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af335f9d4ad4f3b90f9b8839eb49dd6" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45539 } } peers { permanent_uuid: "fbfde83b4c4747109dcc6348fec574fc" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34809 } } peers { permanent_uuid: "388768b564094b3ba54f09afd1c81c8f" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 32827 } }
I20260808 11:36:20.020042 14476 heartbeater.cc:503] Master 127.26.66.190:46781 was elected leader, sending a full tablet report...
I20260808 11:36:20.020588 14633 ts_tablet_manager.cc:1428] T 15bd479e81424aab98302a86633a840a P 388768b564094b3ba54f09afd1c81c8f: Time spent starting tablet: real 0.013s user 0.010s sys 0.005s
I20260808 11:36:20.030563 14637 raft_consensus.cc:482] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:36:20.030872 14637 raft_consensus.cc:504] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af335f9d4ad4f3b90f9b8839eb49dd6" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45539 } } peers { permanent_uuid: "fbfde83b4c4747109dcc6348fec574fc" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34809 } } peers { permanent_uuid: "388768b564094b3ba54f09afd1c81c8f" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 32827 } }
I20260808 11:36:20.032658 14637 leader_election.cc:288] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbfde83b4c4747109dcc6348fec574fc (127.26.66.131:34809), 388768b564094b3ba54f09afd1c81c8f (127.26.66.130:32827)
I20260808 11:36:20.039629 14630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:20.033187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:41635 (local address 127.26.66.130:32827)
0808 11:36:20.033461 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:20.033467 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:20.034172 (+ 705us) server_negotiation.cc:407] Connection header received
0808 11:36:20.034369 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:20.034374 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:20.034467 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:20.034575 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:20.035269 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:20.036048 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:20.037826 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:20.038601 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:20.038723 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:20.038801 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:20.039197 (+ 396us) server_negotiation.cc:299] Negotiation successful
0808 11:36:20.039343 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152}
I20260808 11:36:20.039767 14641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:20.033186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:32827 (local address 127.26.66.129:41635)
0808 11:36:20.034060 (+ 874us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:20.034077 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:20.034202 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:20.034617 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:20.034620 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:20.034640 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:20.035072 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:20.035088 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:20.036190 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:20.036194 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:20.037619 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:20.037631 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:20.038806 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:20.038813 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:20.038999 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:20.039052 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 11:36:20.039126 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 11:36:20.039259 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":721,"mutex_wait_us":1,"thread_start_us":470,"threads_started":1}
I20260808 11:36:20.039809 14640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:20.032807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:34809 (local address 127.26.66.129:37635)
0808 11:36:20.033787 (+ 980us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:20.033812 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:20.033975 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:20.034361 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:20.034366 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:20.034396 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:20.034812 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:20.034824 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:20.035954 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:20.035960 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:20.037623 (+ 1663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:20.037637 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:20.038919 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:20.038923 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:20.039086 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:20.039137 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 11:36:20.039231 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 11:36:20.039352 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":716,"mutex_wait_us":42,"thread_start_us":499,"threads_started":1}
I20260808 11:36:20.040179 14629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:20.033007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:37635 (local address 127.26.66.131:34809)
0808 11:36:20.033220 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:20.033227 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:20.033918 (+ 691us) server_negotiation.cc:407] Connection header received
0808 11:36:20.034120 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:20.034127 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:20.034208 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:20.034298 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:20.034974 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:20.035781 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:20.037897 (+ 2116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:20.038712 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:20.038889 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:20.038962 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:20.039279 (+ 317us) server_negotiation.cc:299] Negotiation successful
0808 11:36:20.039419 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 11:36:20.040916 14427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15bd479e81424aab98302a86633a840a" candidate_uuid: "8af335f9d4ad4f3b90f9b8839eb49dd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "388768b564094b3ba54f09afd1c81c8f" is_pre_election: true
I20260808 11:36:20.041100 14562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15bd479e81424aab98302a86633a840a" candidate_uuid: "8af335f9d4ad4f3b90f9b8839eb49dd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbfde83b4c4747109dcc6348fec574fc" is_pre_election: true
I20260808 11:36:20.041528 14427 raft_consensus.cc:2454] T 15bd479e81424aab98302a86633a840a P 388768b564094b3ba54f09afd1c81c8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8af335f9d4ad4f3b90f9b8839eb49dd6 in term 0.
I20260808 11:36:20.041607 14562 raft_consensus.cc:2454] T 15bd479e81424aab98302a86633a840a P fbfde83b4c4747109dcc6348fec574fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8af335f9d4ad4f3b90f9b8839eb49dd6 in term 0.
I20260808 11:36:20.042335 14220 leader_election.cc:302] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 388768b564094b3ba54f09afd1c81c8f, 8af335f9d4ad4f3b90f9b8839eb49dd6; no voters:
I20260808 11:36:20.042810 14637 raft_consensus.cc:2781] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:36:20.042975 14637 raft_consensus.cc:482] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:36:20.043100 14637 raft_consensus.cc:3037] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:20.045475 14637 raft_consensus.cc:504] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af335f9d4ad4f3b90f9b8839eb49dd6" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45539 } } peers { permanent_uuid: "fbfde83b4c4747109dcc6348fec574fc" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34809 } } peers { permanent_uuid: "388768b564094b3ba54f09afd1c81c8f" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 32827 } }
I20260808 11:36:20.046095 14637 leader_election.cc:288] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6 [CANDIDATE]: Term 1 election: Requested vote from peers fbfde83b4c4747109dcc6348fec574fc (127.26.66.131:34809), 388768b564094b3ba54f09afd1c81c8f (127.26.66.130:32827)
I20260808 11:36:20.046583 14562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15bd479e81424aab98302a86633a840a" candidate_uuid: "8af335f9d4ad4f3b90f9b8839eb49dd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbfde83b4c4747109dcc6348fec574fc"
I20260808 11:36:20.046603 14427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15bd479e81424aab98302a86633a840a" candidate_uuid: "8af335f9d4ad4f3b90f9b8839eb49dd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "388768b564094b3ba54f09afd1c81c8f"
I20260808 11:36:20.046762 14562 raft_consensus.cc:3037] T 15bd479e81424aab98302a86633a840a P fbfde83b4c4747109dcc6348fec574fc [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:20.046815 14427 raft_consensus.cc:3037] T 15bd479e81424aab98302a86633a840a P 388768b564094b3ba54f09afd1c81c8f [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:20.049129 14562 raft_consensus.cc:2454] T 15bd479e81424aab98302a86633a840a P fbfde83b4c4747109dcc6348fec574fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8af335f9d4ad4f3b90f9b8839eb49dd6 in term 1.
I20260808 11:36:20.049149 14427 raft_consensus.cc:2454] T 15bd479e81424aab98302a86633a840a P 388768b564094b3ba54f09afd1c81c8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8af335f9d4ad4f3b90f9b8839eb49dd6 in term 1.
I20260808 11:36:20.049582 14217 leader_election.cc:302] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8af335f9d4ad4f3b90f9b8839eb49dd6, fbfde83b4c4747109dcc6348fec574fc; no voters:
I20260808 11:36:20.049898 14637 raft_consensus.cc:2781] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:36:20.050357 14637 raft_consensus.cc:686] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6 [term 1 LEADER]: Becoming Leader. State: Replica: 8af335f9d4ad4f3b90f9b8839eb49dd6, State: Running, Role: LEADER
I20260808 11:36:20.050839 14637 consensus_queue.cc:237] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af335f9d4ad4f3b90f9b8839eb49dd6" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45539 } } peers { permanent_uuid: "fbfde83b4c4747109dcc6348fec574fc" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34809 } } peers { permanent_uuid: "388768b564094b3ba54f09afd1c81c8f" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 32827 } }
I20260808 11:36:20.055683 14138 catalog_manager.cc:5495] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8af335f9d4ad4f3b90f9b8839eb49dd6 (127.26.66.129). New cstate: current_term: 1 leader_uuid: "8af335f9d4ad4f3b90f9b8839eb49dd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af335f9d4ad4f3b90f9b8839eb49dd6" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbfde83b4c4747109dcc6348fec574fc" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "388768b564094b3ba54f09afd1c81c8f" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 32827 } health_report { overall_health: UNKNOWN } } }
I20260808 11:36:20.073660 14626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:20.067909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42946 (local address 127.26.66.129:45539)
0808 11:36:20.068136 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:20.068142 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:20.068247 (+ 105us) server_negotiation.cc:407] Connection header received
0808 11:36:20.068494 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:20.068498 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:20.068587 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:20.068741 (+ 154us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:36:20.069165 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:20.069861 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:20.071302 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:20.071742 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:20.071913 (+ 171us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:20.072556 (+ 643us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:36:20.073054 (+ 498us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:36:20.073249 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:20.073379 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 11:36:20.073431 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 11:36:20.081992 14562 raft_consensus.cc:1261] T 15bd479e81424aab98302a86633a840a P fbfde83b4c4747109dcc6348fec574fc [term 1 FOLLOWER]: Refusing update from remote peer 8af335f9d4ad4f3b90f9b8839eb49dd6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:36:20.081995 14427 raft_consensus.cc:1261] T 15bd479e81424aab98302a86633a840a P 388768b564094b3ba54f09afd1c81c8f [term 1 FOLLOWER]: Refusing update from remote peer 8af335f9d4ad4f3b90f9b8839eb49dd6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:36:20.083140 14637 consensus_queue.cc:1035] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfde83b4c4747109dcc6348fec574fc" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:36:20.083521 14642 consensus_queue.cc:1035] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "388768b564094b3ba54f09afd1c81c8f" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 32827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:36:20.096619 14646 mvcc.cc:205] Tried to move back new op lower bound from 7316230062404542464 to 7316230062291906560. Current Snapshot: MvccSnapshot[applied={T|T < 7316230062404542464}]
I20260808 11:36:20.111517 14138 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44088:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:36:20.111804 14138 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44088:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:36:20.115690 14138 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ae006cff90034c33b43d7574023c74fc: Sending DeleteTablet for 3 replicas of tablet 15bd479e81424aab98302a86633a840a
I20260808 11:36:20.116958 14266 tablet_service.cc:1514] Processing DeleteTablet for tablet 15bd479e81424aab98302a86633a840a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:36:20 UTC) from {username='slave'} at 127.0.0.1:42932
I20260808 11:36:20.117199 14541 tablet_service.cc:1514] Processing DeleteTablet for tablet 15bd479e81424aab98302a86633a840a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:36:20 UTC) from {username='slave'} at 127.0.0.1:36412
I20260808 11:36:20.117215 14405 tablet_service.cc:1514] Processing DeleteTablet for tablet 15bd479e81424aab98302a86633a840a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:36:20 UTC) from {username='slave'} at 127.0.0.1:49054
I20260808 11:36:20.119620 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 14201
I20260808 11:36:20.130244 14656 tablet_replica.cc:330] T 15bd479e81424aab98302a86633a840a P fbfde83b4c4747109dcc6348fec574fc: stopping tablet replica
I20260808 11:36:20.130748 14656 raft_consensus.cc:2229] T 15bd479e81424aab98302a86633a840a P fbfde83b4c4747109dcc6348fec574fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:36:20.131312 14656 raft_consensus.cc:2258] T 15bd479e81424aab98302a86633a840a P fbfde83b4c4747109dcc6348fec574fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:36:20.134087 14656 ts_tablet_manager.cc:1905] T 15bd479e81424aab98302a86633a840a P fbfde83b4c4747109dcc6348fec574fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:36:20.141296 14656 ts_tablet_manager.cc:1918] T 15bd479e81424aab98302a86633a840a P fbfde83b4c4747109dcc6348fec574fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:36:20.141463 14656 log.cc:1196] T 15bd479e81424aab98302a86633a840a P fbfde83b4c4747109dcc6348fec574fc: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-2/wal/wals/15bd479e81424aab98302a86633a840a
I20260808 11:36:20.142026 14656 ts_tablet_manager.cc:1939] T 15bd479e81424aab98302a86633a840a P fbfde83b4c4747109dcc6348fec574fc: Deleting consensus metadata
I20260808 11:36:20.144062 14121 catalog_manager.cc:4841] TS fbfde83b4c4747109dcc6348fec574fc (127.26.66.131:34809): tablet 15bd479e81424aab98302a86633a840a (table test-table [id=e8450c1d4e674585b1b45009e93a1cbc]) successfully deleted
I20260808 11:36:20.145658 14657 tablet_replica.cc:330] T 15bd479e81424aab98302a86633a840a P 388768b564094b3ba54f09afd1c81c8f: stopping tablet replica
I20260808 11:36:20.146147 14657 raft_consensus.cc:2229] T 15bd479e81424aab98302a86633a840a P 388768b564094b3ba54f09afd1c81c8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:36:20.146662 14657 raft_consensus.cc:2258] T 15bd479e81424aab98302a86633a840a P 388768b564094b3ba54f09afd1c81c8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:36:20.147611 14655 tablet_replica.cc:330] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6: stopping tablet replica
I20260808 11:36:20.148039 14655 raft_consensus.cc:2229] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6 [term 1 LEADER]: Raft consensus shutting down.
I20260808 11:36:20.148700 14655 raft_consensus.cc:2258] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:36:20.149798 14657 ts_tablet_manager.cc:1905] T 15bd479e81424aab98302a86633a840a P 388768b564094b3ba54f09afd1c81c8f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:36:20.150794 14655 ts_tablet_manager.cc:1905] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:36:20.155578 14626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:20.124231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42950 (local address 127.26.66.129:45539)
0808 11:36:20.124460 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:20.124470 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:20.144999 (+ 20529us) server_negotiation.cc:407] Connection header received
0808 11:36:20.145253 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:20.145262 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:20.145401 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:20.145547 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:20.146592 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:20.148310 (+ 1718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:20.150985 (+ 2675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:20.151785 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:20.151921 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:20.153574 (+ 1653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:20.153591 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:20.153611 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:20.154514 (+ 903us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:20.154574 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:20.154608 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:20.154700 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:20.155018 (+ 318us) server_negotiation.cc:299] Negotiation successful
0808 11:36:20.155143 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 11:36:20.157143 14330 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:20.157743 14657 ts_tablet_manager.cc:1918] T 15bd479e81424aab98302a86633a840a P 388768b564094b3ba54f09afd1c81c8f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:36:20.157955 14657 log.cc:1196] T 15bd479e81424aab98302a86633a840a P 388768b564094b3ba54f09afd1c81c8f: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-1/wal/wals/15bd479e81424aab98302a86633a840a
I20260808 11:36:20.158830 14657 ts_tablet_manager.cc:1939] T 15bd479e81424aab98302a86633a840a P 388768b564094b3ba54f09afd1c81c8f: Deleting consensus metadata
I20260808 11:36:20.161307 14124 catalog_manager.cc:4841] TS 388768b564094b3ba54f09afd1c81c8f (127.26.66.130:32827): tablet 15bd479e81424aab98302a86633a840a (table test-table [id=e8450c1d4e674585b1b45009e93a1cbc]) successfully deleted
I20260808 11:36:20.255614 14655 ts_tablet_manager.cc:1918] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:36:20.256036 14655 log.cc:1196] T 15bd479e81424aab98302a86633a840a P 8af335f9d4ad4f3b90f9b8839eb49dd6: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786188664137852-26890-0/minicluster-data/ts-0/wal/wals/15bd479e81424aab98302a86633a840a
I20260808 11:36:20.256402 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 14201
W20260808 11:36:20.278680 14123 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.66.129:45539 (error 108)
I20260808 11:36:20.278908 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 14340
I20260808 11:36:20.280781 14625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:20.280289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45539 (local address 127.0.0.1:42966)
0808 11:36:20.280458 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:20.280607 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:45539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260808 11:36:20.281042 14123 catalog_manager.cc:4584] TS 8af335f9d4ad4f3b90f9b8839eb49dd6 (127.26.66.129:45539): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 15bd479e81424aab98302a86633a840a: Network error: Client connection negotiation failed: client connection to 127.26.66.129:45539: connect: Connection refused (error 111)
I20260808 11:36:20.286442 14630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:20.279762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49056 (local address 127.26.66.130:32827)
0808 11:36:20.279982 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:20.279986 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:20.280038 (+ 52us) server_negotiation.cc:407] Connection header received
0808 11:36:20.280282 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:20.280287 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:20.280414 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:20.280536 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:20.281033 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:20.281861 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:20.283181 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:20.283611 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:20.283754 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:20.284984 (+ 1230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:20.284994 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:20.285007 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:20.285667 (+ 660us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:20.285712 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:20.285733 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:20.285874 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:20.286014 (+ 140us) server_negotiation.cc:299] Negotiation successful
0808 11:36:20.286123 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 11:36:20.287215 14471 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:20.334978 14625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:20.334489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45539 (local address 127.0.0.1:42972)
0808 11:36:20.334701 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:20.334800 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:45539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260808 11:36:20.336107 14625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:20.335728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45539 (local address 127.0.0.1:42974)
0808 11:36:20.335864 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:20.335998 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:45539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 11:36:20.379761 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 14340
I20260808 11:36:20.396811 14625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:20.396146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45539 (local address 127.0.0.1:48124)
0808 11:36:20.396425 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:20.396558 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:45539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260808 11:36:20.397981 14625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:20.397597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45539 (local address 127.0.0.1:48126)
0808 11:36:20.397765 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:20.397854 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:45539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260808 11:36:20.404513 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 14479
I20260808 11:36:20.416647 14629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:20.405456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52818 (local address 127.26.66.131:34809)
0808 11:36:20.405674 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:20.405685 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:20.405711 (+ 26us) server_negotiation.cc:407] Connection header received
0808 11:36:20.405822 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:20.405825 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:20.405976 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:20.406095 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:20.406620 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:20.407546 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:20.409129 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:20.409563 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:20.409703 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:20.415119 (+ 5416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:20.415129 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:20.415144 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:20.415735 (+ 591us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:20.415787 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:20.415807 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:20.415961 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:20.416134 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 11:36:20.416257 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 11:36:20.417310 14607 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:20.478799 14625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:20.478321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45539 (local address 127.0.0.1:48132)
0808 11:36:20.478541 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:20.478638 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:45539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260808 11:36:20.479976 14625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:20.479519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45539 (local address 127.0.0.1:48138)
0808 11:36:20.479737 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:20.479807 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:45539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260808 11:36:20.507711 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 14479
I20260808 11:36:20.529253 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 14106
I20260808 11:36:20.530433 14172 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:20.642699 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 14106
2026-08-08T11:36:20Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (2833 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:36:20 dist-test-slave-zkpd krb5kdc[14666](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:36:20 dist-test-slave-zkpd krb5kdc[14666](info): set up 2 sockets
Aug 08 11:36:20 dist-test-slave-zkpd krb5kdc[14666](info): commencing operation
krb5kdc: starting...
W20260808 11:36:21.825846 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.136s user 0.000s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:36:22 dist-test-slave-zkpd krb5kdc[14666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188982, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:36:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:36:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:36:22.155360 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:36971
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:41239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:36971
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:36:22.508592 14679 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:22.508940 14679 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:22.509095 14679 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:22.516309 14679 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:36:22.516515 14679 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:22.516693 14679 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:22.516846 14679 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:36:22.516937 14679 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:36:22.526613 14679 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:41239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:36971
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:36971
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:22.527982 14679 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:22.529326 14679 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:22.541462 14685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:22.541512 14686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:22.541551 14688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:22.542423 14679 server_base.cc:1034] running on GCE node
I20260808 11:36:22.543157 14679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:22.544644 14679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:22.545855 14679 hybrid_clock.cc:648] HybridClock initialized: now 1786188982545786 us; error 55 us; skew 500 ppm
I20260808 11:36:22.546213 14679 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:36:22 dist-test-slave-zkpd krb5kdc[14666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188982, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:36:22.549569 14679 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:36:22.551062 14679 webserver.cc:460] Webserver started at http://127.26.66.190:40695/ using document root <none> and password file <none>
I20260808 11:36:22.551754 14679 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:22.551932 14679 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:22.552270 14679 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:22.555425 14679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "f74e5bc2f29f49a3915c28342079d818"
format_stamp: "Formatted at 2026-08-08 11:36:22 on dist-test-slave-zkpd"
server_key: "be10ea3a0830be780a490da4c0861f42"
server_key_iv: "608487ec5b68561954fe61e1b1ae6120"
server_key_version: "encryptionkey@0"
I20260808 11:36:22.556262 14679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "f74e5bc2f29f49a3915c28342079d818"
format_stamp: "Formatted at 2026-08-08 11:36:22 on dist-test-slave-zkpd"
server_key: "be10ea3a0830be780a490da4c0861f42"
server_key_iv: "608487ec5b68561954fe61e1b1ae6120"
server_key_version: "encryptionkey@0"
I20260808 11:36:22.561875 14679 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260808 11:36:22.566619 14695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:22.568347 14679 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:36:22.568568 14679 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "f74e5bc2f29f49a3915c28342079d818"
format_stamp: "Formatted at 2026-08-08 11:36:22 on dist-test-slave-zkpd"
server_key: "be10ea3a0830be780a490da4c0861f42"
server_key_iv: "608487ec5b68561954fe61e1b1ae6120"
server_key_version: "encryptionkey@0"
I20260808 11:36:22.568769 14679 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:22.592540 14679 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:22.597102 14679 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:22.597407 14679 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:22.615470 14679 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:36971
I20260808 11:36:22.615504 14753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:36971 every 8 connection(s)
I20260808 11:36:22.616906 14679 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:36:22.620604 14754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:22.626816 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 14679
I20260808 11:36:22.627020 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:36:22.627594 26890 external_mini_cluster.cc:1428] Setting key 943ac010221a94522063278eeaac3568
I20260808 11:36:22.631807 14754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f74e5bc2f29f49a3915c28342079d818: Bootstrap starting.
I20260808 11:36:22.635625 14754 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f74e5bc2f29f49a3915c28342079d818: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:22.636814 14754 log.cc:824] T 00000000000000000000000000000000 P f74e5bc2f29f49a3915c28342079d818: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:22.639839 14754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f74e5bc2f29f49a3915c28342079d818: No bootstrap required, opened a new log
Aug 08 11:36:22 dist-test-slave-zkpd krb5kdc[14666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188982, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:36:22.650511 14754 raft_consensus.cc:348] T 00000000000000000000000000000000 P f74e5bc2f29f49a3915c28342079d818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f74e5bc2f29f49a3915c28342079d818" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 36971 } }
I20260808 11:36:22.650997 14754 raft_consensus.cc:374] T 00000000000000000000000000000000 P f74e5bc2f29f49a3915c28342079d818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:22.651113 14754 raft_consensus.cc:729] T 00000000000000000000000000000000 P f74e5bc2f29f49a3915c28342079d818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f74e5bc2f29f49a3915c28342079d818, State: Initialized, Role: FOLLOWER
I20260808 11:36:22.651775 14754 consensus_queue.cc:260] T 00000000000000000000000000000000 P f74e5bc2f29f49a3915c28342079d818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f74e5bc2f29f49a3915c28342079d818" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 36971 } }
I20260808 11:36:22.652139 14754 raft_consensus.cc:388] T 00000000000000000000000000000000 P f74e5bc2f29f49a3915c28342079d818 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:36:22.652303 14754 raft_consensus.cc:482] T 00000000000000000000000000000000 P f74e5bc2f29f49a3915c28342079d818 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:36:22.652490 14754 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f74e5bc2f29f49a3915c28342079d818 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:22.652648 14757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:22.629613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60208 (local address 127.26.66.190:36971)
0808 11:36:22.630454 (+ 841us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:22.630465 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:22.630506 (+ 41us) server_negotiation.cc:407] Connection header received
0808 11:36:22.632329 (+ 1823us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:22.632350 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:22.632701 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:22.633005 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:22.635059 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:22.636489 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:22.638164 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:22.638800 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:22.638928 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:22.643837 (+ 4909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:22.643850 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:22.643869 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:22.643956 (+ 87us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:22.648133 (+ 4177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:22.648792 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:22.648806 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:22.648815 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:22.649033 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:22.649382 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:22.649387 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:22.649391 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:22.650060 (+ 669us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:22.650342 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:22.650732 (+ 390us) server_negotiation.cc:299] Negotiation successful
0808 11:36:22.651251 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":426,"threads_started":1}
I20260808 11:36:22.654866 14754 raft_consensus.cc:504] T 00000000000000000000000000000000 P f74e5bc2f29f49a3915c28342079d818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f74e5bc2f29f49a3915c28342079d818" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 36971 } }
I20260808 11:36:22.655426 14754 leader_election.cc:302] T 00000000000000000000000000000000 P f74e5bc2f29f49a3915c28342079d818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f74e5bc2f29f49a3915c28342079d818; no voters:
I20260808 11:36:22.656088 14754 leader_election.cc:288] T 00000000000000000000000000000000 P f74e5bc2f29f49a3915c28342079d818 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:36:22.656172 14759 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f74e5bc2f29f49a3915c28342079d818 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:36:22.656958 14759 raft_consensus.cc:686] T 00000000000000000000000000000000 P f74e5bc2f29f49a3915c28342079d818 [term 1 LEADER]: Becoming Leader. State: Replica: f74e5bc2f29f49a3915c28342079d818, State: Running, Role: LEADER
I20260808 11:36:22.657440 14759 consensus_queue.cc:237] T 00000000000000000000000000000000 P f74e5bc2f29f49a3915c28342079d818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f74e5bc2f29f49a3915c28342079d818" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 36971 } }
I20260808 11:36:22.658227 14754 sys_catalog.cc:564] T 00000000000000000000000000000000 P f74e5bc2f29f49a3915c28342079d818 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:36:22.660410 14760 sys_catalog.cc:455] T 00000000000000000000000000000000 P f74e5bc2f29f49a3915c28342079d818 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f74e5bc2f29f49a3915c28342079d818" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f74e5bc2f29f49a3915c28342079d818" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 36971 } } }
I20260808 11:36:22.660386 14761 sys_catalog.cc:455] T 00000000000000000000000000000000 P f74e5bc2f29f49a3915c28342079d818 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f74e5bc2f29f49a3915c28342079d818. Latest consensus state: current_term: 1 leader_uuid: "f74e5bc2f29f49a3915c28342079d818" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f74e5bc2f29f49a3915c28342079d818" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 36971 } } }
I20260808 11:36:22.660833 14760 sys_catalog.cc:458] T 00000000000000000000000000000000 P f74e5bc2f29f49a3915c28342079d818 [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:22.660833 14761 sys_catalog.cc:458] T 00000000000000000000000000000000 P f74e5bc2f29f49a3915c28342079d818 [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:22.661675 14766 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:36:22.667125 14766 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:36:22.676278 14766 catalog_manager.cc:1347] Generated new cluster ID: 00b39e77f5134ad8a28b4231e5b20789
I20260808 11:36:22.676410 14766 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:36:22.695525 14766 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:36:22.696897 14766 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:36:22.709638 14766 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f74e5bc2f29f49a3915c28342079d818: Generated new TSK 0
I20260808 11:36:22.710435 14766 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.66.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
Entry for principal kudu/127.26.66.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab.
I20260808 11:36:22.790894 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:0
--local_ip_for_outbound_sockets=127.26.66.129
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:36971
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:41239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:36:23.143354 14781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:23.143630 14781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:23.143790 14781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:23.151013 14781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:23.151166 14781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:23.151399 14781 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:36:23.162055 14781 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:41239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.129.keytab
--principal=kudu/127.26.66.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:36971
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:23.163324 14781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:23.164642 14781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:23.178053 14786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:23.178018 14789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:23.178087 14787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:23.179119 14781 server_base.cc:1034] running on GCE node
I20260808 11:36:23.179739 14781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:23.180743 14781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:23.181960 14781 hybrid_clock.cc:648] HybridClock initialized: now 1786188983181893 us; error 54 us; skew 500 ppm
I20260808 11:36:23.182293 14781 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:36:23 dist-test-slave-zkpd krb5kdc[14666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188983, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:36:23.185648 14781 init.cc:377] Logged in from keytab as kudu/127.26.66.129@KRBTEST.COM (short username kudu)
I20260808 11:36:23.187036 14781 webserver.cc:460] Webserver started at http://127.26.66.129:42367/ using document root <none> and password file <none>
I20260808 11:36:23.187682 14781 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:23.187783 14781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:23.188117 14781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:23.191037 14781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-0/data/instance:
uuid: "eceb7435189d4a82a51f61558d6bdbec"
format_stamp: "Formatted at 2026-08-08 11:36:23 on dist-test-slave-zkpd"
server_key: "2c0985870ec161ff3792b86bafd7eb01"
server_key_iv: "c30c12ea33910a80a230b3abd767a228"
server_key_version: "encryptionkey@0"
I20260808 11:36:23.191840 14781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance:
uuid: "eceb7435189d4a82a51f61558d6bdbec"
format_stamp: "Formatted at 2026-08-08 11:36:23 on dist-test-slave-zkpd"
server_key: "2c0985870ec161ff3792b86bafd7eb01"
server_key_iv: "c30c12ea33910a80a230b3abd767a228"
server_key_version: "encryptionkey@0"
I20260808 11:36:23.197096 14781 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 11:36:23.200353 14796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:23.201593 14781 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 11:36:23.201762 14781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "eceb7435189d4a82a51f61558d6bdbec"
format_stamp: "Formatted at 2026-08-08 11:36:23 on dist-test-slave-zkpd"
server_key: "2c0985870ec161ff3792b86bafd7eb01"
server_key_iv: "c30c12ea33910a80a230b3abd767a228"
server_key_version: "encryptionkey@0"
I20260808 11:36:23.201922 14781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:23.222689 14781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:23.226737 14781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:23.226975 14781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:23.227844 14781 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:36:23.229241 14781 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:36:23.229317 14781 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:23.229421 14781 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:36:23.229465 14781 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:23.263743 14781 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:45531
I20260808 11:36:23.263870 14917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:45531 every 8 connection(s)
I20260808 11:36:23.265125 14781 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:36:23.274715 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 14781
I20260808 11:36:23.274922 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance
I20260808 11:36:23.275413 26890 external_mini_cluster.cc:1428] Setting key 0623afad24eb4bd51db8924185fdc12b
Aug 08 11:36:23 dist-test-slave-zkpd krb5kdc[14666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188983, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.129@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:36:23.286577 14920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:23.267807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:45489 (local address 127.26.66.190:36971)
0808 11:36:23.268279 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:23.268284 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:23.269251 (+ 967us) server_negotiation.cc:407] Connection header received
0808 11:36:23.271163 (+ 1912us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:23.271169 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:23.271261 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:23.271397 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:23.273057 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:23.274149 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:23.276020 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:23.276531 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:23.276673 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:23.280730 (+ 4057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:23.280735 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:23.280738 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:23.280772 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:23.283399 (+ 2627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:23.284233 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:23.284237 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:23.284240 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:23.284369 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:23.284820 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:23.284825 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:23.284827 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:23.285085 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:23.285258 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:23.285950 (+ 692us) server_negotiation.cc:299] Negotiation successful
0808 11:36:23.286179 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":252,"threads_started":1}
I20260808 11:36:23.287469 14921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:23.268380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:36971 (local address 127.26.66.129:45489)
0808 11:36:23.269081 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:23.269121 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:23.270869 (+ 1748us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:23.271639 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:23.271647 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:23.272234 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:36:23.272871 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:23.272891 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:23.274340 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:23.274351 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:23.275807 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:23.275822 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:23.276785 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:23.276791 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:23.276997 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:23.277793 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:36:23.277825 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:36:23.280495 (+ 2670us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:36:23.283554 (+ 3059us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:36:23.283563 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:36:23.283578 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:36:23.284096 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:36:23.284486 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:36:23.284491 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:36:23.284495 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:36:23.284689 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:36:23.285222 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:36:23.285230 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:36:23.285562 (+ 332us) client_negotiation.cc:769] Sending connection context
0808 11:36:23.285822 (+ 260us) client_negotiation.cc:240] Negotiation successful
0808 11:36:23.286354 (+ 532us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":269,"threads_started":1}
I20260808 11:36:23.289091 14918 heartbeater.cc:347] Connected to a master server at 127.26.66.190:36971
I20260808 11:36:23.289433 14918 heartbeater.cc:464] Registering TS with master...
I20260808 11:36:23.290313 14918 heartbeater.cc:511] Master 127.26.66.190:36971 requested a full tablet report, sending...
I20260808 11:36:23.292742 14714 ts_manager.cc:194] Registered new tserver with Master: eceb7435189d4a82a51f61558d6bdbec (127.26.66.129:45531)
I20260808 11:36:23.294358 14714 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.129@KRBTEST.COM'} at 127.26.66.129:45489
WARNING: no policy specified for kudu/127.26.66.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
Entry for principal kudu/127.26.66.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab.
I20260808 11:36:23.351760 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:0
--local_ip_for_outbound_sockets=127.26.66.130
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:36971
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:41239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:36:23.705286 14924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:23.705546 14924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:23.705664 14924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:23.713013 14924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:23.713116 14924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:23.713228 14924 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:36:23.722901 14924 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:41239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.130.keytab
--principal=kudu/127.26.66.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:36971
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:23.724107 14924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:23.725312 14924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:23.737962 14929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:23.738001 14932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:23.738039 14930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:23.739635 14924 server_base.cc:1034] running on GCE node
I20260808 11:36:23.740376 14924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:23.741286 14924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:23.742493 14924 hybrid_clock.cc:648] HybridClock initialized: now 1786188983742444 us; error 35 us; skew 500 ppm
I20260808 11:36:23.742846 14924 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:36:23 dist-test-slave-zkpd krb5kdc[14666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188983, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:36:23.746170 14924 init.cc:377] Logged in from keytab as kudu/127.26.66.130@KRBTEST.COM (short username kudu)
I20260808 11:36:23.747543 14924 webserver.cc:460] Webserver started at http://127.26.66.130:42591/ using document root <none> and password file <none>
I20260808 11:36:23.748278 14924 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:23.748389 14924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:23.748652 14924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:23.751515 14924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-1/data/instance:
uuid: "40a9aa5a2b924693be16178b118ee500"
format_stamp: "Formatted at 2026-08-08 11:36:23 on dist-test-slave-zkpd"
server_key: "e8d21403ae652166a825dbedce98f342"
server_key_iv: "509a9d0e7aaaa05b84f9cf9b50d5e62f"
server_key_version: "encryptionkey@0"
I20260808 11:36:23.752327 14924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance:
uuid: "40a9aa5a2b924693be16178b118ee500"
format_stamp: "Formatted at 2026-08-08 11:36:23 on dist-test-slave-zkpd"
server_key: "e8d21403ae652166a825dbedce98f342"
server_key_iv: "509a9d0e7aaaa05b84f9cf9b50d5e62f"
server_key_version: "encryptionkey@0"
I20260808 11:36:23.757609 14924 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260808 11:36:23.761201 14940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:23.762499 14924 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:36:23.762634 14924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "40a9aa5a2b924693be16178b118ee500"
format_stamp: "Formatted at 2026-08-08 11:36:23 on dist-test-slave-zkpd"
server_key: "e8d21403ae652166a825dbedce98f342"
server_key_iv: "509a9d0e7aaaa05b84f9cf9b50d5e62f"
server_key_version: "encryptionkey@0"
I20260808 11:36:23.762820 14924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:23.786623 14924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:23.790903 14924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:23.791148 14924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:23.792137 14924 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:36:23.793529 14924 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:36:23.793632 14924 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:23.793843 14924 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:36:23.793918 14924 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:23.829274 14924 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:34667
I20260808 11:36:23.829375 15059 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:34667 every 8 connection(s)
I20260808 11:36:23.830555 14924 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:36:23.838828 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 14924
I20260808 11:36:23.839033 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance
I20260808 11:36:23.839496 26890 external_mini_cluster.cc:1428] Setting key c2f83e29844f0b4c820ff1c7e4b2d968
Aug 08 11:36:23 dist-test-slave-zkpd krb5kdc[14666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188983, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.130@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:36:23.851742 15062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:23.833171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:55209 (local address 127.26.66.190:36971)
0808 11:36:23.833619 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:23.833623 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:23.834571 (+ 948us) server_negotiation.cc:407] Connection header received
0808 11:36:23.836479 (+ 1908us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:23.836483 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:23.836552 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:23.836651 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:23.838124 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:23.838843 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:23.840580 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:23.841089 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:23.841185 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:23.845671 (+ 4486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:23.845676 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:23.845679 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:23.845711 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:23.848550 (+ 2839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:23.849317 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:23.849321 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:23.849324 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:23.849452 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:23.849921 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:23.849925 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:23.849927 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:23.850207 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:23.850379 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:23.851101 (+ 722us) server_negotiation.cc:299] Negotiation successful
0808 11:36:23.851341 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":338,"thread_start_us":218,"threads_started":1}
I20260808 11:36:23.852799 15063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:23.833708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:36971 (local address 127.26.66.130:55209)
0808 11:36:23.834395 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:23.834438 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:23.836228 (+ 1790us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:23.836897 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:23.836904 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:23.837381 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:36:23.837946 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:23.837965 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:23.839006 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:23.839017 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:23.840424 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:23.840437 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:23.841330 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:23.841337 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:23.841542 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:23.842275 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:36:23.842309 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:36:23.845412 (+ 3103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:36:23.848700 (+ 3288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:36:23.848708 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:36:23.848725 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:36:23.849155 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:36:23.849570 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:36:23.849575 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:36:23.849579 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:36:23.849787 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:36:23.850352 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:36:23.850360 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:36:23.850709 (+ 349us) client_negotiation.cc:769] Sending connection context
0808 11:36:23.850979 (+ 270us) client_negotiation.cc:240] Negotiation successful
0808 11:36:23.851530 (+ 551us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":270,"threads_started":1}
I20260808 11:36:23.854396 15060 heartbeater.cc:347] Connected to a master server at 127.26.66.190:36971
I20260808 11:36:23.854735 15060 heartbeater.cc:464] Registering TS with master...
I20260808 11:36:23.855624 15060 heartbeater.cc:511] Master 127.26.66.190:36971 requested a full tablet report, sending...
I20260808 11:36:23.857227 14714 ts_manager.cc:194] Registered new tserver with Master: 40a9aa5a2b924693be16178b118ee500 (127.26.66.130:34667)
I20260808 11:36:23.858187 14714 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.130@KRBTEST.COM'} at 127.26.66.130:55209
WARNING: no policy specified for kudu/127.26.66.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
Entry for principal kudu/127.26.66.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab.
I20260808 11:36:23.916500 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:0
--local_ip_for_outbound_sockets=127.26.66.131
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:36971
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:41239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:36:24.260541 15066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:24.260860 15066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:24.261035 15066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:24.268843 15066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:24.268987 15066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:24.269183 15066 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:36:24.278869 15066 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:41239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.131.keytab
--principal=kudu/127.26.66.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:36971
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:24.280131 15066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:24.281424 15066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:24.294974 15071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:24.294950 15072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:24.295553 15074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:24.295928 15066 server_base.cc:1034] running on GCE node
I20260808 11:36:24.296535 15066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:24.297488 15066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:24.297946 14918 heartbeater.cc:503] Master 127.26.66.190:36971 was elected leader, sending a full tablet report...
I20260808 11:36:24.298674 15066 hybrid_clock.cc:648] HybridClock initialized: now 1786188984298623 us; error 42 us; skew 500 ppm
I20260808 11:36:24.298995 15066 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:36:24 dist-test-slave-zkpd krb5kdc[14666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188984, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:36:24.302206 15066 init.cc:377] Logged in from keytab as kudu/127.26.66.131@KRBTEST.COM (short username kudu)
I20260808 11:36:24.303771 15066 webserver.cc:460] Webserver started at http://127.26.66.131:41093/ using document root <none> and password file <none>
I20260808 11:36:24.304497 15066 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:24.304647 15066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:24.304975 15066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:24.308130 15066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-2/data/instance:
uuid: "749b1fed4c14485aaf09b448756b2f58"
format_stamp: "Formatted at 2026-08-08 11:36:24 on dist-test-slave-zkpd"
server_key: "8818ed73cb7b528e7f94bd71cd3e8eba"
server_key_iv: "80ab66d4fef9f3c3aface4c3c76bd0ee"
server_key_version: "encryptionkey@0"
I20260808 11:36:24.308943 15066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance:
uuid: "749b1fed4c14485aaf09b448756b2f58"
format_stamp: "Formatted at 2026-08-08 11:36:24 on dist-test-slave-zkpd"
server_key: "8818ed73cb7b528e7f94bd71cd3e8eba"
server_key_iv: "80ab66d4fef9f3c3aface4c3c76bd0ee"
server_key_version: "encryptionkey@0"
I20260808 11:36:24.314184 15066 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 11:36:24.317793 15081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:24.319028 15066 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 11:36:24.319206 15066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "749b1fed4c14485aaf09b448756b2f58"
format_stamp: "Formatted at 2026-08-08 11:36:24 on dist-test-slave-zkpd"
server_key: "8818ed73cb7b528e7f94bd71cd3e8eba"
server_key_iv: "80ab66d4fef9f3c3aface4c3c76bd0ee"
server_key_version: "encryptionkey@0"
I20260808 11:36:24.319411 15066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:24.334286 15066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:24.338734 15066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:24.339042 15066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:24.340044 15066 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:36:24.341380 15066 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:36:24.341485 15066 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:24.341642 15066 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:36:24.341722 15066 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:24.376892 15066 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:41399
I20260808 11:36:24.376945 15201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:41399 every 8 connection(s)
I20260808 11:36:24.378176 15066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:36:24.388550 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 15066
I20260808 11:36:24.388757 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance
I20260808 11:36:24.389281 26890 external_mini_cluster.cc:1428] Setting key a232c759e15178a455be975be714a490
Aug 08 11:36:24 dist-test-slave-zkpd krb5kdc[14666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188984, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.131@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:36:24.399266 15205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:24.380914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:33337 (local address 127.26.66.190:36971)
0808 11:36:24.381404 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:24.381409 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:24.382323 (+ 914us) server_negotiation.cc:407] Connection header received
0808 11:36:24.384225 (+ 1902us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:24.384231 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:24.384328 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:24.384451 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:24.385978 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.386813 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.388487 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.389009 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.389149 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:24.393197 (+ 4048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:24.393202 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:24.393205 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:24.393239 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:24.396130 (+ 2891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:24.396879 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:24.396889 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:24.396891 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:24.397013 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:24.397463 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:24.397468 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:24.397473 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:24.397752 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:24.397926 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:24.398623 (+ 697us) server_negotiation.cc:299] Negotiation successful
0808 11:36:24.398860 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":247,"threads_started":1}
I20260808 11:36:24.400238 15206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:24.381367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:36971 (local address 127.26.66.131:33337)
0808 11:36:24.382111 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:24.382191 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:24.383936 (+ 1745us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:24.384696 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:24.384704 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:24.385215 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:36:24.385784 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:24.385803 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.386973 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.386983 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:24.388332 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:24.388346 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.389245 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.389253 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:24.389542 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:24.390248 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:36:24.390279 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:36:24.392990 (+ 2711us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:36:24.396288 (+ 3298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:36:24.396297 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:36:24.396312 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:36:24.396738 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:36:24.397130 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:36:24.397135 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:36:24.397138 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:36:24.397340 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:36:24.397892 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:36:24.397900 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:36:24.398247 (+ 347us) client_negotiation.cc:769] Sending connection context
0808 11:36:24.398504 (+ 257us) client_negotiation.cc:240] Negotiation successful
0808 11:36:24.399048 (+ 544us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":307,"threads_started":1}
I20260808 11:36:24.401549 15202 heartbeater.cc:347] Connected to a master server at 127.26.66.190:36971
I20260808 11:36:24.401865 15202 heartbeater.cc:464] Registering TS with master...
I20260808 11:36:24.402607 15202 heartbeater.cc:511] Master 127.26.66.190:36971 requested a full tablet report, sending...
I20260808 11:36:24.404220 14714 ts_manager.cc:194] Registered new tserver with Master: 749b1fed4c14485aaf09b448756b2f58 (127.26.66.131:41399)
I20260808 11:36:24.405046 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 11:36:24.405167 14714 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.66.131@KRBTEST.COM'} at 127.26.66.131:33337
I20260808 11:36:24.421871 15205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:24.409482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60214 (local address 127.26.66.190:36971)
0808 11:36:24.409708 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:24.409714 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:24.410053 (+ 339us) server_negotiation.cc:407] Connection header received
0808 11:36:24.410176 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:24.410179 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:24.410273 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:24.410356 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:24.411749 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.412545 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.413837 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.414235 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.414329 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:24.416729 (+ 2400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:24.416734 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:24.416737 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:24.416769 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:24.419438 (+ 2669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:24.420060 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:24.420063 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:24.420066 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:24.420180 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:24.420536 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:24.420539 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:24.420541 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:24.420855 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:24.421044 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:24.421330 (+ 286us) server_negotiation.cc:299] Negotiation successful
0808 11:36:24.421492 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 11:36:24.425772 14714 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60214:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 11:36:24.432731 14714 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:36:24.455020 15217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:24.445112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44782 (local address 127.26.66.129:45531)
0808 11:36:24.446526 (+ 1414us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:24.446538 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:24.446572 (+ 34us) server_negotiation.cc:407] Connection header received
0808 11:36:24.446683 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:24.446692 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:24.446932 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:24.447868 (+ 936us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:24.448145 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.449477 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.452352 (+ 2875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.453804 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.453956 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:24.454200 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:24.454514 (+ 314us) server_negotiation.cc:299] Negotiation successful
0808 11:36:24.454672 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1237,"thread_start_us":1044,"threads_started":1}
I20260808 11:36:24.455031 15216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:24.445040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45531 (local address 127.0.0.1:44782)
0808 11:36:24.445778 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:24.445809 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:24.445930 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:24.447194 (+ 1264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:24.447203 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:24.447259 (+ 56us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:24.447672 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:24.447685 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.449611 (+ 1926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.449619 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:24.452158 (+ 2539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:24.452173 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.454031 (+ 1858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.454039 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:24.454261 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:24.454311 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 11:36:24.454461 (+ 150us) client_negotiation.cc:240] Negotiation successful
0808 11:36:24.454664 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":380,"threads_started":1}
I20260808 11:36:24.458461 15218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:24.446337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:34667 (local address 127.0.0.1:53316)
0808 11:36:24.446843 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:24.446859 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:24.446964 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:24.451057 (+ 4093us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:24.451062 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:24.451088 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:24.451585 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:24.451599 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.453588 (+ 1989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.453594 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:24.455735 (+ 2141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:24.455750 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.457638 (+ 1888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.457645 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:24.457813 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:24.457846 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 11:36:24.457978 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 11:36:24.458118 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":244,"threads_started":1}
I20260808 11:36:24.458890 15221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:24.447547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45096 (local address 127.26.66.131:41399)
0808 11:36:24.450121 (+ 2574us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:24.450129 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:24.450162 (+ 33us) server_negotiation.cc:407] Connection header received
0808 11:36:24.450268 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:24.450275 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:24.450494 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:24.450715 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:24.451575 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.452965 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.455633 (+ 2668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.457444 (+ 1811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.457561 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:24.457797 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:24.458415 (+ 618us) server_negotiation.cc:299] Negotiation successful
0808 11:36:24.458581 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2401,"thread_start_us":2237,"threads_started":1}
I20260808 11:36:24.458889 15220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:24.446920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:41399 (local address 127.0.0.1:45096)
0808 11:36:24.447499 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:24.447515 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:24.448728 (+ 1213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:24.450720 (+ 1992us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:24.450725 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:24.450751 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:24.451294 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:24.451310 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.453101 (+ 1791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.453108 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:24.455259 (+ 2151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:24.455277 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.457974 (+ 2697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.457987 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:24.458187 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:24.458216 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 11:36:24.458342 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 11:36:24.458475 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439,"mutex_wait_us":1,"thread_start_us":808,"threads_started":1}
I20260808 11:36:24.459393 15219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:24.446671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53316 (local address 127.26.66.130:34667)
0808 11:36:24.450471 (+ 3800us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:24.450477 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:24.450498 (+ 21us) server_negotiation.cc:407] Connection header received
0808 11:36:24.450606 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:24.450611 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:24.450843 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:24.451046 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:24.451797 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.453431 (+ 1634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.455948 (+ 2517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.457412 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.457561 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:24.457749 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:24.458865 (+ 1116us) server_negotiation.cc:299] Negotiation successful
0808 11:36:24.459028 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3659,"thread_start_us":3522,"threads_started":1}
I20260808 11:36:24.459196 14849 tablet_service.cc:1467] Processing CreateTablet for tablet 0cf0a583242941489a9231ffbc9b2680 (DEFAULT_TABLE table=test-table [id=e41237f0200543b7a25b411b4391221f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:36:24.460798 14849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cf0a583242941489a9231ffbc9b2680. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:24.462360 15133 tablet_service.cc:1467] Processing CreateTablet for tablet 0cf0a583242941489a9231ffbc9b2680 (DEFAULT_TABLE table=test-table [id=e41237f0200543b7a25b411b4391221f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:36:24.462924 14990 tablet_service.cc:1467] Processing CreateTablet for tablet 0cf0a583242941489a9231ffbc9b2680 (DEFAULT_TABLE table=test-table [id=e41237f0200543b7a25b411b4391221f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:36:24.463539 15133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cf0a583242941489a9231ffbc9b2680. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:24.464185 14990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cf0a583242941489a9231ffbc9b2680. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:24.475406 15222 tablet_bootstrap.cc:492] T 0cf0a583242941489a9231ffbc9b2680 P 749b1fed4c14485aaf09b448756b2f58: Bootstrap starting.
I20260808 11:36:24.478484 15222 tablet_bootstrap.cc:654] T 0cf0a583242941489a9231ffbc9b2680 P 749b1fed4c14485aaf09b448756b2f58: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:24.479223 15224 tablet_bootstrap.cc:492] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500: Bootstrap starting.
I20260808 11:36:24.480418 15222 log.cc:824] T 0cf0a583242941489a9231ffbc9b2680 P 749b1fed4c14485aaf09b448756b2f58: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:24.480563 15223 tablet_bootstrap.cc:492] T 0cf0a583242941489a9231ffbc9b2680 P eceb7435189d4a82a51f61558d6bdbec: Bootstrap starting.
I20260808 11:36:24.483223 15224 tablet_bootstrap.cc:654] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:24.483676 15223 tablet_bootstrap.cc:654] T 0cf0a583242941489a9231ffbc9b2680 P eceb7435189d4a82a51f61558d6bdbec: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:24.484709 15223 log.cc:824] T 0cf0a583242941489a9231ffbc9b2680 P eceb7435189d4a82a51f61558d6bdbec: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:24.484763 15224 log.cc:824] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:24.487243 15223 tablet_bootstrap.cc:492] T 0cf0a583242941489a9231ffbc9b2680 P eceb7435189d4a82a51f61558d6bdbec: No bootstrap required, opened a new log
I20260808 11:36:24.487509 15223 ts_tablet_manager.cc:1397] T 0cf0a583242941489a9231ffbc9b2680 P eceb7435189d4a82a51f61558d6bdbec: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 11:36:24.489773 15224 tablet_bootstrap.cc:492] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500: No bootstrap required, opened a new log
I20260808 11:36:24.489873 15222 tablet_bootstrap.cc:492] T 0cf0a583242941489a9231ffbc9b2680 P 749b1fed4c14485aaf09b448756b2f58: No bootstrap required, opened a new log
I20260808 11:36:24.490047 15224 ts_tablet_manager.cc:1397] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260808 11:36:24.490134 15222 ts_tablet_manager.cc:1397] T 0cf0a583242941489a9231ffbc9b2680 P 749b1fed4c14485aaf09b448756b2f58: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.004s
I20260808 11:36:24.497594 15224 raft_consensus.cc:348] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eceb7435189d4a82a51f61558d6bdbec" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45531 } } peers { permanent_uuid: "40a9aa5a2b924693be16178b118ee500" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34667 } } peers { permanent_uuid: "749b1fed4c14485aaf09b448756b2f58" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 41399 } }
I20260808 11:36:24.497952 15224 raft_consensus.cc:374] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:24.498059 15224 raft_consensus.cc:729] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a9aa5a2b924693be16178b118ee500, State: Initialized, Role: FOLLOWER
I20260808 11:36:24.498256 15223 raft_consensus.cc:348] T 0cf0a583242941489a9231ffbc9b2680 P eceb7435189d4a82a51f61558d6bdbec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eceb7435189d4a82a51f61558d6bdbec" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45531 } } peers { permanent_uuid: "40a9aa5a2b924693be16178b118ee500" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34667 } } peers { permanent_uuid: "749b1fed4c14485aaf09b448756b2f58" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 41399 } }
I20260808 11:36:24.498658 15223 raft_consensus.cc:374] T 0cf0a583242941489a9231ffbc9b2680 P eceb7435189d4a82a51f61558d6bdbec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:24.498764 15223 raft_consensus.cc:729] T 0cf0a583242941489a9231ffbc9b2680 P eceb7435189d4a82a51f61558d6bdbec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eceb7435189d4a82a51f61558d6bdbec, State: Initialized, Role: FOLLOWER
I20260808 11:36:24.498725 15224 consensus_queue.cc:260] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eceb7435189d4a82a51f61558d6bdbec" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45531 } } peers { permanent_uuid: "40a9aa5a2b924693be16178b118ee500" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34667 } } peers { permanent_uuid: "749b1fed4c14485aaf09b448756b2f58" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 41399 } }
I20260808 11:36:24.499509 15223 consensus_queue.cc:260] T 0cf0a583242941489a9231ffbc9b2680 P eceb7435189d4a82a51f61558d6bdbec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eceb7435189d4a82a51f61558d6bdbec" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45531 } } peers { permanent_uuid: "40a9aa5a2b924693be16178b118ee500" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34667 } } peers { permanent_uuid: "749b1fed4c14485aaf09b448756b2f58" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 41399 } }
I20260808 11:36:24.499874 15060 heartbeater.cc:503] Master 127.26.66.190:36971 was elected leader, sending a full tablet report...
I20260808 11:36:24.500913 15222 raft_consensus.cc:348] T 0cf0a583242941489a9231ffbc9b2680 P 749b1fed4c14485aaf09b448756b2f58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eceb7435189d4a82a51f61558d6bdbec" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45531 } } peers { permanent_uuid: "40a9aa5a2b924693be16178b118ee500" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34667 } } peers { permanent_uuid: "749b1fed4c14485aaf09b448756b2f58" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 41399 } }
I20260808 11:36:24.501336 15222 raft_consensus.cc:374] T 0cf0a583242941489a9231ffbc9b2680 P 749b1fed4c14485aaf09b448756b2f58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:24.501408 15223 ts_tablet_manager.cc:1428] T 0cf0a583242941489a9231ffbc9b2680 P eceb7435189d4a82a51f61558d6bdbec: Time spent starting tablet: real 0.014s user 0.013s sys 0.001s
I20260808 11:36:24.501435 15222 raft_consensus.cc:729] T 0cf0a583242941489a9231ffbc9b2680 P 749b1fed4c14485aaf09b448756b2f58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 749b1fed4c14485aaf09b448756b2f58, State: Initialized, Role: FOLLOWER
I20260808 11:36:24.501988 15222 consensus_queue.cc:260] T 0cf0a583242941489a9231ffbc9b2680 P 749b1fed4c14485aaf09b448756b2f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eceb7435189d4a82a51f61558d6bdbec" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45531 } } peers { permanent_uuid: "40a9aa5a2b924693be16178b118ee500" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34667 } } peers { permanent_uuid: "749b1fed4c14485aaf09b448756b2f58" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 41399 } }
I20260808 11:36:24.503073 15202 heartbeater.cc:503] Master 127.26.66.190:36971 was elected leader, sending a full tablet report...
I20260808 11:36:24.503793 15222 ts_tablet_manager.cc:1428] T 0cf0a583242941489a9231ffbc9b2680 P 749b1fed4c14485aaf09b448756b2f58: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260808 11:36:24.504487 15224 ts_tablet_manager.cc:1428] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500: Time spent starting tablet: real 0.014s user 0.007s sys 0.005s
W20260808 11:36:24.517628 14919 tablet.cc:2369] T 0cf0a583242941489a9231ffbc9b2680 P eceb7435189d4a82a51f61558d6bdbec: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 11:36:24.582679 15061 tablet.cc:2369] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:36:24.613155 15228 raft_consensus.cc:482] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:36:24.613492 15228 raft_consensus.cc:504] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eceb7435189d4a82a51f61558d6bdbec" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45531 } } peers { permanent_uuid: "40a9aa5a2b924693be16178b118ee500" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34667 } } peers { permanent_uuid: "749b1fed4c14485aaf09b448756b2f58" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 41399 } }
I20260808 11:36:24.615252 15228 leader_election.cc:288] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eceb7435189d4a82a51f61558d6bdbec (127.26.66.129:45531), 749b1fed4c14485aaf09b448756b2f58 (127.26.66.131:41399)
I20260808 11:36:24.623225 15217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:24.615707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:52831 (local address 127.26.66.129:45531)
0808 11:36:24.615961 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:24.615967 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:24.616299 (+ 332us) server_negotiation.cc:407] Connection header received
0808 11:36:24.616550 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:24.616559 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:24.616643 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:24.616709 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:24.617714 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.618722 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.620905 (+ 2183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.622182 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.622329 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:24.622409 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:24.622851 (+ 442us) server_negotiation.cc:299] Negotiation successful
0808 11:36:24.622986 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 11:36:24.623428 15231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:24.615577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45531 (local address 127.26.66.130:52831)
0808 11:36:24.616174 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:24.616191 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:24.616366 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:24.616953 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:24.616960 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:24.617000 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:24.617516 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:24.617530 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.618849 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.618856 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:24.620717 (+ 1861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:24.620736 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.622456 (+ 1720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.622464 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:24.622663 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:24.622704 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 11:36:24.622819 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 11:36:24.622952 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":392,"threads_started":1}
I20260808 11:36:24.624316 15232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:24.616395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:41399 (local address 127.26.66.130:37853)
0808 11:36:24.617523 (+ 1128us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:24.617540 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:24.617663 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:24.617999 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:24.618004 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:24.618030 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:24.618377 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:24.618388 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.619835 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.619841 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:24.621496 (+ 1655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:24.621508 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.623158 (+ 1650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.623164 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:24.623744 (+ 580us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:24.623777 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 11:36:24.623879 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 11:36:24.624091 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":980,"thread_start_us":736,"threads_started":1}
I20260808 11:36:24.624533 14871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cf0a583242941489a9231ffbc9b2680" candidate_uuid: "40a9aa5a2b924693be16178b118ee500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eceb7435189d4a82a51f61558d6bdbec" is_pre_election: true
I20260808 11:36:24.624940 15221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:24.616691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:37853 (local address 127.26.66.131:41399)
0808 11:36:24.616899 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:24.616905 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:24.617649 (+ 744us) server_negotiation.cc:407] Connection header received
0808 11:36:24.617784 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:24.617789 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:24.617867 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:24.617955 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:24.618573 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.619676 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.621659 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.622718 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.622913 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:24.622983 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:24.623950 (+ 967us) server_negotiation.cc:299] Negotiation successful
0808 11:36:24.624687 (+ 737us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 11:36:24.625087 14871 raft_consensus.cc:2454] T 0cf0a583242941489a9231ffbc9b2680 P eceb7435189d4a82a51f61558d6bdbec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a9aa5a2b924693be16178b118ee500 in term 0.
I20260808 11:36:24.625828 14942 leader_election.cc:302] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a9aa5a2b924693be16178b118ee500, eceb7435189d4a82a51f61558d6bdbec; no voters:
I20260808 11:36:24.625844 15154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cf0a583242941489a9231ffbc9b2680" candidate_uuid: "40a9aa5a2b924693be16178b118ee500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "749b1fed4c14485aaf09b448756b2f58" is_pre_election: true
I20260808 11:36:24.626241 15228 raft_consensus.cc:2781] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:36:24.626375 15228 raft_consensus.cc:482] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:36:24.626463 15228 raft_consensus.cc:3037] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:24.626377 15154 raft_consensus.cc:2454] T 0cf0a583242941489a9231ffbc9b2680 P 749b1fed4c14485aaf09b448756b2f58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a9aa5a2b924693be16178b118ee500 in term 0.
I20260808 11:36:24.629631 15228 raft_consensus.cc:504] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eceb7435189d4a82a51f61558d6bdbec" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45531 } } peers { permanent_uuid: "40a9aa5a2b924693be16178b118ee500" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34667 } } peers { permanent_uuid: "749b1fed4c14485aaf09b448756b2f58" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 41399 } }
W20260808 11:36:24.629915 15203 tablet.cc:2369] T 0cf0a583242941489a9231ffbc9b2680 P 749b1fed4c14485aaf09b448756b2f58: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:36:24.630329 15228 leader_election.cc:288] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500 [CANDIDATE]: Term 1 election: Requested vote from peers eceb7435189d4a82a51f61558d6bdbec (127.26.66.129:45531), 749b1fed4c14485aaf09b448756b2f58 (127.26.66.131:41399)
I20260808 11:36:24.630852 15154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cf0a583242941489a9231ffbc9b2680" candidate_uuid: "40a9aa5a2b924693be16178b118ee500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "749b1fed4c14485aaf09b448756b2f58"
I20260808 11:36:24.630970 14871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cf0a583242941489a9231ffbc9b2680" candidate_uuid: "40a9aa5a2b924693be16178b118ee500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eceb7435189d4a82a51f61558d6bdbec"
I20260808 11:36:24.631045 15154 raft_consensus.cc:3037] T 0cf0a583242941489a9231ffbc9b2680 P 749b1fed4c14485aaf09b448756b2f58 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:24.631220 14871 raft_consensus.cc:3037] T 0cf0a583242941489a9231ffbc9b2680 P eceb7435189d4a82a51f61558d6bdbec [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:24.634106 14871 raft_consensus.cc:2454] T 0cf0a583242941489a9231ffbc9b2680 P eceb7435189d4a82a51f61558d6bdbec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a9aa5a2b924693be16178b118ee500 in term 1.
I20260808 11:36:24.634224 15154 raft_consensus.cc:2454] T 0cf0a583242941489a9231ffbc9b2680 P 749b1fed4c14485aaf09b448756b2f58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a9aa5a2b924693be16178b118ee500 in term 1.
I20260808 11:36:24.634510 14942 leader_election.cc:302] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a9aa5a2b924693be16178b118ee500, eceb7435189d4a82a51f61558d6bdbec; no voters:
I20260808 11:36:24.634831 15228 raft_consensus.cc:2781] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:36:24.635278 15228 raft_consensus.cc:686] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500 [term 1 LEADER]: Becoming Leader. State: Replica: 40a9aa5a2b924693be16178b118ee500, State: Running, Role: LEADER
I20260808 11:36:24.635776 15228 consensus_queue.cc:237] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eceb7435189d4a82a51f61558d6bdbec" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45531 } } peers { permanent_uuid: "40a9aa5a2b924693be16178b118ee500" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34667 } } peers { permanent_uuid: "749b1fed4c14485aaf09b448756b2f58" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 41399 } }
I20260808 11:36:24.640461 14712 catalog_manager.cc:5495] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a9aa5a2b924693be16178b118ee500 (127.26.66.130). New cstate: current_term: 1 leader_uuid: "40a9aa5a2b924693be16178b118ee500" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eceb7435189d4a82a51f61558d6bdbec" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a9aa5a2b924693be16178b118ee500" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 34667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "749b1fed4c14485aaf09b448756b2f58" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 41399 } health_report { overall_health: UNKNOWN } } }
I20260808 11:36:24.691653 15219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:24.686144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53328 (local address 127.26.66.130:34667)
0808 11:36:24.686386 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:24.686394 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:24.686414 (+ 20us) server_negotiation.cc:407] Connection header received
0808 11:36:24.686665 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:24.686669 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:24.686744 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:24.686909 (+ 165us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:36:24.687308 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.688091 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.689443 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.689908 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.690047 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:24.690560 (+ 513us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:36:24.691049 (+ 489us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:36:24.691207 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:24.691298 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 11:36:24.691379 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 11:36:24.699877 15154 raft_consensus.cc:1261] T 0cf0a583242941489a9231ffbc9b2680 P 749b1fed4c14485aaf09b448756b2f58 [term 1 FOLLOWER]: Refusing update from remote peer 40a9aa5a2b924693be16178b118ee500: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:36:24.699968 14871 raft_consensus.cc:1261] T 0cf0a583242941489a9231ffbc9b2680 P eceb7435189d4a82a51f61558d6bdbec [term 1 FOLLOWER]: Refusing update from remote peer 40a9aa5a2b924693be16178b118ee500: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:36:24.700975 15233 consensus_queue.cc:1035] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500 [LEADER]: Connected to new peer: Peer: permanent_uuid: "749b1fed4c14485aaf09b448756b2f58" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 41399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:36:24.701366 15228 consensus_queue.cc:1035] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eceb7435189d4a82a51f61558d6bdbec" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 45531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:36:24.713349 15236 mvcc.cc:205] Tried to move back new op lower bound from 7316230081320849408 to 7316230081071775744. Current Snapshot: MvccSnapshot[applied={T|T < 7316230081320849408}]
I20260808 11:36:24.720927 15238 mvcc.cc:205] Tried to move back new op lower bound from 7316230081320849408 to 7316230081071775744. Current Snapshot: MvccSnapshot[applied={T|T < 7316230081320849408}]
I20260808 11:36:24.729732 14712 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60214:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:36:24.730024 14712 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60214:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:36:24.733534 14712 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f74e5bc2f29f49a3915c28342079d818: Sending DeleteTablet for 3 replicas of tablet 0cf0a583242941489a9231ffbc9b2680
I20260808 11:36:24.734875 14849 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cf0a583242941489a9231ffbc9b2680 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:36:24 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:44782
I20260808 11:36:24.734874 14990 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cf0a583242941489a9231ffbc9b2680 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:36:24 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:53316
I20260808 11:36:24.735047 15133 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cf0a583242941489a9231ffbc9b2680 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:36:24 UTC) from {username='kudu', principal='kudu/127.26.66.190@KRBTEST.COM'} at 127.0.0.1:45096
I20260808 11:36:24.736557 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 14781
I20260808 11:36:24.770920 15248 tablet_replica.cc:330] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500: stopping tablet replica
I20260808 11:36:24.771559 15248 raft_consensus.cc:2229] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500 [term 1 LEADER]: Raft consensus shutting down.
I20260808 11:36:24.775068 15248 raft_consensus.cc:2258] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500 [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 08 11:36:24 dist-test-slave-zkpd krb5kdc[14666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188982, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.129@KRBTEST.COM
I20260808 11:36:24.780668 15249 tablet_replica.cc:330] T 0cf0a583242941489a9231ffbc9b2680 P 749b1fed4c14485aaf09b448756b2f58: stopping tablet replica
I20260808 11:36:24.780916 15247 tablet_replica.cc:330] T 0cf0a583242941489a9231ffbc9b2680 P eceb7435189d4a82a51f61558d6bdbec: stopping tablet replica
I20260808 11:36:24.781329 15249 raft_consensus.cc:2229] T 0cf0a583242941489a9231ffbc9b2680 P 749b1fed4c14485aaf09b448756b2f58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:36:24.781353 15247 raft_consensus.cc:2229] T 0cf0a583242941489a9231ffbc9b2680 P eceb7435189d4a82a51f61558d6bdbec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:36:24.781934 15249 raft_consensus.cc:2258] T 0cf0a583242941489a9231ffbc9b2680 P 749b1fed4c14485aaf09b448756b2f58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:36:24.781941 15247 raft_consensus.cc:2258] T 0cf0a583242941489a9231ffbc9b2680 P eceb7435189d4a82a51f61558d6bdbec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:36:24.782094 15248 ts_tablet_manager.cc:1905] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:36:24.784380 15247 ts_tablet_manager.cc:1905] T 0cf0a583242941489a9231ffbc9b2680 P eceb7435189d4a82a51f61558d6bdbec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:36:24.786259 15249 ts_tablet_manager.cc:1905] T 0cf0a583242941489a9231ffbc9b2680 P 749b1fed4c14485aaf09b448756b2f58: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:36:24.788900 15217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:24.738155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44788 (local address 127.26.66.129:45531)
0808 11:36:24.738394 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:24.738402 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:24.762051 (+ 23649us) server_negotiation.cc:407] Connection header received
0808 11:36:24.762649 (+ 598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:24.762659 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:24.762772 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:24.762864 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:24.765282 (+ 2418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.766891 (+ 1609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.772544 (+ 5653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.773487 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.773619 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:24.780698 (+ 7079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:24.780722 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:24.780744 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:24.780790 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:24.784952 (+ 4162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:24.785911 (+ 959us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:24.785920 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:24.785924 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:24.786095 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:24.786602 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:24.786610 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:24.786615 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:24.787150 (+ 535us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:24.787487 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:24.788178 (+ 691us) server_negotiation.cc:299] Negotiation successful
0808 11:36:24.788443 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 11:36:24.790453 14913 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:24.790410 15248 ts_tablet_manager.cc:1918] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:36:24.790593 15248 log.cc:1196] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-1/wal/wals/0cf0a583242941489a9231ffbc9b2680
I20260808 11:36:24.791339 15248 ts_tablet_manager.cc:1939] T 0cf0a583242941489a9231ffbc9b2680 P 40a9aa5a2b924693be16178b118ee500: Deleting consensus metadata
I20260808 11:36:24.793877 14697 catalog_manager.cc:4841] TS 40a9aa5a2b924693be16178b118ee500 (127.26.66.130:34667): tablet 0cf0a583242941489a9231ffbc9b2680 (table test-table [id=e41237f0200543b7a25b411b4391221f]) successfully deleted
I20260808 11:36:24.799794 15249 ts_tablet_manager.cc:1918] T 0cf0a583242941489a9231ffbc9b2680 P 749b1fed4c14485aaf09b448756b2f58: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:36:24.800158 15249 log.cc:1196] T 0cf0a583242941489a9231ffbc9b2680 P 749b1fed4c14485aaf09b448756b2f58: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786188664137852-26890-0/minicluster-data/ts-2/wal/wals/0cf0a583242941489a9231ffbc9b2680
I20260808 11:36:24.800861 15249 ts_tablet_manager.cc:1939] T 0cf0a583242941489a9231ffbc9b2680 P 749b1fed4c14485aaf09b448756b2f58: Deleting consensus metadata
I20260808 11:36:24.802908 14697 catalog_manager.cc:4841] TS 749b1fed4c14485aaf09b448756b2f58 (127.26.66.131:41399): tablet 0cf0a583242941489a9231ffbc9b2680 (table test-table [id=e41237f0200543b7a25b411b4391221f]) successfully deleted
I20260808 11:36:24.905118 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 14781
W20260808 11:36:24.931105 14697 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.66.129:45531 (error 108)
I20260808 11:36:24.931289 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 14924
I20260808 11:36:24.933166 15220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:24.932633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45531 (local address 127.0.0.1:44796)
0808 11:36:24.932855 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:24.932990 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:45531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
W20260808 11:36:24.933432 14697 catalog_manager.cc:4584] TS eceb7435189d4a82a51f61558d6bdbec (127.26.66.129:45531): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0cf0a583242941489a9231ffbc9b2680: Network error: Client connection negotiation failed: client connection to 127.26.66.129:45531: connect: Connection refused (error 111)
Aug 08 11:36:24 dist-test-slave-zkpd krb5kdc[14666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188982, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.130@KRBTEST.COM
I20260808 11:36:24.949309 15219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:24.932146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53334 (local address 127.26.66.130:34667)
0808 11:36:24.932387 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:24.932394 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:24.932826 (+ 432us) server_negotiation.cc:407] Connection header received
0808 11:36:24.932957 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:24.932962 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:24.933034 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:24.933151 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:24.934655 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.935473 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.936933 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:24.937365 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:24.937509 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:24.942026 (+ 4517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:24.942043 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:24.942062 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:24.942124 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:24.946080 (+ 3956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:24.946805 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:24.946813 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:24.946816 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:24.946999 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:24.947378 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:24.947382 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:24.947385 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:24.947813 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:24.948461 (+ 648us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:24.948664 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 11:36:24.948909 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 11:36:24.950125 15054 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:24.987434 15220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:24.986859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45531 (local address 127.0.0.1:44804)
0808 11:36:24.987166 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:24.987274 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:45531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177}
I20260808 11:36:24.988672 15220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:24.988323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45531 (local address 127.0.0.1:44820)
0808 11:36:24.988457 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:24.988547 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:45531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 11:36:25.049360 15220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:25.048840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45531 (local address 127.0.0.1:44822)
0808 11:36:25.049064 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:25.049167 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:45531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260808 11:36:25.050458 15220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:25.050130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45531 (local address 127.0.0.1:44824)
0808 11:36:25.050263 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:25.050345 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:45531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 11:36:25.068539 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 14924
I20260808 11:36:25.094065 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 15066
Aug 08 11:36:25 dist-test-slave-zkpd krb5kdc[14666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188982, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.131@KRBTEST.COM
I20260808 11:36:25.109325 15221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:25.094881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45110 (local address 127.26.66.131:41399)
0808 11:36:25.095069 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:25.095073 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:25.095092 (+ 19us) server_negotiation.cc:407] Connection header received
0808 11:36:25.095242 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:25.095247 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:25.095330 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:25.095428 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:25.096896 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:25.097627 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:25.098874 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:25.099232 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:25.099323 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:25.104045 (+ 4722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:25.104059 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:25.104074 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:25.104105 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:25.106783 (+ 2678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:25.107427 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:25.107434 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:25.107436 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:25.107584 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:25.107974 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:25.107977 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:25.107979 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:25.108313 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:25.108537 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:25.108799 (+ 262us) server_negotiation.cc:299] Negotiation successful
0808 11:36:25.108964 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 11:36:25.110034 15197 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:25.130993 15220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:25.130509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45531 (local address 127.0.0.1:44832)
0808 11:36:25.130715 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:25.130797 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:45531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260808 11:36:25.132126 15220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:25.131692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45531 (local address 127.0.0.1:44846)
0808 11:36:25.131928 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:25.132014 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:45531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260808 11:36:25.201628 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 15066
I20260808 11:36:25.222962 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 14679
I20260808 11:36:25.224200 14748 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:25.337100 15220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:25.336512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:45531 (local address 127.0.0.1:44856)
0808 11:36:25.336750 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:25.336888 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:45531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260808 11:36:25.337085 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 14679
2026-08-08T11:36:25Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4694 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T11:36:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:36:25Z Disabled control of system clock
I20260808 11:36:25.438030 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:46799
--webserver_interface=127.26.66.190
--webserver_port=0
--builtin_ntp_servers=127.26.66.148:39873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:46799
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 11:36:25.794606 15259 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:25.794880 15259 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:25.794971 15259 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:25.802322 15259 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:36:25.802416 15259 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:25.802453 15259 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:25.802510 15259 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:36:25.802552 15259 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:36:25.811429 15259 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:39873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:46799
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:46799
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:25.812706 15259 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:25.814522 15259 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:25.826212 15265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:25.826279 15268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:25.826315 15264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:25.827147 15259 server_base.cc:1034] running on GCE node
I20260808 11:36:25.827945 15259 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:25.829263 15259 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:25.830497 15259 hybrid_clock.cc:648] HybridClock initialized: now 1786188985830456 us; error 51 us; skew 500 ppm
I20260808 11:36:25.830868 15259 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:36:25.839507 15259 webserver.cc:460] Webserver started at http://127.26.66.190:35169/ using document root <none> and password file <none>
I20260808 11:36:25.840281 15259 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:25.840417 15259 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:25.840760 15259 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:25.843590 15259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "5290ad6651d7475ea0058d6cbbe84f0e"
format_stamp: "Formatted at 2026-08-08 11:36:25 on dist-test-slave-zkpd"
server_key: "8db36939a49ecbf5cd32d834dc990459"
server_key_iv: "bcb339ca6fc94bbb450b8e2f8bca080e"
server_key_version: "encryptionkey@0"
I20260808 11:36:25.844496 15259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "5290ad6651d7475ea0058d6cbbe84f0e"
format_stamp: "Formatted at 2026-08-08 11:36:25 on dist-test-slave-zkpd"
server_key: "8db36939a49ecbf5cd32d834dc990459"
server_key_iv: "bcb339ca6fc94bbb450b8e2f8bca080e"
server_key_version: "encryptionkey@0"
I20260808 11:36:25.849668 15259 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260808 11:36:25.853139 15274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:25.854542 15259 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:36:25.854745 15259 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "5290ad6651d7475ea0058d6cbbe84f0e"
format_stamp: "Formatted at 2026-08-08 11:36:25 on dist-test-slave-zkpd"
server_key: "8db36939a49ecbf5cd32d834dc990459"
server_key_iv: "bcb339ca6fc94bbb450b8e2f8bca080e"
server_key_version: "encryptionkey@0"
I20260808 11:36:25.854974 15259 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:25.876955 15259 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:25.877833 15259 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:25.878137 15259 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:25.896782 15259 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:46799
I20260808 11:36:25.896802 15332 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:46799 every 8 connection(s)
I20260808 11:36:25.898241 15259 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:36:25.901938 15333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:25.903571 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 15259
I20260808 11:36:25.903766 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:36:25.904352 26890 external_mini_cluster.cc:1428] Setting key a79943138eb4e1dfe718f21ef6b32e73
I20260808 11:36:25.915087 15333 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5290ad6651d7475ea0058d6cbbe84f0e: Bootstrap starting.
I20260808 11:36:25.917551 15336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:25.906418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41350 (local address 127.26.66.190:46799)
0808 11:36:25.907465 (+ 1047us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:25.907475 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:25.907518 (+ 43us) server_negotiation.cc:407] Connection header received
0808 11:36:25.909165 (+ 1647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:25.909190 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:25.909624 (+ 434us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:25.910011 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:25.910565 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:25.911844 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:25.913223 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:25.913883 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:25.914096 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:25.915326 (+ 1230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:25.915335 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:25.915348 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:25.915850 (+ 502us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:25.915991 (+ 141us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:25.916014 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:25.916136 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:25.916366 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 11:36:25.916674 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":632,"thread_start_us":373,"threads_started":1}
I20260808 11:36:25.918515 15333 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5290ad6651d7475ea0058d6cbbe84f0e: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:25.919610 15333 log.cc:824] T 00000000000000000000000000000000 P 5290ad6651d7475ea0058d6cbbe84f0e: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:25.922299 15333 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5290ad6651d7475ea0058d6cbbe84f0e: No bootstrap required, opened a new log
I20260808 11:36:25.929250 15333 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5290ad6651d7475ea0058d6cbbe84f0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5290ad6651d7475ea0058d6cbbe84f0e" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46799 } }
I20260808 11:36:25.929598 15333 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5290ad6651d7475ea0058d6cbbe84f0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:25.929715 15333 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5290ad6651d7475ea0058d6cbbe84f0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5290ad6651d7475ea0058d6cbbe84f0e, State: Initialized, Role: FOLLOWER
I20260808 11:36:25.930313 15333 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5290ad6651d7475ea0058d6cbbe84f0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5290ad6651d7475ea0058d6cbbe84f0e" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46799 } }
I20260808 11:36:25.930563 15333 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5290ad6651d7475ea0058d6cbbe84f0e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:36:25.930721 15333 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5290ad6651d7475ea0058d6cbbe84f0e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:36:25.930891 15333 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5290ad6651d7475ea0058d6cbbe84f0e [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:25.933034 15333 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5290ad6651d7475ea0058d6cbbe84f0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5290ad6651d7475ea0058d6cbbe84f0e" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46799 } }
I20260808 11:36:25.933530 15333 leader_election.cc:302] T 00000000000000000000000000000000 P 5290ad6651d7475ea0058d6cbbe84f0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5290ad6651d7475ea0058d6cbbe84f0e; no voters:
I20260808 11:36:25.934134 15333 leader_election.cc:288] T 00000000000000000000000000000000 P 5290ad6651d7475ea0058d6cbbe84f0e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:36:25.934289 15338 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5290ad6651d7475ea0058d6cbbe84f0e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:36:25.935053 15338 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5290ad6651d7475ea0058d6cbbe84f0e [term 1 LEADER]: Becoming Leader. State: Replica: 5290ad6651d7475ea0058d6cbbe84f0e, State: Running, Role: LEADER
I20260808 11:36:25.935547 15338 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5290ad6651d7475ea0058d6cbbe84f0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5290ad6651d7475ea0058d6cbbe84f0e" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46799 } }
I20260808 11:36:25.936211 15333 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5290ad6651d7475ea0058d6cbbe84f0e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:36:25.938542 15339 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5290ad6651d7475ea0058d6cbbe84f0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5290ad6651d7475ea0058d6cbbe84f0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5290ad6651d7475ea0058d6cbbe84f0e" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46799 } } }
I20260808 11:36:25.938542 15340 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5290ad6651d7475ea0058d6cbbe84f0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5290ad6651d7475ea0058d6cbbe84f0e. Latest consensus state: current_term: 1 leader_uuid: "5290ad6651d7475ea0058d6cbbe84f0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5290ad6651d7475ea0058d6cbbe84f0e" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46799 } } }
I20260808 11:36:25.939020 15339 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5290ad6651d7475ea0058d6cbbe84f0e [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:25.939112 15340 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5290ad6651d7475ea0058d6cbbe84f0e [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:25.942688 15345 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:36:25.948527 15345 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:36:25.957329 15345 catalog_manager.cc:1347] Generated new cluster ID: efcb594e57aa4c58a4e9ed9bfff9e335
I20260808 11:36:25.957442 15345 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:36:25.970820 15345 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:36:25.972179 15345 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:36:25.983788 15345 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5290ad6651d7475ea0058d6cbbe84f0e: Generated new TSK 0
I20260808 11:36:25.984592 15345 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:36:25.989346 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.129:0
--local_ip_for_outbound_sockets=127.26.66.129
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46799
--builtin_ntp_servers=127.26.66.148:39873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 11:36:26.342082 15359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:26.342427 15359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:26.342593 15359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:26.349958 15359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:26.350102 15359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:26.350286 15359 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.129
I20260808 11:36:26.360467 15359 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:39873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.66.129
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.129
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:26.361874 15359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:26.363879 15359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:26.377630 15367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:26.377702 15364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:26.377677 15365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:26.378775 15359 server_base.cc:1034] running on GCE node
I20260808 11:36:26.379340 15359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:26.380329 15359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:26.381546 15359 hybrid_clock.cc:648] HybridClock initialized: now 1786188986381505 us; error 26 us; skew 500 ppm
I20260808 11:36:26.381888 15359 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:36:26.384404 15359 webserver.cc:460] Webserver started at http://127.26.66.129:41379/ using document root <none> and password file <none>
I20260808 11:36:26.385105 15359 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:26.385254 15359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:26.385597 15359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:26.388561 15359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-0/data/instance:
uuid: "073465c96e28418389d6f962e058908b"
format_stamp: "Formatted at 2026-08-08 11:36:26 on dist-test-slave-zkpd"
server_key: "27d0db2ddd3b8b5a322621302df9dd15"
server_key_iv: "2cab229c2d9fb3e5847f3ac9b43b15d2"
server_key_version: "encryptionkey@0"
I20260808 11:36:26.389355 15359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance:
uuid: "073465c96e28418389d6f962e058908b"
format_stamp: "Formatted at 2026-08-08 11:36:26 on dist-test-slave-zkpd"
server_key: "27d0db2ddd3b8b5a322621302df9dd15"
server_key_iv: "2cab229c2d9fb3e5847f3ac9b43b15d2"
server_key_version: "encryptionkey@0"
I20260808 11:36:26.394482 15359 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 11:36:26.397853 15373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:26.399262 15359 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 11:36:26.399434 15359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-0/wal
uuid: "073465c96e28418389d6f962e058908b"
format_stamp: "Formatted at 2026-08-08 11:36:26 on dist-test-slave-zkpd"
server_key: "27d0db2ddd3b8b5a322621302df9dd15"
server_key_iv: "2cab229c2d9fb3e5847f3ac9b43b15d2"
server_key_version: "encryptionkey@0"
I20260808 11:36:26.399654 15359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:26.432402 15359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:26.433755 15359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:26.434185 15359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:26.435683 15359 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:36:26.437970 15359 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:36:26.438105 15359 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:26.438232 15359 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:36:26.438321 15359 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:26.475629 15359 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.129:36479
I20260808 11:36:26.475726 15491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.129:36479 every 8 connection(s)
I20260808 11:36:26.477105 15359 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-0/data/info.pb
I20260808 11:36:26.485953 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 15359
I20260808 11:36:26.486151 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-0/wal/instance
I20260808 11:36:26.486670 26890 external_mini_cluster.cc:1428] Setting key 0dfaf107f711a170180c0b1a07d3f73f
I20260808 11:36:26.489846 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.130:0
--local_ip_for_outbound_sockets=127.26.66.130
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46799
--builtin_ntp_servers=127.26.66.148:39873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 11:36:26.491242 15494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:26.479879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.129:57877 (local address 127.26.66.190:46799)
0808 11:36:26.480359 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:26.480363 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:26.481640 (+ 1277us) server_negotiation.cc:407] Connection header received
0808 11:36:26.483590 (+ 1950us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:26.483596 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:26.483687 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:26.483831 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:26.485071 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:26.485841 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:26.487829 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:26.488347 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:26.488501 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:26.490166 (+ 1665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:26.490175 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:26.490182 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:26.490207 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:26.490279 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:26.490298 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:26.490398 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:26.490641 (+ 243us) server_negotiation.cc:299] Negotiation successful
0808 11:36:26.490757 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":217,"threads_started":1}
I20260808 11:36:26.492156 15495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:26.480516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:46799 (local address 127.26.66.129:57877)
0808 11:36:26.481469 (+ 953us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:26.481509 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:26.483255 (+ 1746us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:26.484105 (+ 850us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:26.484113 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:26.484209 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:36:26.484887 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:26.484907 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:26.486014 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:26.486018 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:26.487666 (+ 1648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:26.487687 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:26.488610 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:26.488616 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:26.488947 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:26.489726 (+ 779us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 11:36:26.489730 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:36:26.489786 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 11:36:26.489909 (+ 123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:36:26.490417 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:36:26.490426 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:36:26.490433 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 11:36:26.490595 (+ 162us) client_negotiation.cc:240] Negotiation successful
0808 11:36:26.490935 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":290,"threads_started":1}
I20260808 11:36:26.493753 15492 heartbeater.cc:347] Connected to a master server at 127.26.66.190:46799
I20260808 11:36:26.494089 15492 heartbeater.cc:464] Registering TS with master...
I20260808 11:36:26.495015 15492 heartbeater.cc:511] Master 127.26.66.190:46799 requested a full tablet report, sending...
I20260808 11:36:26.497304 15292 ts_manager.cc:194] Registered new tserver with Master: 073465c96e28418389d6f962e058908b (127.26.66.129:36479)
I20260808 11:36:26.498883 15292 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.66.129:57877
W20260808 11:36:26.833658 15496 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:26.833932 15496 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:26.834017 15496 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:26.841027 15496 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:26.841115 15496 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:26.841213 15496 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.130
I20260808 11:36:26.850135 15496 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:39873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.66.130
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.130
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:26.851248 15496 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:26.853020 15496 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:26.865988 15503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:26.866031 15505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:26.866077 15502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:26.869338 15496 server_base.cc:1034] running on GCE node
I20260808 11:36:26.869989 15496 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:26.870944 15496 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:26.872181 15496 hybrid_clock.cc:648] HybridClock initialized: now 1786188986872141 us; error 63 us; skew 500 ppm
I20260808 11:36:26.872506 15496 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:36:26.874830 15496 webserver.cc:460] Webserver started at http://127.26.66.130:34213/ using document root <none> and password file <none>
I20260808 11:36:26.875521 15496 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:26.875655 15496 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:26.876055 15496 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:26.878947 15496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-1/data/instance:
uuid: "a49e9efc39694da19e2466afed4d8f76"
format_stamp: "Formatted at 2026-08-08 11:36:26 on dist-test-slave-zkpd"
server_key: "9060bcc8e244a279e99f8c1a0f1eb9af"
server_key_iv: "486f3062a279f38154afe9e61706e7eb"
server_key_version: "encryptionkey@0"
I20260808 11:36:26.879761 15496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance:
uuid: "a49e9efc39694da19e2466afed4d8f76"
format_stamp: "Formatted at 2026-08-08 11:36:26 on dist-test-slave-zkpd"
server_key: "9060bcc8e244a279e99f8c1a0f1eb9af"
server_key_iv: "486f3062a279f38154afe9e61706e7eb"
server_key_version: "encryptionkey@0"
I20260808 11:36:26.885111 15496 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 11:36:26.888638 15511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:26.889895 15496 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:36:26.890069 15496 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-1/wal
uuid: "a49e9efc39694da19e2466afed4d8f76"
format_stamp: "Formatted at 2026-08-08 11:36:26 on dist-test-slave-zkpd"
server_key: "9060bcc8e244a279e99f8c1a0f1eb9af"
server_key_iv: "486f3062a279f38154afe9e61706e7eb"
server_key_version: "encryptionkey@0"
I20260808 11:36:26.890285 15496 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:26.904958 15496 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:26.905700 15496 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:26.906014 15496 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:26.907038 15496 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:36:26.908470 15496 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:36:26.908600 15496 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:26.908725 15496 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:36:26.908819 15496 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:26.943379 15496 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.130:36485
I20260808 11:36:26.943475 15632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.130:36485 every 8 connection(s)
I20260808 11:36:26.944825 15496 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-1/data/info.pb
I20260808 11:36:26.945838 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 15496
I20260808 11:36:26.946038 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-1/wal/instance
I20260808 11:36:26.946630 26890 external_mini_cluster.cc:1428] Setting key ba4a96e2c86e8853c3b5a63025349385
I20260808 11:36:26.950003 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.66.131:0
--local_ip_for_outbound_sockets=127.26.66.131
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46799
--builtin_ntp_servers=127.26.66.148:39873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 11:36:26.959641 15494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:26.947675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.130:37599 (local address 127.26.66.190:46799)
0808 11:36:26.947858 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:26.947862 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:26.949547 (+ 1685us) server_negotiation.cc:407] Connection header received
0808 11:36:26.951350 (+ 1803us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:26.951355 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:26.951443 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:26.951542 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:26.953060 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:26.953889 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:26.956382 (+ 2493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:26.956864 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:26.956974 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:26.958667 (+ 1693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:26.958672 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:26.958676 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:26.958694 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:26.958730 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:26.958743 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:26.958897 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:26.959182 (+ 285us) server_negotiation.cc:299] Negotiation successful
0808 11:36:26.959301 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 11:36:26.960844 15635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:26.948422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:46799 (local address 127.26.66.130:37599)
0808 11:36:26.949407 (+ 985us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:26.949445 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:26.951102 (+ 1657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:26.951826 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:26.951840 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:26.951991 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:36:26.952851 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:26.952880 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:26.954061 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:26.954069 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:26.956215 (+ 2146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:26.956233 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:26.957096 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:26.957106 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:26.957444 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:26.958285 (+ 841us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 11:36:26.958290 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:36:26.958350 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 11:36:26.958447 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:36:26.958928 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:36:26.958947 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:36:26.958954 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 11:36:26.959151 (+ 197us) client_negotiation.cc:240] Negotiation successful
0808 11:36:26.959572 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":346,"threads_started":1}
I20260808 11:36:26.962339 15633 heartbeater.cc:347] Connected to a master server at 127.26.66.190:46799
I20260808 11:36:26.962755 15633 heartbeater.cc:464] Registering TS with master...
I20260808 11:36:26.963501 15633 heartbeater.cc:511] Master 127.26.66.190:46799 requested a full tablet report, sending...
I20260808 11:36:26.964967 15292 ts_manager.cc:194] Registered new tserver with Master: a49e9efc39694da19e2466afed4d8f76 (127.26.66.130:36485)
I20260808 11:36:26.965796 15292 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.66.130:37599
W20260808 11:36:27.304909 15636 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:27.305188 15636 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:27.305349 15636 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:27.312835 15636 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:27.312937 15636 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:27.313126 15636 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.66.131
I20260808 11:36:27.322276 15636 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:39873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.66.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.66.131
--webserver_port=0
--tserver_master_addrs=127.26.66.190:46799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.66.131
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:27.323606 15636 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:27.325496 15636 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:27.338522 15645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:27.338616 15642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:27.338649 15643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:27.340190 15636 server_base.cc:1034] running on GCE node
I20260808 11:36:27.340770 15636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:27.341717 15636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:27.342952 15636 hybrid_clock.cc:648] HybridClock initialized: now 1786188987342914 us; error 51 us; skew 500 ppm
I20260808 11:36:27.343334 15636 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 11:36:27.345588 15636 webserver.cc:460] Webserver started at http://127.26.66.131:46587/ using document root <none> and password file <none>
I20260808 11:36:27.346333 15636 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:27.346465 15636 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:27.346774 15636 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:27.349689 15636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-2/data/instance:
uuid: "96d131df6b364550ad3983d9f2c8d29a"
format_stamp: "Formatted at 2026-08-08 11:36:27 on dist-test-slave-zkpd"
server_key: "9c23f66fdf007996b560b91cfd881499"
server_key_iv: "efc189326286e8d1441786a320ee49a3"
server_key_version: "encryptionkey@0"
I20260808 11:36:27.350517 15636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance:
uuid: "96d131df6b364550ad3983d9f2c8d29a"
format_stamp: "Formatted at 2026-08-08 11:36:27 on dist-test-slave-zkpd"
server_key: "9c23f66fdf007996b560b91cfd881499"
server_key_iv: "efc189326286e8d1441786a320ee49a3"
server_key_version: "encryptionkey@0"
I20260808 11:36:27.355718 15636 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260808 11:36:27.359319 15652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:27.360760 15636 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:36:27.360949 15636 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-2/wal
uuid: "96d131df6b364550ad3983d9f2c8d29a"
format_stamp: "Formatted at 2026-08-08 11:36:27 on dist-test-slave-zkpd"
server_key: "9c23f66fdf007996b560b91cfd881499"
server_key_iv: "efc189326286e8d1441786a320ee49a3"
server_key_version: "encryptionkey@0"
I20260808 11:36:27.361162 15636 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:27.372812 15636 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:27.373730 15636 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:27.374044 15636 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:27.375000 15636 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 11:36:27.376565 15636 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 11:36:27.376698 15636 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:27.376837 15636 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 11:36:27.376928 15636 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:27.411494 15636 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.131:34003
I20260808 11:36:27.411550 15774 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.131:34003 every 8 connection(s)
I20260808 11:36:27.412890 15636 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-2/data/info.pb
I20260808 11:36:27.416450 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 15636
I20260808 11:36:27.416658 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-2/wal/instance
I20260808 11:36:27.417263 26890 external_mini_cluster.cc:1428] Setting key b609dc45f52a53bc9f4a9336d7a23eb3
I20260808 11:36:27.426038 15494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:27.415483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:43697 (local address 127.26.66.190:46799)
0808 11:36:27.415685 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:27.415689 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:27.417365 (+ 1676us) server_negotiation.cc:407] Connection header received
0808 11:36:27.419783 (+ 2418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:27.419789 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:27.419876 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:27.420015 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:27.421250 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:27.421996 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:27.423510 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:27.424041 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:27.424168 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:27.425401 (+ 1233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:27.425407 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:27.425412 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:27.425431 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:27.425464 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:27.425477 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:27.425551 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:27.425716 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 11:36:27.425793 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 11:36:27.426959 15777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:27.415978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:46799 (local address 127.26.66.131:43697)
0808 11:36:27.417141 (+ 1163us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:27.417186 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:27.419496 (+ 2310us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:27.420274 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:27.420286 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:27.420404 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:36:27.421065 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:27.421084 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:27.422124 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:27.422128 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:27.423366 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:27.423379 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:27.424245 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:27.424268 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:27.424470 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:27.425097 (+ 627us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 11:36:27.425100 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:36:27.425142 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 11:36:27.425220 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:36:27.425547 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:36:27.425552 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:36:27.425557 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 11:36:27.425689 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 11:36:27.425969 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":394,"threads_started":1}
I20260808 11:36:27.428363 15775 heartbeater.cc:347] Connected to a master server at 127.26.66.190:46799
I20260808 11:36:27.428625 15775 heartbeater.cc:464] Registering TS with master...
I20260808 11:36:27.429296 15775 heartbeater.cc:511] Master 127.26.66.190:46799 requested a full tablet report, sending...
I20260808 11:36:27.430610 15292 ts_manager.cc:194] Registered new tserver with Master: 96d131df6b364550ad3983d9f2c8d29a (127.26.66.131:34003)
I20260808 11:36:27.431728 15292 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.66.131:43697
I20260808 11:36:27.432760 26890 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 11:36:27.443073 15494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:27.436880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41364 (local address 127.26.66.190:46799)
0808 11:36:27.437059 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:27.437063 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:27.437634 (+ 571us) server_negotiation.cc:407] Connection header received
0808 11:36:27.437874 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:27.437880 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:27.437966 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:27.438074 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:27.438577 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:27.439256 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:27.440690 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:27.441111 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:27.441248 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:27.442281 (+ 1033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:27.442286 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:27.442290 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:27.442308 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:27.442337 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:27.442349 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:27.442447 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:27.442605 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 11:36:27.442695 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 11:36:27.446560 15292 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41364:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 11:36:27.453425 15292 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 11:36:27.483861 15790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:27.467351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.131:34003 (local address 127.0.0.1:55244)
0808 11:36:27.468550 (+ 1199us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:27.468608 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:27.468856 (+ 248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:27.475687 (+ 6831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:27.475692 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:27.475717 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:27.476127 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:27.476139 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:27.478121 (+ 1982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:27.478127 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:27.480737 (+ 2610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:27.480753 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:27.482902 (+ 2149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:27.482909 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:27.483114 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:27.483169 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 11:36:27.483288 (+ 119us) client_negotiation.cc:240] Negotiation successful
0808 11:36:27.483480 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":868,"mutex_wait_us":109,"thread_start_us":1800,"threads_started":1}
I20260808 11:36:27.484135 15791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:27.467721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55244 (local address 127.26.66.131:34003)
0808 11:36:27.474842 (+ 7121us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:27.474852 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:27.474898 (+ 46us) server_negotiation.cc:407] Connection header received
0808 11:36:27.475011 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:27.475018 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:27.475230 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:27.475430 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:27.476378 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:27.477932 (+ 1554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:27.480982 (+ 3050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:27.482367 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:27.482495 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:27.482764 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:27.483392 (+ 628us) server_negotiation.cc:299] Negotiation successful
0808 11:36:27.483614 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6967,"thread_start_us":6818,"threads_started":1}
I20260808 11:36:27.485203 15789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:27.467676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:36479 (local address 127.0.0.1:35854)
0808 11:36:27.469477 (+ 1801us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:27.469495 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:27.469605 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:27.473652 (+ 4047us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:27.473662 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:27.473732 (+ 70us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:27.474186 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:27.474202 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:27.476702 (+ 2500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:27.476711 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:27.481107 (+ 4396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:27.481129 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:27.484544 (+ 3415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:27.484550 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:27.484758 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:27.484789 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 11:36:27.484867 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 11:36:27.484970 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1666,"mutex_wait_us":132,"thread_start_us":899,"threads_started":1}
I20260808 11:36:27.485932 15792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:27.468354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35854 (local address 127.26.66.129:36479)
0808 11:36:27.472488 (+ 4134us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:27.472500 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:27.472538 (+ 38us) server_negotiation.cc:407] Connection header received
0808 11:36:27.472660 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:27.472671 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:27.473013 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:27.473248 (+ 235us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:27.474402 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:27.476493 (+ 2091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:27.481380 (+ 4887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:27.483956 (+ 2576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:27.484101 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:27.485385 (+ 1284us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:27.485466 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 11:36:27.485654 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3898,"thread_start_us":3738,"threads_started":1}
I20260808 11:36:27.489737 15423 tablet_service.cc:1467] Processing CreateTablet for tablet 7640a8e6cf5e43c79440c2d67bb77d9a (DEFAULT_TABLE table=test-table [id=9733298d273f43719f0025a1f6dfdb01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:36:27.491055 15423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7640a8e6cf5e43c79440c2d67bb77d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:27.491689 15707 tablet_service.cc:1467] Processing CreateTablet for tablet 7640a8e6cf5e43c79440c2d67bb77d9a (DEFAULT_TABLE table=test-table [id=9733298d273f43719f0025a1f6dfdb01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:36:27.493033 15707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7640a8e6cf5e43c79440c2d67bb77d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:27.495391 15790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:27.469605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:36485 (local address 127.0.0.1:52534)
0808 11:36:27.484550 (+ 14945us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:27.484568 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:27.484669 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:27.487933 (+ 3264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:27.487941 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:27.487982 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:27.488742 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:27.488754 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:27.490807 (+ 2053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:27.490822 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:27.492610 (+ 1788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:27.492627 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:27.494520 (+ 1893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:27.494526 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:27.494719 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:27.494753 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 11:36:27.494972 (+ 219us) client_negotiation.cc:240] Negotiation successful
0808 11:36:27.495110 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14836,"thread_start_us":18608,"threads_started":1}
I20260808 11:36:27.496381 15794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:27.470231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52534 (local address 127.26.66.130:36485)
0808 11:36:27.487288 (+ 17057us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:27.487296 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:27.487325 (+ 29us) server_negotiation.cc:407] Connection header received
0808 11:36:27.487434 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:27.487442 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:27.487668 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:27.487921 (+ 253us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:27.489040 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:27.490647 (+ 1607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:27.492810 (+ 2163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:27.494331 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:27.494478 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:27.494708 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:27.495067 (+ 359us) server_negotiation.cc:299] Negotiation successful
0808 11:36:27.496033 (+ 966us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16902,"thread_start_us":16738,"threads_started":1}
I20260808 11:36:27.499950 15564 tablet_service.cc:1467] Processing CreateTablet for tablet 7640a8e6cf5e43c79440c2d67bb77d9a (DEFAULT_TABLE table=test-table [id=9733298d273f43719f0025a1f6dfdb01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 11:36:27.501266 15564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7640a8e6cf5e43c79440c2d67bb77d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:27.502380 15492 heartbeater.cc:503] Master 127.26.66.190:46799 was elected leader, sending a full tablet report...
I20260808 11:36:27.503947 15795 tablet_bootstrap.cc:492] T 7640a8e6cf5e43c79440c2d67bb77d9a P 073465c96e28418389d6f962e058908b: Bootstrap starting.
I20260808 11:36:27.507040 15795 tablet_bootstrap.cc:654] T 7640a8e6cf5e43c79440c2d67bb77d9a P 073465c96e28418389d6f962e058908b: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:27.508158 15795 log.cc:824] T 7640a8e6cf5e43c79440c2d67bb77d9a P 073465c96e28418389d6f962e058908b: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:27.508745 15796 tablet_bootstrap.cc:492] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a: Bootstrap starting.
I20260808 11:36:27.512986 15796 tablet_bootstrap.cc:654] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:27.514240 15796 log.cc:824] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:27.514638 15795 tablet_bootstrap.cc:492] T 7640a8e6cf5e43c79440c2d67bb77d9a P 073465c96e28418389d6f962e058908b: No bootstrap required, opened a new log
I20260808 11:36:27.515017 15795 ts_tablet_manager.cc:1397] T 7640a8e6cf5e43c79440c2d67bb77d9a P 073465c96e28418389d6f962e058908b: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.010s
I20260808 11:36:27.516908 15799 tablet_bootstrap.cc:492] T 7640a8e6cf5e43c79440c2d67bb77d9a P a49e9efc39694da19e2466afed4d8f76: Bootstrap starting.
I20260808 11:36:27.520390 15799 tablet_bootstrap.cc:654] T 7640a8e6cf5e43c79440c2d67bb77d9a P a49e9efc39694da19e2466afed4d8f76: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:27.521354 15796 tablet_bootstrap.cc:492] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a: No bootstrap required, opened a new log
I20260808 11:36:27.521560 15799 log.cc:824] T 7640a8e6cf5e43c79440c2d67bb77d9a P a49e9efc39694da19e2466afed4d8f76: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:27.521616 15796 ts_tablet_manager.cc:1397] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.004s
I20260808 11:36:27.524489 15799 tablet_bootstrap.cc:492] T 7640a8e6cf5e43c79440c2d67bb77d9a P a49e9efc39694da19e2466afed4d8f76: No bootstrap required, opened a new log
I20260808 11:36:27.524753 15799 ts_tablet_manager.cc:1397] T 7640a8e6cf5e43c79440c2d67bb77d9a P a49e9efc39694da19e2466afed4d8f76: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260808 11:36:27.525611 15795 raft_consensus.cc:348] T 7640a8e6cf5e43c79440c2d67bb77d9a P 073465c96e28418389d6f962e058908b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96d131df6b364550ad3983d9f2c8d29a" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34003 } } peers { permanent_uuid: "073465c96e28418389d6f962e058908b" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 36479 } } peers { permanent_uuid: "a49e9efc39694da19e2466afed4d8f76" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36485 } }
I20260808 11:36:27.526078 15795 raft_consensus.cc:374] T 7640a8e6cf5e43c79440c2d67bb77d9a P 073465c96e28418389d6f962e058908b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:27.526185 15795 raft_consensus.cc:729] T 7640a8e6cf5e43c79440c2d67bb77d9a P 073465c96e28418389d6f962e058908b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073465c96e28418389d6f962e058908b, State: Initialized, Role: FOLLOWER
I20260808 11:36:27.526799 15795 consensus_queue.cc:260] T 7640a8e6cf5e43c79440c2d67bb77d9a P 073465c96e28418389d6f962e058908b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96d131df6b364550ad3983d9f2c8d29a" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34003 } } peers { permanent_uuid: "073465c96e28418389d6f962e058908b" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 36479 } } peers { permanent_uuid: "a49e9efc39694da19e2466afed4d8f76" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36485 } }
I20260808 11:36:27.528514 15795 ts_tablet_manager.cc:1428] T 7640a8e6cf5e43c79440c2d67bb77d9a P 073465c96e28418389d6f962e058908b: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260808 11:36:27.530865 15796 raft_consensus.cc:348] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96d131df6b364550ad3983d9f2c8d29a" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34003 } } peers { permanent_uuid: "073465c96e28418389d6f962e058908b" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 36479 } } peers { permanent_uuid: "a49e9efc39694da19e2466afed4d8f76" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36485 } }
I20260808 11:36:27.531208 15796 raft_consensus.cc:374] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:27.531340 15796 raft_consensus.cc:729] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96d131df6b364550ad3983d9f2c8d29a, State: Initialized, Role: FOLLOWER
I20260808 11:36:27.532011 15796 consensus_queue.cc:260] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96d131df6b364550ad3983d9f2c8d29a" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34003 } } peers { permanent_uuid: "073465c96e28418389d6f962e058908b" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 36479 } } peers { permanent_uuid: "a49e9efc39694da19e2466afed4d8f76" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36485 } }
I20260808 11:36:27.533454 15775 heartbeater.cc:503] Master 127.26.66.190:46799 was elected leader, sending a full tablet report...
I20260808 11:36:27.534251 15796 ts_tablet_manager.cc:1428] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260808 11:36:27.534575 15799 raft_consensus.cc:348] T 7640a8e6cf5e43c79440c2d67bb77d9a P a49e9efc39694da19e2466afed4d8f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96d131df6b364550ad3983d9f2c8d29a" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34003 } } peers { permanent_uuid: "073465c96e28418389d6f962e058908b" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 36479 } } peers { permanent_uuid: "a49e9efc39694da19e2466afed4d8f76" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36485 } }
I20260808 11:36:27.534999 15799 raft_consensus.cc:374] T 7640a8e6cf5e43c79440c2d67bb77d9a P a49e9efc39694da19e2466afed4d8f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:27.535110 15799 raft_consensus.cc:729] T 7640a8e6cf5e43c79440c2d67bb77d9a P a49e9efc39694da19e2466afed4d8f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a49e9efc39694da19e2466afed4d8f76, State: Initialized, Role: FOLLOWER
I20260808 11:36:27.535655 15799 consensus_queue.cc:260] T 7640a8e6cf5e43c79440c2d67bb77d9a P a49e9efc39694da19e2466afed4d8f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96d131df6b364550ad3983d9f2c8d29a" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34003 } } peers { permanent_uuid: "073465c96e28418389d6f962e058908b" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 36479 } } peers { permanent_uuid: "a49e9efc39694da19e2466afed4d8f76" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36485 } }
I20260808 11:36:27.536900 15633 heartbeater.cc:503] Master 127.26.66.190:46799 was elected leader, sending a full tablet report...
I20260808 11:36:27.537532 15799 ts_tablet_manager.cc:1428] T 7640a8e6cf5e43c79440c2d67bb77d9a P a49e9efc39694da19e2466afed4d8f76: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
W20260808 11:36:27.664718 15776 tablet.cc:2369] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 11:36:27.697279 15634 tablet.cc:2369] T 7640a8e6cf5e43c79440c2d67bb77d9a P a49e9efc39694da19e2466afed4d8f76: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 11:36:27.729682 15493 tablet.cc:2369] T 7640a8e6cf5e43c79440c2d67bb77d9a P 073465c96e28418389d6f962e058908b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:36:27.928246 15802 raft_consensus.cc:482] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 11:36:27.928560 15802 raft_consensus.cc:504] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96d131df6b364550ad3983d9f2c8d29a" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34003 } } peers { permanent_uuid: "073465c96e28418389d6f962e058908b" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 36479 } } peers { permanent_uuid: "a49e9efc39694da19e2466afed4d8f76" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36485 } }
I20260808 11:36:27.930284 15802 leader_election.cc:288] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073465c96e28418389d6f962e058908b (127.26.66.129:36479), a49e9efc39694da19e2466afed4d8f76 (127.26.66.130:36485)
I20260808 11:36:27.937826 15792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:27.930680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:36711 (local address 127.26.66.129:36479)
0808 11:36:27.930964 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:27.930973 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:27.931683 (+ 710us) server_negotiation.cc:407] Connection header received
0808 11:36:27.931871 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:27.931877 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:27.931993 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:27.932078 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:27.932733 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:27.933713 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:27.935986 (+ 2273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:27.936893 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:27.937052 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:27.937130 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:27.937416 (+ 286us) server_negotiation.cc:299] Negotiation successful
0808 11:36:27.937553 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260808 11:36:27.937868 15805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:27.930456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:36479 (local address 127.26.66.131:36711)
0808 11:36:27.931542 (+ 1086us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:27.931562 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:27.931701 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:27.932139 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:27.932144 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:27.932188 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:27.932547 (+ 359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:27.932558 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:27.933860 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:27.933865 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:27.935744 (+ 1879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:27.935757 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:27.937045 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:27.937051 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:27.937254 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:27.937279 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 11:36:27.937353 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 11:36:27.937510 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":939,"mutex_wait_us":132,"thread_start_us":927,"threads_started":1}
I20260808 11:36:27.937901 15794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:27.930902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.66.131:39281 (local address 127.26.66.130:36485)
0808 11:36:27.931144 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:27.931154 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:27.931847 (+ 693us) server_negotiation.cc:407] Connection header received
0808 11:36:27.932064 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:27.932072 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:27.932197 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:27.932320 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 11:36:27.933003 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:27.933734 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:27.936076 (+ 2342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:27.936909 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:27.937101 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:27.937177 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:27.937538 (+ 361us) server_negotiation.cc:299] Negotiation successful
0808 11:36:27.937667 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 11:36:27.937974 15804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:27.930811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.130:36485 (local address 127.26.66.131:39281)
0808 11:36:27.931689 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:27.931708 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 11:36:27.931876 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:36:27.932359 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:36:27.932362 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:36:27.932382 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 11:36:27.932802 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:27.932827 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:27.933911 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:27.933915 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:27.935744 (+ 1829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:36:27.935758 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:36:27.937116 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:36:27.937126 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:36:27.937295 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:27.937320 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 11:36:27.937495 (+ 175us) client_negotiation.cc:240] Negotiation successful
0808 11:36:27.937611 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":734,"mutex_wait_us":67,"thread_start_us":343,"threads_started":1}
I20260808 11:36:27.939003 15585 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7640a8e6cf5e43c79440c2d67bb77d9a" candidate_uuid: "96d131df6b364550ad3983d9f2c8d29a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a49e9efc39694da19e2466afed4d8f76" is_pre_election: true
I20260808 11:36:27.939100 15445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7640a8e6cf5e43c79440c2d67bb77d9a" candidate_uuid: "96d131df6b364550ad3983d9f2c8d29a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073465c96e28418389d6f962e058908b" is_pre_election: true
I20260808 11:36:27.939545 15585 raft_consensus.cc:2454] T 7640a8e6cf5e43c79440c2d67bb77d9a P a49e9efc39694da19e2466afed4d8f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96d131df6b364550ad3983d9f2c8d29a in term 0.
I20260808 11:36:27.939620 15445 raft_consensus.cc:2454] T 7640a8e6cf5e43c79440c2d67bb77d9a P 073465c96e28418389d6f962e058908b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96d131df6b364550ad3983d9f2c8d29a in term 0.
I20260808 11:36:27.940415 15657 leader_election.cc:302] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96d131df6b364550ad3983d9f2c8d29a, a49e9efc39694da19e2466afed4d8f76; no voters:
I20260808 11:36:27.940871 15802 raft_consensus.cc:2781] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 11:36:27.941025 15802 raft_consensus.cc:482] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 11:36:27.941144 15802 raft_consensus.cc:3037] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:27.944037 15802 raft_consensus.cc:504] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96d131df6b364550ad3983d9f2c8d29a" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34003 } } peers { permanent_uuid: "073465c96e28418389d6f962e058908b" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 36479 } } peers { permanent_uuid: "a49e9efc39694da19e2466afed4d8f76" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36485 } }
I20260808 11:36:27.944773 15802 leader_election.cc:288] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a [CANDIDATE]: Term 1 election: Requested vote from peers 073465c96e28418389d6f962e058908b (127.26.66.129:36479), a49e9efc39694da19e2466afed4d8f76 (127.26.66.130:36485)
I20260808 11:36:27.945158 15445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7640a8e6cf5e43c79440c2d67bb77d9a" candidate_uuid: "96d131df6b364550ad3983d9f2c8d29a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073465c96e28418389d6f962e058908b"
I20260808 11:36:27.945410 15445 raft_consensus.cc:3037] T 7640a8e6cf5e43c79440c2d67bb77d9a P 073465c96e28418389d6f962e058908b [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:27.945571 15585 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7640a8e6cf5e43c79440c2d67bb77d9a" candidate_uuid: "96d131df6b364550ad3983d9f2c8d29a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a49e9efc39694da19e2466afed4d8f76"
I20260808 11:36:27.945804 15585 raft_consensus.cc:3037] T 7640a8e6cf5e43c79440c2d67bb77d9a P a49e9efc39694da19e2466afed4d8f76 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:27.948822 15445 raft_consensus.cc:2454] T 7640a8e6cf5e43c79440c2d67bb77d9a P 073465c96e28418389d6f962e058908b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96d131df6b364550ad3983d9f2c8d29a in term 1.
I20260808 11:36:27.949271 15655 leader_election.cc:302] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073465c96e28418389d6f962e058908b, 96d131df6b364550ad3983d9f2c8d29a; no voters:
I20260808 11:36:27.949422 15585 raft_consensus.cc:2454] T 7640a8e6cf5e43c79440c2d67bb77d9a P a49e9efc39694da19e2466afed4d8f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96d131df6b364550ad3983d9f2c8d29a in term 1.
I20260808 11:36:27.949582 15802 raft_consensus.cc:2781] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:36:27.950155 15802 raft_consensus.cc:686] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a [term 1 LEADER]: Becoming Leader. State: Replica: 96d131df6b364550ad3983d9f2c8d29a, State: Running, Role: LEADER
I20260808 11:36:27.950661 15802 consensus_queue.cc:237] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96d131df6b364550ad3983d9f2c8d29a" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34003 } } peers { permanent_uuid: "073465c96e28418389d6f962e058908b" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 36479 } } peers { permanent_uuid: "a49e9efc39694da19e2466afed4d8f76" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36485 } }
I20260808 11:36:27.955773 15292 catalog_manager.cc:5495] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a reported cstate change: term changed from 0 to 1, leader changed from <none> to 96d131df6b364550ad3983d9f2c8d29a (127.26.66.131). New cstate: current_term: 1 leader_uuid: "96d131df6b364550ad3983d9f2c8d29a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96d131df6b364550ad3983d9f2c8d29a" member_type: VOTER last_known_addr { host: "127.26.66.131" port: 34003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073465c96e28418389d6f962e058908b" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 36479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a49e9efc39694da19e2466afed4d8f76" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36485 } health_report { overall_health: UNKNOWN } } }
I20260808 11:36:28.040794 15810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:28.034601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55246 (local address 127.26.66.131:34003)
0808 11:36:28.035464 (+ 863us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:28.035472 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:28.035497 (+ 25us) server_negotiation.cc:407] Connection header received
0808 11:36:28.035596 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:28.035600 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:28.035675 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:28.035842 (+ 167us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:36:28.036402 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:28.037115 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:28.038579 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:28.038992 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:28.039128 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:28.039622 (+ 494us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:36:28.040195 (+ 573us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:36:28.040368 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:28.040429 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 11:36:28.040506 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":714,"thread_start_us":580,"threads_started":1}
I20260808 11:36:28.048854 15445 raft_consensus.cc:1261] T 7640a8e6cf5e43c79440c2d67bb77d9a P 073465c96e28418389d6f962e058908b [term 1 FOLLOWER]: Refusing update from remote peer 96d131df6b364550ad3983d9f2c8d29a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:36:28.048873 15585 raft_consensus.cc:1261] T 7640a8e6cf5e43c79440c2d67bb77d9a P a49e9efc39694da19e2466afed4d8f76 [term 1 FOLLOWER]: Refusing update from remote peer 96d131df6b364550ad3983d9f2c8d29a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:36:28.049857 15806 consensus_queue.cc:1035] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a [LEADER]: Connected to new peer: Peer: permanent_uuid: "073465c96e28418389d6f962e058908b" member_type: VOTER last_known_addr { host: "127.26.66.129" port: 36479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:36:28.050201 15802 consensus_queue.cc:1035] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a49e9efc39694da19e2466afed4d8f76" member_type: VOTER last_known_addr { host: "127.26.66.130" port: 36485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:36:28.063683 15815 mvcc.cc:205] Tried to move back new op lower bound from 7316230095038144512 to 7316230094650331136. Current Snapshot: MvccSnapshot[applied={T|T < 7316230095038144512}]
I20260808 11:36:28.066267 15811 mvcc.cc:205] Tried to move back new op lower bound from 7316230095038144512 to 7316230094650331136. Current Snapshot: MvccSnapshot[applied={T|T < 7316230095038144512 or (T in {7316230095038144512})}]
I20260808 11:36:28.075951 15291 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41364:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:36:28.076220 15291 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41364:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 11:36:28.079788 15291 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5290ad6651d7475ea0058d6cbbe84f0e: Sending DeleteTablet for 3 replicas of tablet 7640a8e6cf5e43c79440c2d67bb77d9a
I20260808 11:36:28.080986 15423 tablet_service.cc:1514] Processing DeleteTablet for tablet 7640a8e6cf5e43c79440c2d67bb77d9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:36:28 UTC) from {username='slave'} at 127.0.0.1:35854
I20260808 11:36:28.081028 15564 tablet_service.cc:1514] Processing DeleteTablet for tablet 7640a8e6cf5e43c79440c2d67bb77d9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:36:28 UTC) from {username='slave'} at 127.0.0.1:52534
I20260808 11:36:28.081561 15707 tablet_service.cc:1514] Processing DeleteTablet for tablet 7640a8e6cf5e43c79440c2d67bb77d9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 11:36:28 UTC) from {username='slave'} at 127.0.0.1:55244
I20260808 11:36:28.082544 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 15359
I20260808 11:36:28.088464 15823 tablet_replica.cc:330] T 7640a8e6cf5e43c79440c2d67bb77d9a P a49e9efc39694da19e2466afed4d8f76: stopping tablet replica
I20260808 11:36:28.088958 15823 raft_consensus.cc:2229] T 7640a8e6cf5e43c79440c2d67bb77d9a P a49e9efc39694da19e2466afed4d8f76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:36:28.089367 15822 tablet_replica.cc:330] T 7640a8e6cf5e43c79440c2d67bb77d9a P 073465c96e28418389d6f962e058908b: stopping tablet replica
I20260808 11:36:28.089519 15823 raft_consensus.cc:2258] T 7640a8e6cf5e43c79440c2d67bb77d9a P a49e9efc39694da19e2466afed4d8f76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:36:28.089926 15824 tablet_replica.cc:330] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a: stopping tablet replica
I20260808 11:36:28.090363 15824 raft_consensus.cc:2229] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a [term 1 LEADER]: Raft consensus shutting down.
I20260808 11:36:28.090893 15822 raft_consensus.cc:2229] T 7640a8e6cf5e43c79440c2d67bb77d9a P 073465c96e28418389d6f962e058908b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 11:36:28.091516 15823 ts_tablet_manager.cc:1905] T 7640a8e6cf5e43c79440c2d67bb77d9a P a49e9efc39694da19e2466afed4d8f76: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:36:28.091605 15824 raft_consensus.cc:2258] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:36:28.092168 15822 raft_consensus.cc:2258] T 7640a8e6cf5e43c79440c2d67bb77d9a P 073465c96e28418389d6f962e058908b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 11:36:28.094333 15824 ts_tablet_manager.cc:1905] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:36:28.099018 15823 ts_tablet_manager.cc:1918] T 7640a8e6cf5e43c79440c2d67bb77d9a P a49e9efc39694da19e2466afed4d8f76: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:36:28.099252 15823 log.cc:1196] T 7640a8e6cf5e43c79440c2d67bb77d9a P a49e9efc39694da19e2466afed4d8f76: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-1/wal/wals/7640a8e6cf5e43c79440c2d67bb77d9a
I20260808 11:36:28.099865 15823 ts_tablet_manager.cc:1939] T 7640a8e6cf5e43c79440c2d67bb77d9a P a49e9efc39694da19e2466afed4d8f76: Deleting consensus metadata
I20260808 11:36:28.100095 15822 ts_tablet_manager.cc:1905] T 7640a8e6cf5e43c79440c2d67bb77d9a P 073465c96e28418389d6f962e058908b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 11:36:28.101938 15278 catalog_manager.cc:4841] TS a49e9efc39694da19e2466afed4d8f76 (127.26.66.130:36485): tablet 7640a8e6cf5e43c79440c2d67bb77d9a (table test-table [id=9733298d273f43719f0025a1f6dfdb01]) successfully deleted
I20260808 11:36:28.102440 15824 ts_tablet_manager.cc:1918] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 11:36:28.102670 15824 log.cc:1196] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a: Deleting WAL directory at /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786188664137852-26890-0/minicluster-data/ts-2/wal/wals/7640a8e6cf5e43c79440c2d67bb77d9a
I20260808 11:36:28.103294 15824 ts_tablet_manager.cc:1939] T 7640a8e6cf5e43c79440c2d67bb77d9a P 96d131df6b364550ad3983d9f2c8d29a: Deleting consensus metadata
I20260808 11:36:28.104519 15792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:28.084254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35868 (local address 127.26.66.129:36479)
0808 11:36:28.084488 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:28.084497 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:28.088676 (+ 4179us) server_negotiation.cc:407] Connection header received
0808 11:36:28.088867 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:28.088875 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:28.089028 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:28.089178 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:28.090176 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:28.094791 (+ 4615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:28.097168 (+ 2377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:28.097827 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:28.097937 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:28.102532 (+ 4595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:28.102545 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:28.102561 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:28.103428 (+ 867us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:28.103488 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:28.103514 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:28.103603 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:28.103931 (+ 328us) server_negotiation.cc:299] Negotiation successful
0808 11:36:28.104053 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 11:36:28.104998 15278 catalog_manager.cc:4841] TS 96d131df6b364550ad3983d9f2c8d29a (127.26.66.131:34003): tablet 7640a8e6cf5e43c79440c2d67bb77d9a (table test-table [id=9733298d273f43719f0025a1f6dfdb01]) successfully deleted
I20260808 11:36:28.105944 15487 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:28.195044 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 15359
W20260808 11:36:28.220902 15276 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.66.129:36479 (error 108)
I20260808 11:36:28.222240 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 15496
I20260808 11:36:28.223232 15828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:28.222270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:36479 (local address 127.0.0.1:35870)
0808 11:36:28.222793 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:28.222993 (+ 200us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:36479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":223,"threads_started":1}
W20260808 11:36:28.223554 15276 catalog_manager.cc:4584] TS 073465c96e28418389d6f962e058908b (127.26.66.129:36479): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7640a8e6cf5e43c79440c2d67bb77d9a: Network error: Client connection negotiation failed: client connection to 127.26.66.129:36479: connect: Connection refused (error 111)
I20260808 11:36:28.230135 15794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:28.223073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52544 (local address 127.26.66.130:36485)
0808 11:36:28.223268 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:28.223275 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:28.223443 (+ 168us) server_negotiation.cc:407] Connection header received
0808 11:36:28.223528 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:28.223535 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:28.223681 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:28.223801 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:28.224399 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:28.225140 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:28.227004 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:28.227407 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:28.227501 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:28.228754 (+ 1253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:28.228762 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:28.228776 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:28.229356 (+ 580us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:28.229409 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:28.229429 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:28.229517 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:28.229683 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 11:36:28.229769 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 11:36:28.230760 15628 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:28.277516 15828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:28.276928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:36479 (local address 127.0.0.1:35876)
0808 11:36:28.277190 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:28.277329 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:36479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260808 11:36:28.278810 15828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:28.278374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:36479 (local address 127.0.0.1:35890)
0808 11:36:28.278545 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:28.278648 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:36479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 11:36:28.323339 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 15496
I20260808 11:36:28.339329 15828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:28.338740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:36479 (local address 127.0.0.1:35894)
0808 11:36:28.339075 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:28.339168 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:36479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171}
I20260808 11:36:28.340480 15828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:28.340113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:36479 (local address 127.0.0.1:35904)
0808 11:36:28.340268 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:28.340345 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:36479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 11:36:28.351626 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 15636
I20260808 11:36:28.359063 15810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:28.352495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55256 (local address 127.26.66.131:34003)
0808 11:36:28.352729 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:28.352735 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:28.352764 (+ 29us) server_negotiation.cc:407] Connection header received
0808 11:36:28.352901 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:28.352907 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:28.353002 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:28.353123 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:28.353550 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:28.354378 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:28.355656 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:28.356233 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:28.356390 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:28.357567 (+ 1177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:28.357577 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:28.357594 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:28.358233 (+ 639us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:28.358279 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:28.358302 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:28.358436 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:28.358615 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 11:36:28.358712 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260808 11:36:28.359951 15770 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:28.420971 15828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:28.420396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:36479 (local address 127.0.0.1:35912)
0808 11:36:28.420667 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:28.420782 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:36479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260808 11:36:28.422242 15828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:28.421730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:36479 (local address 127.0.0.1:35928)
0808 11:36:28.421991 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:28.422075 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:36479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149}
I20260808 11:36:28.485373 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 15636
I20260808 11:36:28.510119 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 15259
I20260808 11:36:28.511375 15326 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:28.621162 15828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:28.620411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.129:36479 (local address 127.0.0.1:35936)
0808 11:36:28.620755 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0808 11:36:28.620908 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.129:36479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
I20260808 11:36:28.621317 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 15259
2026-08-08T11:36:28Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3284 ms)
[----------] 6 tests from EncryptionPolicyTest (23599 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:36:28 dist-test-slave-zkpd krb5kdc[15835](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:36:28 dist-test-slave-zkpd krb5kdc[15835](info): set up 2 sockets
Aug 08 11:36:28 dist-test-slave-zkpd krb5kdc[15835](info): commencing operation
krb5kdc: starting...
W20260808 11:36:29.806813 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.000s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:36:30 dist-test-slave-zkpd krb5kdc[15835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188990, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:36:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:36:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 11:36:30.147578 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33917
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33917
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:36:30.494966 15850 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:30.495332 15850 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:30.495500 15850 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:30.502658 15850 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:36:30.502815 15850 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:30.502941 15850 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:30.503047 15850 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:36:30.503130 15850 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:36:30.513068 15850 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33917
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:30.514418 15850 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:30.515761 15850 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:30.527550 15855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:30.527458 15858 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:30.527503 15856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:30.528707 15850 server_base.cc:1034] running on GCE node
I20260808 11:36:30.529500 15850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:30.531010 15850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:30.532212 15850 hybrid_clock.cc:648] HybridClock initialized: now 1786188990532163 us; error 45 us; skew 500 ppm
I20260808 11:36:30.532570 15850 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:36:30 dist-test-slave-zkpd krb5kdc[15835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188990, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:36:30.535882 15850 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 11:36:30.537465 15850 webserver.cc:460] Webserver started at http://127.0.0.1:43091/ using document root <none> and password file <none>
I20260808 11:36:30.538154 15850 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:30.538295 15850 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:30.538615 15850 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:30.541687 15850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "a8a5527bfa9742a9967a4037f2d940ab"
format_stamp: "Formatted at 2026-08-08 11:36:30 on dist-test-slave-zkpd"
server_key: "5818004c12cc957b9c71b9ebbf54fd8b"
server_key_iv: "1a3f3d0133e7c45639dc4070a01e09b8"
server_key_version: "encryptionkey@0"
I20260808 11:36:30.542476 15850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "a8a5527bfa9742a9967a4037f2d940ab"
format_stamp: "Formatted at 2026-08-08 11:36:30 on dist-test-slave-zkpd"
server_key: "5818004c12cc957b9c71b9ebbf54fd8b"
server_key_iv: "1a3f3d0133e7c45639dc4070a01e09b8"
server_key_version: "encryptionkey@0"
I20260808 11:36:30.547742 15850 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260808 11:36:30.551251 15865 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:30.552743 15850 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:36:30.552951 15850 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "a8a5527bfa9742a9967a4037f2d940ab"
format_stamp: "Formatted at 2026-08-08 11:36:30 on dist-test-slave-zkpd"
server_key: "5818004c12cc957b9c71b9ebbf54fd8b"
server_key_iv: "1a3f3d0133e7c45639dc4070a01e09b8"
server_key_version: "encryptionkey@0"
I20260808 11:36:30.553154 15850 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:30.579908 15850 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:30.584491 15850 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:30.584800 15850 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:30.603785 15850 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33917
I20260808 11:36:30.603821 15920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33917 every 8 connection(s)
I20260808 11:36:30.605250 15850 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:36:30.609196 15921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:30.611943 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 15850
I20260808 11:36:30.612170 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:36:30.613004 26890 external_mini_cluster.cc:1428] Setting key 72322a6638e6bf51b65b93c1957ed7a1
I20260808 11:36:30.622444 15921 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8a5527bfa9742a9967a4037f2d940ab: Bootstrap starting.
I20260808 11:36:30.626796 15921 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a8a5527bfa9742a9967a4037f2d940ab: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:30.628257 15921 log.cc:824] T 00000000000000000000000000000000 P a8a5527bfa9742a9967a4037f2d940ab: Log is configured to *not* fsync() on all Append() calls
Aug 08 11:36:30 dist-test-slave-zkpd krb5kdc[15835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188990, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 11:36:30.631264 15921 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8a5527bfa9742a9967a4037f2d940ab: No bootstrap required, opened a new log
I20260808 11:36:30.637722 15924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:30.615202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47787 (local address 127.0.0.1:33917)
0808 11:36:30.616055 (+ 853us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:30.616066 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:30.616110 (+ 44us) server_negotiation.cc:407] Connection header received
0808 11:36:30.617837 (+ 1727us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:30.617859 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:30.618273 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:30.618626 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:30.620533 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:30.621898 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:30.623725 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:30.624534 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:30.624699 (+ 165us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:30.630155 (+ 5456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:30.630163 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:30.630177 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:30.630216 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:30.633432 (+ 3216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:30.634255 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:30.634265 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:30.634273 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:30.634441 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:30.634931 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:30.634936 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:30.634938 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:30.635452 (+ 514us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:30.635827 (+ 375us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:30.636386 (+ 559us) server_negotiation.cc:299] Negotiation successful
0808 11:36:30.636713 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":388,"threads_started":1}
I20260808 11:36:30.639367 15921 raft_consensus.cc:348] T 00000000000000000000000000000000 P a8a5527bfa9742a9967a4037f2d940ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8a5527bfa9742a9967a4037f2d940ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33917 } }
I20260808 11:36:30.639736 15921 raft_consensus.cc:374] T 00000000000000000000000000000000 P a8a5527bfa9742a9967a4037f2d940ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:30.639863 15921 raft_consensus.cc:729] T 00000000000000000000000000000000 P a8a5527bfa9742a9967a4037f2d940ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8a5527bfa9742a9967a4037f2d940ab, State: Initialized, Role: FOLLOWER
I20260808 11:36:30.640501 15921 consensus_queue.cc:260] T 00000000000000000000000000000000 P a8a5527bfa9742a9967a4037f2d940ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8a5527bfa9742a9967a4037f2d940ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33917 } }
I20260808 11:36:30.640829 15921 raft_consensus.cc:388] T 00000000000000000000000000000000 P a8a5527bfa9742a9967a4037f2d940ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:36:30.640998 15921 raft_consensus.cc:482] T 00000000000000000000000000000000 P a8a5527bfa9742a9967a4037f2d940ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:36:30.641191 15921 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a8a5527bfa9742a9967a4037f2d940ab [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:30.641788 26890 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 11:36:30.643487 15921 raft_consensus.cc:504] T 00000000000000000000000000000000 P a8a5527bfa9742a9967a4037f2d940ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8a5527bfa9742a9967a4037f2d940ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33917 } }
I20260808 11:36:30.644050 15921 leader_election.cc:302] T 00000000000000000000000000000000 P a8a5527bfa9742a9967a4037f2d940ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a8a5527bfa9742a9967a4037f2d940ab; no voters:
I20260808 11:36:30.644738 15921 leader_election.cc:288] T 00000000000000000000000000000000 P a8a5527bfa9742a9967a4037f2d940ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:36:30.644840 15928 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a8a5527bfa9742a9967a4037f2d940ab [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:36:30.650153 15921 sys_catalog.cc:564] T 00000000000000000000000000000000 P a8a5527bfa9742a9967a4037f2d940ab [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:36:30.651801 15928 raft_consensus.cc:686] T 00000000000000000000000000000000 P a8a5527bfa9742a9967a4037f2d940ab [term 1 LEADER]: Becoming Leader. State: Replica: a8a5527bfa9742a9967a4037f2d940ab, State: Running, Role: LEADER
I20260808 11:36:30.652566 15928 consensus_queue.cc:237] T 00000000000000000000000000000000 P a8a5527bfa9742a9967a4037f2d940ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8a5527bfa9742a9967a4037f2d940ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33917 } }
I20260808 11:36:30.656050 15931 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8a5527bfa9742a9967a4037f2d940ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a8a5527bfa9742a9967a4037f2d940ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8a5527bfa9742a9967a4037f2d940ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33917 } } }
I20260808 11:36:30.656598 15931 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8a5527bfa9742a9967a4037f2d940ab [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:30.657407 15932 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8a5527bfa9742a9967a4037f2d940ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8a5527bfa9742a9967a4037f2d940ab. Latest consensus state: current_term: 1 leader_uuid: "a8a5527bfa9742a9967a4037f2d940ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8a5527bfa9742a9967a4037f2d940ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33917 } } }
I20260808 11:36:30.658192 15932 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8a5527bfa9742a9967a4037f2d940ab [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:30.663470 15941 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:36:30.666597 15924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:30.646734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36673 (local address 127.0.0.1:33917)
0808 11:36:30.646894 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:30.646898 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:30.647621 (+ 723us) server_negotiation.cc:407] Connection header received
0808 11:36:30.647819 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:30.647825 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:30.647949 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:30.648061 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:30.649759 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:30.650659 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:30.652132 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:30.652954 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:30.653090 (+ 136us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:30.656093 (+ 3003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:30.656099 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:30.656104 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:30.656139 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:30.663006 (+ 6867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:30.663792 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:30.663797 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:30.663801 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:30.664007 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:30.664722 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:30.664729 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:30.664735 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:30.665274 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:30.665583 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:30.665960 (+ 377us) server_negotiation.cc:299] Negotiation successful
0808 11:36:30.666141 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 11:36:30.671516 15941 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:36:30.681206 15941 catalog_manager.cc:1347] Generated new cluster ID: 2341a450be8849fa9f29f4e32ffc277f
I20260808 11:36:30.681339 15941 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:36:30.705900 15941 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:36:30.707224 15941 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:36:30.717077 15941 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a8a5527bfa9742a9967a4037f2d940ab: Generated new TSK 0
I20260808 11:36:30.717988 15941 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:36:30.735146 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 15850
I20260808 11:36:30.736444 15915 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:30.830758 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 15850
W20260808 11:36:30.853099 15833 connection.cc:535] client connection to 127.0.0.1:33917 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33917): Connection reset by peer (error 104)
2026-08-08T11:36:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2203 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:36:30 dist-test-slave-zkpd krb5kdc[15955](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:36:30 dist-test-slave-zkpd krb5kdc[15955](info): set up 2 sockets
Aug 08 11:36:30 dist-test-slave-zkpd krb5kdc[15955](info): commencing operation
krb5kdc: starting...
W20260808 11:36:32.030696 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.157s user 0.004s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:36:32 dist-test-slave-zkpd krb5kdc[15955](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188992, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:36:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:36:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 11:36:32.388136 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40401
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40401
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:36:32.736851 15968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:32.737195 15968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:32.737360 15968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:32.744627 15968 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:36:32.744786 15968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:32.744900 15968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:32.745010 15968 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:36:32.745087 15968 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:36:32.754840 15968 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40401
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40401
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:32.756115 15968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:32.757450 15968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:32.769331 15975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:32.769371 15977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:32.769419 15973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:32.770462 15968 server_base.cc:1034] running on GCE node
I20260808 11:36:32.771258 15968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:32.772640 15968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:32.773864 15968 hybrid_clock.cc:648] HybridClock initialized: now 1786188992773821 us; error 29 us; skew 500 ppm
I20260808 11:36:32.774194 15968 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:36:32 dist-test-slave-zkpd krb5kdc[15955](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188992, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:36:32.777350 15968 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 11:36:32.778708 15968 webserver.cc:460] Webserver started at http://127.0.0.1:44195/ using document root <none> and password file <none>
I20260808 11:36:32.779323 15968 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:32.779423 15968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:32.779671 15968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:32.782680 15968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "9a547e9db94046a0a7a485d4b29fd630"
format_stamp: "Formatted at 2026-08-08 11:36:32 on dist-test-slave-zkpd"
server_key: "60ba78cfee1a53a327256f219ff4d2bb"
server_key_iv: "b8f8d6c3727639b1579f10971fa51503"
server_key_version: "encryptionkey@0"
I20260808 11:36:32.783420 15968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "9a547e9db94046a0a7a485d4b29fd630"
format_stamp: "Formatted at 2026-08-08 11:36:32 on dist-test-slave-zkpd"
server_key: "60ba78cfee1a53a327256f219ff4d2bb"
server_key_iv: "b8f8d6c3727639b1579f10971fa51503"
server_key_version: "encryptionkey@0"
I20260808 11:36:32.788627 15968 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 11:36:32.791975 15987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:32.793256 15968 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 11:36:32.793426 15968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "9a547e9db94046a0a7a485d4b29fd630"
format_stamp: "Formatted at 2026-08-08 11:36:32 on dist-test-slave-zkpd"
server_key: "60ba78cfee1a53a327256f219ff4d2bb"
server_key_iv: "b8f8d6c3727639b1579f10971fa51503"
server_key_version: "encryptionkey@0"
I20260808 11:36:32.793637 15968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:32.819026 15968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:32.823544 15968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:32.823820 15968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:32.842545 15968 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40401
I20260808 11:36:32.842581 16042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40401 every 8 connection(s)
I20260808 11:36:32.843873 15968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:36:32.847695 16043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:32.852088 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 15968
I20260808 11:36:32.852283 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:36:32.852730 26890 external_mini_cluster.cc:1428] Setting key 4a9052e5c43079890d0f450bb5def891
I20260808 11:36:32.859002 16043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a547e9db94046a0a7a485d4b29fd630: Bootstrap starting.
I20260808 11:36:32.862722 16043 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9a547e9db94046a0a7a485d4b29fd630: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:32.864156 16043 log.cc:824] T 00000000000000000000000000000000 P 9a547e9db94046a0a7a485d4b29fd630: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:32.867584 16043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a547e9db94046a0a7a485d4b29fd630: No bootstrap required, opened a new log
I20260808 11:36:32.867605 16046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:32.854569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54873 (local address 127.0.0.1:40401)
0808 11:36:32.855359 (+ 790us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:32.855382 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:32.855424 (+ 42us) server_negotiation.cc:407] Connection header received
0808 11:36:32.857428 (+ 2004us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:32.857450 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:32.857885 (+ 435us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:32.858185 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:32.858862 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:32.860369 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:32.862290 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:32.863052 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:32.863185 (+ 133us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:32.864599 (+ 1414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:32.864608 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:32.864623 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:32.865489 (+ 866us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:32.865616 (+ 127us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:32.865658 (+ 42us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:32.865872 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:32.866317 (+ 445us) server_negotiation.cc:299] Negotiation successful
0808 11:36:32.866526 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":367,"threads_started":1}
I20260808 11:36:32.872140 26890 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 11:36:32.876477 16043 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9a547e9db94046a0a7a485d4b29fd630 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a547e9db94046a0a7a485d4b29fd630" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40401 } }
I20260808 11:36:32.877044 16043 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9a547e9db94046a0a7a485d4b29fd630 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:32.877254 16043 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9a547e9db94046a0a7a485d4b29fd630 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a547e9db94046a0a7a485d4b29fd630, State: Initialized, Role: FOLLOWER
I20260808 11:36:32.877975 16043 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a547e9db94046a0a7a485d4b29fd630 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a547e9db94046a0a7a485d4b29fd630" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40401 } }
I20260808 11:36:32.878259 16043 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9a547e9db94046a0a7a485d4b29fd630 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:36:32.878422 16043 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9a547e9db94046a0a7a485d4b29fd630 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:36:32.878610 16043 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9a547e9db94046a0a7a485d4b29fd630 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:32.881145 16043 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9a547e9db94046a0a7a485d4b29fd630 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a547e9db94046a0a7a485d4b29fd630" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40401 } }
I20260808 11:36:32.881688 16043 leader_election.cc:302] T 00000000000000000000000000000000 P 9a547e9db94046a0a7a485d4b29fd630 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9a547e9db94046a0a7a485d4b29fd630; no voters:
I20260808 11:36:32.882424 16043 leader_election.cc:288] T 00000000000000000000000000000000 P 9a547e9db94046a0a7a485d4b29fd630 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:36:32.882556 16053 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9a547e9db94046a0a7a485d4b29fd630 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:36:32.884150 16046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:32.877034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55845 (local address 127.0.0.1:40401)
0808 11:36:32.877250 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:32.877258 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:32.877686 (+ 428us) server_negotiation.cc:407] Connection header received
0808 11:36:32.877927 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:32.877931 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:32.877999 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:32.878112 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:32.878773 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:32.879557 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:32.880989 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:32.881534 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:32.881686 (+ 152us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:32.883081 (+ 1395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:32.883089 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:32.883099 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:32.883125 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:32.883208 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:32.883241 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:32.883326 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:32.883670 (+ 344us) server_negotiation.cc:299] Negotiation successful
0808 11:36:32.883738 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 11:36:32.885294 16043 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9a547e9db94046a0a7a485d4b29fd630 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:36:32.888240 16053 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9a547e9db94046a0a7a485d4b29fd630 [term 1 LEADER]: Becoming Leader. State: Replica: 9a547e9db94046a0a7a485d4b29fd630, State: Running, Role: LEADER
I20260808 11:36:32.888876 16053 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9a547e9db94046a0a7a485d4b29fd630 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a547e9db94046a0a7a485d4b29fd630" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40401 } }
I20260808 11:36:32.892081 16054 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a547e9db94046a0a7a485d4b29fd630 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9a547e9db94046a0a7a485d4b29fd630" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a547e9db94046a0a7a485d4b29fd630" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40401 } } }
I20260808 11:36:32.892478 16054 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a547e9db94046a0a7a485d4b29fd630 [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:32.892910 16055 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a547e9db94046a0a7a485d4b29fd630 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a547e9db94046a0a7a485d4b29fd630. Latest consensus state: current_term: 1 leader_uuid: "9a547e9db94046a0a7a485d4b29fd630" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a547e9db94046a0a7a485d4b29fd630" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40401 } } }
I20260808 11:36:32.893301 16055 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a547e9db94046a0a7a485d4b29fd630 [sys.catalog]: This master's current role is: LEADER
W20260808 11:36:32.898057 16070 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9a547e9db94046a0a7a485d4b29fd630: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 11:36:32.898200 16070 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 11:36:32.898494 16071 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:36:32.900779 16071 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:36:32.909078 16071 catalog_manager.cc:1347] Generated new cluster ID: 39a8c6b2233b4823952f4e7bb81c9b94
I20260808 11:36:32.909190 16071 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:36:32.926278 16071 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:36:32.927565 16071 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:36:32.940893 16071 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9a547e9db94046a0a7a485d4b29fd630: Generated new TSK 0
I20260808 11:36:32.941713 16071 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:36:32.948120 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 15968
W20260808 11:36:32.949334 16038 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:54873
W20260808 11:36:32.950168 26890 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 15968: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 11:36:32.950383 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 15968
W20260808 11:36:32.972110 15953 connection.cc:535] client connection to 127.0.0.1:40401 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40401): Connection reset by peer (error 104)
2026-08-08T11:36:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2118 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:36:33 dist-test-slave-zkpd krb5kdc[16077](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:36:33 dist-test-slave-zkpd krb5kdc[16077](info): set up 2 sockets
Aug 08 11:36:33 dist-test-slave-zkpd krb5kdc[16077](info): commencing operation
krb5kdc: starting...
W20260808 11:36:34.119028 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.004s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:36:34 dist-test-slave-zkpd krb5kdc[16077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188994, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:36:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:36:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 11:36:34.467268 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42363
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42363
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:36:34.818845 16092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:34.819176 16092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:34.819346 16092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:34.826579 16092 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:36:34.826745 16092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:34.826850 16092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:34.826957 16092 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:36:34.827034 16092 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:36:34.836647 16092 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42363
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42363
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:34.837896 16092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:34.839213 16092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:34.851048 16097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:34.850992 16098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:34.851089 16100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:34.852192 16092 server_base.cc:1034] running on GCE node
I20260808 11:36:34.852908 16092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:34.854199 16092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:34.855407 16092 hybrid_clock.cc:648] HybridClock initialized: now 1786188994855371 us; error 23 us; skew 500 ppm
I20260808 11:36:34.855715 16092 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:36:34 dist-test-slave-zkpd krb5kdc[16077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188994, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:36:34.858878 16092 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 11:36:34.860289 16092 webserver.cc:460] Webserver started at http://127.0.0.1:41191/ using document root <none> and password file <none>
I20260808 11:36:34.860903 16092 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:34.861004 16092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:34.861244 16092 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:34.864135 16092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "370510d7866542d390185139c3389f2c"
format_stamp: "Formatted at 2026-08-08 11:36:34 on dist-test-slave-zkpd"
server_key: "609d5a542482aa6315fb03c854a10584"
server_key_iv: "f2d9b908ff1ea5c0f95fe9bdabc8f77d"
server_key_version: "encryptionkey@0"
I20260808 11:36:34.864873 16092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "370510d7866542d390185139c3389f2c"
format_stamp: "Formatted at 2026-08-08 11:36:34 on dist-test-slave-zkpd"
server_key: "609d5a542482aa6315fb03c854a10584"
server_key_iv: "f2d9b908ff1ea5c0f95fe9bdabc8f77d"
server_key_version: "encryptionkey@0"
I20260808 11:36:34.869841 16092 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 11:36:34.873180 16107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:34.874480 16092 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:36:34.874629 16092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "370510d7866542d390185139c3389f2c"
format_stamp: "Formatted at 2026-08-08 11:36:34 on dist-test-slave-zkpd"
server_key: "609d5a542482aa6315fb03c854a10584"
server_key_iv: "f2d9b908ff1ea5c0f95fe9bdabc8f77d"
server_key_version: "encryptionkey@0"
I20260808 11:36:34.874795 16092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:34.880421 16092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:34.884796 16092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:34.885051 16092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:34.904175 16092 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42363
I20260808 11:36:34.904228 16165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42363 every 8 connection(s)
I20260808 11:36:34.905637 16092 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:36:34.909409 16166 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:34.909927 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 16092
I20260808 11:36:34.910127 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:36:34.910732 26890 external_mini_cluster.cc:1428] Setting key 4ab7707e0ea880493fd129e27e8b2fae
I20260808 11:36:34.919212 16169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:34.912578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56643 (local address 127.0.0.1:42363)
0808 11:36:34.913463 (+ 885us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:34.913477 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:34.913519 (+ 42us) server_negotiation.cc:407] Connection header received
0808 11:36:34.915691 (+ 2172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:34.915713 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:34.916127 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:34.916468 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:34.917601 (+ 1133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:34.917607 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:34.917619 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:34.917631 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:34.917679 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:34.917697 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:34.917933 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:34.918088 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 11:36:34.918287 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":648,"thread_start_us":400,"threads_started":1}
I20260808 11:36:34.923075 26890 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 11:36:34.923645 16166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 370510d7866542d390185139c3389f2c: Bootstrap starting.
I20260808 11:36:34.926702 16166 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 370510d7866542d390185139c3389f2c: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:34.927913 16166 log.cc:824] T 00000000000000000000000000000000 P 370510d7866542d390185139c3389f2c: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:34.930153 16169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:34.927726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37441 (local address 127.0.0.1:42363)
0808 11:36:34.927954 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:34.927960 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:34.928250 (+ 290us) server_negotiation.cc:407] Connection header received
0808 11:36:34.928437 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:34.928440 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:34.928485 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:34.928599 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:34.929543 (+ 944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:34.929548 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:34.929552 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:34.929575 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:34.929613 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:34.929626 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:34.929743 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:34.929840 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 11:36:34.929900 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 11:36:34.930896 16166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 370510d7866542d390185139c3389f2c: No bootstrap required, opened a new log
I20260808 11:36:34.938531 16166 raft_consensus.cc:348] T 00000000000000000000000000000000 P 370510d7866542d390185139c3389f2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "370510d7866542d390185139c3389f2c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42363 } }
I20260808 11:36:34.938930 16166 raft_consensus.cc:374] T 00000000000000000000000000000000 P 370510d7866542d390185139c3389f2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:34.939035 16166 raft_consensus.cc:729] T 00000000000000000000000000000000 P 370510d7866542d390185139c3389f2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 370510d7866542d390185139c3389f2c, State: Initialized, Role: FOLLOWER
I20260808 11:36:34.939625 16166 consensus_queue.cc:260] T 00000000000000000000000000000000 P 370510d7866542d390185139c3389f2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "370510d7866542d390185139c3389f2c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42363 } }
I20260808 11:36:34.939867 16166 raft_consensus.cc:388] T 00000000000000000000000000000000 P 370510d7866542d390185139c3389f2c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:36:34.940044 16166 raft_consensus.cc:482] T 00000000000000000000000000000000 P 370510d7866542d390185139c3389f2c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:36:34.940250 16166 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 370510d7866542d390185139c3389f2c [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:34.942554 16166 raft_consensus.cc:504] T 00000000000000000000000000000000 P 370510d7866542d390185139c3389f2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "370510d7866542d390185139c3389f2c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42363 } }
I20260808 11:36:34.943038 16166 leader_election.cc:302] T 00000000000000000000000000000000 P 370510d7866542d390185139c3389f2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 370510d7866542d390185139c3389f2c; no voters:
I20260808 11:36:34.943645 16166 leader_election.cc:288] T 00000000000000000000000000000000 P 370510d7866542d390185139c3389f2c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:36:34.943786 16177 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 370510d7866542d390185139c3389f2c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:36:34.944528 16177 raft_consensus.cc:686] T 00000000000000000000000000000000 P 370510d7866542d390185139c3389f2c [term 1 LEADER]: Becoming Leader. State: Replica: 370510d7866542d390185139c3389f2c, State: Running, Role: LEADER
I20260808 11:36:34.945029 16177 consensus_queue.cc:237] T 00000000000000000000000000000000 P 370510d7866542d390185139c3389f2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "370510d7866542d390185139c3389f2c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42363 } }
I20260808 11:36:34.945940 16166 sys_catalog.cc:564] T 00000000000000000000000000000000 P 370510d7866542d390185139c3389f2c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:36:34.948099 16179 sys_catalog.cc:455] T 00000000000000000000000000000000 P 370510d7866542d390185139c3389f2c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 370510d7866542d390185139c3389f2c. Latest consensus state: current_term: 1 leader_uuid: "370510d7866542d390185139c3389f2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "370510d7866542d390185139c3389f2c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42363 } } }
I20260808 11:36:34.948537 16179 sys_catalog.cc:458] T 00000000000000000000000000000000 P 370510d7866542d390185139c3389f2c [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:34.948426 16178 sys_catalog.cc:455] T 00000000000000000000000000000000 P 370510d7866542d390185139c3389f2c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "370510d7866542d390185139c3389f2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "370510d7866542d390185139c3389f2c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42363 } } }
I20260808 11:36:34.948683 16178 sys_catalog.cc:458] T 00000000000000000000000000000000 P 370510d7866542d390185139c3389f2c [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:34.950505 16185 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:36:34.955412 16185 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:36:34.963506 16185 catalog_manager.cc:1347] Generated new cluster ID: bc0a07efd61a4b73b65dd6651418f58e
I20260808 11:36:34.963624 16185 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:36:34.981482 16185 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:36:34.981877 16185 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:36:34.992614 16185 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 370510d7866542d390185139c3389f2c: Generated new TSK 0
I20260808 11:36:34.993405 16185 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:36:34.997946 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 16092
W20260808 11:36:34.999193 16161 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:56643
W20260808 11:36:34.999917 26890 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 16092: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 11:36:35.000074 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 16092
2026-08-08T11:36:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2047 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:36:35 dist-test-slave-zkpd krb5kdc[16198](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:36:35 dist-test-slave-zkpd krb5kdc[16198](info): set up 2 sockets
Aug 08 11:36:35 dist-test-slave-zkpd krb5kdc[16198](info): commencing operation
krb5kdc: starting...
W20260808 11:36:36.174237 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.136s user 0.003s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:36:36 dist-test-slave-zkpd krb5kdc[16198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188996, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:36:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:36:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 11:36:36.520977 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40701
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40701
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:36:36.867564 16213 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:36.867848 16213 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:36.868007 16213 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:36.875257 16213 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:36:36.875360 16213 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:36.875407 16213 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:36.875468 16213 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:36:36.875514 16213 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:36:36.885249 16213 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40701
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:36.886448 16213 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:36.887717 16213 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:36.899729 16219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:36.899657 16222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:36.899685 16220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:36.900600 16213 server_base.cc:1034] running on GCE node
I20260808 11:36:36.901366 16213 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:36.902691 16213 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:36.903949 16213 hybrid_clock.cc:648] HybridClock initialized: now 1786188996903856 us; error 33 us; skew 500 ppm
I20260808 11:36:36.904302 16213 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:36:36 dist-test-slave-zkpd krb5kdc[16198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188996, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:36:36.907349 16213 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 11:36:36.908870 16213 webserver.cc:460] Webserver started at http://127.0.0.1:38405/ using document root <none> and password file <none>
I20260808 11:36:36.909564 16213 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:36.909698 16213 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:36.910010 16213 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:36.913064 16213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "2e224492a7c34564a1f3b091189c75fa"
format_stamp: "Formatted at 2026-08-08 11:36:36 on dist-test-slave-zkpd"
server_key: "d540d164ab2ad738233d954d01f4052b"
server_key_iv: "62e316cdc932d88d3758a73526e04466"
server_key_version: "encryptionkey@0"
I20260808 11:36:36.913867 16213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "2e224492a7c34564a1f3b091189c75fa"
format_stamp: "Formatted at 2026-08-08 11:36:36 on dist-test-slave-zkpd"
server_key: "d540d164ab2ad738233d954d01f4052b"
server_key_iv: "62e316cdc932d88d3758a73526e04466"
server_key_version: "encryptionkey@0"
I20260808 11:36:36.918908 16213 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 11:36:36.922433 16229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:36.923746 16213 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 11:36:36.923977 16213 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "2e224492a7c34564a1f3b091189c75fa"
format_stamp: "Formatted at 2026-08-08 11:36:36 on dist-test-slave-zkpd"
server_key: "d540d164ab2ad738233d954d01f4052b"
server_key_iv: "62e316cdc932d88d3758a73526e04466"
server_key_version: "encryptionkey@0"
I20260808 11:36:36.924175 16213 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:36.941133 16213 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:36.945006 16213 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:36.945318 16213 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:36.964296 16213 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40701
I20260808 11:36:36.964334 16286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40701 every 8 connection(s)
I20260808 11:36:36.965672 16213 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:36:36.969483 16287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:36.972410 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 16213
I20260808 11:36:36.972609 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:36:36.973080 26890 external_mini_cluster.cc:1428] Setting key ff6afb4e8100fd120917bf672bde2f01
I20260808 11:36:36.982635 16287 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e224492a7c34564a1f3b091189c75fa: Bootstrap starting.
I20260808 11:36:36.986203 16287 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e224492a7c34564a1f3b091189c75fa: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:36.987186 16287 log.cc:824] T 00000000000000000000000000000000 P 2e224492a7c34564a1f3b091189c75fa: Log is configured to *not* fsync() on all Append() calls
Aug 08 11:36:36 dist-test-slave-zkpd krb5kdc[16198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188996, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 11:36:36.990458 16287 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e224492a7c34564a1f3b091189c75fa: No bootstrap required, opened a new log
I20260808 11:36:36.997584 16290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:36.975028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38661 (local address 127.0.0.1:40701)
0808 11:36:36.975940 (+ 912us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:36.975956 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:36.976008 (+ 52us) server_negotiation.cc:407] Connection header received
0808 11:36:36.978390 (+ 2382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:36.978420 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:36.978980 (+ 560us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:36.979418 (+ 438us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:36.980832 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:36.982802 (+ 1970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:36.984140 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:36.985213 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:36.985420 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:36.990043 (+ 4623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:36.990051 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:36.990063 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:36.990102 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:36.993291 (+ 3189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:36.994150 (+ 859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:36.994155 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:36.994161 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:36.994318 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:36.994763 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:36.994766 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:36.994768 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:36.995294 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:36.995528 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:36.996186 (+ 658us) server_negotiation.cc:299] Negotiation successful
0808 11:36:36.996589 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":636,"thread_start_us":419,"threads_started":1}
I20260808 11:36:36.999365 16287 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e224492a7c34564a1f3b091189c75fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e224492a7c34564a1f3b091189c75fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40701 } }
I20260808 11:36:36.999758 16287 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2e224492a7c34564a1f3b091189c75fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:36.999944 16287 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e224492a7c34564a1f3b091189c75fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e224492a7c34564a1f3b091189c75fa, State: Initialized, Role: FOLLOWER
I20260808 11:36:37.000560 16287 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e224492a7c34564a1f3b091189c75fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e224492a7c34564a1f3b091189c75fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40701 } }
I20260808 11:36:37.000810 16287 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2e224492a7c34564a1f3b091189c75fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:36:37.000972 16287 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e224492a7c34564a1f3b091189c75fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:36:37.001160 16287 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e224492a7c34564a1f3b091189c75fa [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:37.001343 26890 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 11:36:37.003387 16287 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e224492a7c34564a1f3b091189c75fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e224492a7c34564a1f3b091189c75fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40701 } }
I20260808 11:36:37.003980 16287 leader_election.cc:302] T 00000000000000000000000000000000 P 2e224492a7c34564a1f3b091189c75fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e224492a7c34564a1f3b091189c75fa; no voters:
I20260808 11:36:37.004673 16287 leader_election.cc:288] T 00000000000000000000000000000000 P 2e224492a7c34564a1f3b091189c75fa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:36:37.004786 16295 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e224492a7c34564a1f3b091189c75fa [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:36:37.007236 16287 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e224492a7c34564a1f3b091189c75fa [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:36:37.011377 16295 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e224492a7c34564a1f3b091189c75fa [term 1 LEADER]: Becoming Leader. State: Replica: 2e224492a7c34564a1f3b091189c75fa, State: Running, Role: LEADER
I20260808 11:36:37.012212 16295 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e224492a7c34564a1f3b091189c75fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e224492a7c34564a1f3b091189c75fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40701 } }
I20260808 11:36:37.015920 16297 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e224492a7c34564a1f3b091189c75fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e224492a7c34564a1f3b091189c75fa. Latest consensus state: current_term: 1 leader_uuid: "2e224492a7c34564a1f3b091189c75fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e224492a7c34564a1f3b091189c75fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40701 } } }
I20260808 11:36:37.016415 16297 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e224492a7c34564a1f3b091189c75fa [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:37.016932 16298 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e224492a7c34564a1f3b091189c75fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2e224492a7c34564a1f3b091189c75fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e224492a7c34564a1f3b091189c75fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40701 } } }
I20260808 11:36:37.017222 16298 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e224492a7c34564a1f3b091189c75fa [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:37.025797 16306 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:36:37.026268 16290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:37.006246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33367 (local address 127.0.0.1:40701)
0808 11:36:37.006459 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:37.006467 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:37.008458 (+ 1991us) server_negotiation.cc:407] Connection header received
0808 11:36:37.008654 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:37.008659 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:37.008755 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:37.008866 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:37.010680 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:37.011416 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:37.012963 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:37.013514 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:37.013650 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:37.017510 (+ 3860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:37.017517 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:37.017522 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:37.017561 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:37.022376 (+ 4815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:37.023549 (+ 1173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:37.023557 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:37.023563 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:37.023741 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:37.024324 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:37.024329 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:37.024333 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:37.024757 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:37.024984 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:37.025537 (+ 553us) server_negotiation.cc:299] Negotiation successful
0808 11:36:37.025782 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 11:36:37.033124 16306 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:36:37.042342 16306 catalog_manager.cc:1347] Generated new cluster ID: 72d1dc5955fb46b4ae18bb3465df520f
I20260808 11:36:37.042466 16306 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:36:37.075054 16306 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:36:37.076505 16306 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:36:37.092378 16306 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2e224492a7c34564a1f3b091189c75fa: Generated new TSK 0
I20260808 11:36:37.093374 16306 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:36:37.099458 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 16213
I20260808 11:36:37.100544 16282 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:37.194793 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 16213
2026-08-08T11:36:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2197 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:36:37 dist-test-slave-zkpd krb5kdc[16320](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:36:37 dist-test-slave-zkpd krb5kdc[16320](info): set up 2 sockets
Aug 08 11:36:37 dist-test-slave-zkpd krb5kdc[16320](info): commencing operation
krb5kdc: starting...
W20260808 11:36:38.358228 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.005s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:36:38 dist-test-slave-zkpd krb5kdc[16320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188998, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:36:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:36:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 11:36:38.696214 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46141
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46141
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:36:39.040292 16336 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:39.040629 16336 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:39.040800 16336 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:39.048091 16336 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:36:39.048257 16336 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:39.048372 16336 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:39.048492 16336 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:36:39.048580 16336 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:36:39.058319 16336 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46141
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46141
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:39.059574 16336 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:39.060916 16336 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:39.072525 16341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:39.072556 16344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:39.073052 16342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:39.073809 16336 server_base.cc:1034] running on GCE node
I20260808 11:36:39.074601 16336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:39.076012 16336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:39.077246 16336 hybrid_clock.cc:648] HybridClock initialized: now 1786188999077196 us; error 37 us; skew 500 ppm
I20260808 11:36:39.077608 16336 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:36:39 dist-test-slave-zkpd krb5kdc[16320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786188999, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:36:39.080966 16336 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 11:36:39.082475 16336 webserver.cc:460] Webserver started at http://127.0.0.1:41675/ using document root <none> and password file <none>
I20260808 11:36:39.083153 16336 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:39.083300 16336 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:39.083608 16336 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:39.086660 16336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "6a49e18d83cb45e8ad57474239c3ae1f"
format_stamp: "Formatted at 2026-08-08 11:36:39 on dist-test-slave-zkpd"
server_key: "2434aa9a6098ffd61c7be08463d9fd27"
server_key_iv: "e3addffa8e32b9d8106891c470af94a8"
server_key_version: "encryptionkey@0"
I20260808 11:36:39.087459 16336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "6a49e18d83cb45e8ad57474239c3ae1f"
format_stamp: "Formatted at 2026-08-08 11:36:39 on dist-test-slave-zkpd"
server_key: "2434aa9a6098ffd61c7be08463d9fd27"
server_key_iv: "e3addffa8e32b9d8106891c470af94a8"
server_key_version: "encryptionkey@0"
I20260808 11:36:39.092662 16336 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 11:36:39.096102 16352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:39.097389 16336 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 11:36:39.097570 16336 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "6a49e18d83cb45e8ad57474239c3ae1f"
format_stamp: "Formatted at 2026-08-08 11:36:39 on dist-test-slave-zkpd"
server_key: "2434aa9a6098ffd61c7be08463d9fd27"
server_key_iv: "e3addffa8e32b9d8106891c470af94a8"
server_key_version: "encryptionkey@0"
I20260808 11:36:39.097765 16336 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:39.129123 16336 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:39.134967 16336 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:39.135253 16336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:39.154258 16336 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46141
I20260808 11:36:39.154309 16406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46141 every 8 connection(s)
I20260808 11:36:39.155623 16336 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:36:39.159386 16407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:39.160588 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 16336
I20260808 11:36:39.160796 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:36:39.161243 26890 external_mini_cluster.cc:1428] Setting key 0e1e80b04ab2d5fc3651caae49f3d70d
I20260808 11:36:39.174365 16407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a49e18d83cb45e8ad57474239c3ae1f: Bootstrap starting.
I20260808 11:36:39.176332 16410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:39.163162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36485 (local address 127.0.0.1:46141)
0808 11:36:39.163990 (+ 828us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:39.164006 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:39.164056 (+ 50us) server_negotiation.cc:407] Connection header received
0808 11:36:39.166071 (+ 2015us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:39.166099 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:39.166611 (+ 512us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:39.167080 (+ 469us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:39.167567 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:39.169483 (+ 1916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:39.171012 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:39.172158 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:39.172337 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:39.173461 (+ 1124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:39.173472 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:39.173489 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:39.174212 (+ 723us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:39.174315 (+ 103us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:39.174352 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:39.174465 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:39.174732 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 11:36:39.175008 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":558,"thread_start_us":325,"threads_started":1}
I20260808 11:36:39.178287 16407 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a49e18d83cb45e8ad57474239c3ae1f: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:39.179617 16407 log.cc:824] T 00000000000000000000000000000000 P 6a49e18d83cb45e8ad57474239c3ae1f: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:39.180158 26890 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 11:36:39.182436 16407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a49e18d83cb45e8ad57474239c3ae1f: No bootstrap required, opened a new log
I20260808 11:36:39.191511 16410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:39.184765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48153 (local address 127.0.0.1:46141)
0808 11:36:39.184979 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:39.184987 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:39.185500 (+ 513us) server_negotiation.cc:407] Connection header received
0808 11:36:39.185669 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:39.185673 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:39.185733 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:39.185811 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:39.186426 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:39.187111 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:39.189017 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:39.189479 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:39.189570 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:39.190790 (+ 1220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:39.190794 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:39.190797 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:39.190815 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:39.190853 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:39.190868 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:39.190940 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:39.191109 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 11:36:39.191187 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 11:36:39.192473 16407 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a49e18d83cb45e8ad57474239c3ae1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a49e18d83cb45e8ad57474239c3ae1f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46141 } }
I20260808 11:36:39.192932 16407 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6a49e18d83cb45e8ad57474239c3ae1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:39.193040 16407 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a49e18d83cb45e8ad57474239c3ae1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a49e18d83cb45e8ad57474239c3ae1f, State: Initialized, Role: FOLLOWER
I20260808 11:36:39.193611 16407 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a49e18d83cb45e8ad57474239c3ae1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a49e18d83cb45e8ad57474239c3ae1f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46141 } }
I20260808 11:36:39.193852 16407 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a49e18d83cb45e8ad57474239c3ae1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:36:39.193956 16407 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a49e18d83cb45e8ad57474239c3ae1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:36:39.194072 16407 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a49e18d83cb45e8ad57474239c3ae1f [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:39.196231 16407 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a49e18d83cb45e8ad57474239c3ae1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a49e18d83cb45e8ad57474239c3ae1f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46141 } }
I20260808 11:36:39.196661 16407 leader_election.cc:302] T 00000000000000000000000000000000 P 6a49e18d83cb45e8ad57474239c3ae1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a49e18d83cb45e8ad57474239c3ae1f; no voters:
I20260808 11:36:39.197182 16407 leader_election.cc:288] T 00000000000000000000000000000000 P 6a49e18d83cb45e8ad57474239c3ae1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:36:39.197320 16417 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a49e18d83cb45e8ad57474239c3ae1f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:36:39.198590 16417 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a49e18d83cb45e8ad57474239c3ae1f [term 1 LEADER]: Becoming Leader. State: Replica: 6a49e18d83cb45e8ad57474239c3ae1f, State: Running, Role: LEADER
I20260808 11:36:39.199093 16417 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a49e18d83cb45e8ad57474239c3ae1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a49e18d83cb45e8ad57474239c3ae1f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46141 } }
I20260808 11:36:39.199401 16407 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a49e18d83cb45e8ad57474239c3ae1f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:36:39.202430 16418 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a49e18d83cb45e8ad57474239c3ae1f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a49e18d83cb45e8ad57474239c3ae1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a49e18d83cb45e8ad57474239c3ae1f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46141 } } }
I20260808 11:36:39.202385 16419 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a49e18d83cb45e8ad57474239c3ae1f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a49e18d83cb45e8ad57474239c3ae1f. Latest consensus state: current_term: 1 leader_uuid: "6a49e18d83cb45e8ad57474239c3ae1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a49e18d83cb45e8ad57474239c3ae1f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46141 } } }
I20260808 11:36:39.202883 16418 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a49e18d83cb45e8ad57474239c3ae1f [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:39.202883 16419 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a49e18d83cb45e8ad57474239c3ae1f [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:39.203811 16427 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:36:39.208905 16427 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:36:39.218991 16427 catalog_manager.cc:1347] Generated new cluster ID: ae6d97a8e3a74039b17012f1f691befc
I20260808 11:36:39.219166 16427 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:36:39.234658 16427 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:36:39.236577 16427 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:36:39.246152 16427 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6a49e18d83cb45e8ad57474239c3ae1f: Generated new TSK 0
I20260808 11:36:39.247236 16427 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:36:39.253233 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 16336
W20260808 11:36:39.254969 16401 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:36485
W20260808 11:36:39.255684 26890 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 16336: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 11:36:39.255852 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 16336
2026-08-08T11:36:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2058 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:36:39 dist-test-slave-zkpd krb5kdc[16441](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:36:39 dist-test-slave-zkpd krb5kdc[16441](info): set up 2 sockets
Aug 08 11:36:39 dist-test-slave-zkpd krb5kdc[16441](info): commencing operation
krb5kdc: starting...
W20260808 11:36:40.438511 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.144s user 0.003s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:36:40 dist-test-slave-zkpd krb5kdc[16441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189000, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:36:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:36:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 11:36:40.788705 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40177
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40177
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:36:41.138447 16456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:41.138720 16456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:41.138908 16456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:41.147465 16456 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:36:41.147573 16456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:41.147689 16456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:41.147797 16456 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:36:41.147881 16456 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:36:41.157749 16456 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40177
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40177
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:41.159013 16456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:41.160411 16456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:41.172509 16461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:41.172545 16465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:41.172612 16462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:41.173453 16456 server_base.cc:1034] running on GCE node
I20260808 11:36:41.174208 16456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:41.175590 16456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:41.176812 16456 hybrid_clock.cc:648] HybridClock initialized: now 1786189001176776 us; error 98 us; skew 500 ppm
I20260808 11:36:41.177155 16456 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:36:41 dist-test-slave-zkpd krb5kdc[16441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189001, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:36:41.180361 16456 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 11:36:41.181929 16456 webserver.cc:460] Webserver started at http://127.0.0.1:43765/ using document root <none> and password file <none>
I20260808 11:36:41.182651 16456 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:41.182802 16456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:41.183125 16456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:41.186203 16456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "25e5849335254e2282b1980c7e1c4d88"
format_stamp: "Formatted at 2026-08-08 11:36:41 on dist-test-slave-zkpd"
server_key: "ad29a5d2a2a330195685288d8ea754cd"
server_key_iv: "0d01c83b3364a36f75fd2768b20b565a"
server_key_version: "encryptionkey@0"
I20260808 11:36:41.186990 16456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "25e5849335254e2282b1980c7e1c4d88"
format_stamp: "Formatted at 2026-08-08 11:36:41 on dist-test-slave-zkpd"
server_key: "ad29a5d2a2a330195685288d8ea754cd"
server_key_iv: "0d01c83b3364a36f75fd2768b20b565a"
server_key_version: "encryptionkey@0"
I20260808 11:36:41.192166 16456 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 11:36:41.195586 16473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:41.196985 16456 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:36:41.197170 16456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "25e5849335254e2282b1980c7e1c4d88"
format_stamp: "Formatted at 2026-08-08 11:36:41 on dist-test-slave-zkpd"
server_key: "ad29a5d2a2a330195685288d8ea754cd"
server_key_iv: "0d01c83b3364a36f75fd2768b20b565a"
server_key_version: "encryptionkey@0"
I20260808 11:36:41.197371 16456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:41.203190 16456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:41.207178 16456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:41.207486 16456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:41.226449 16456 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40177
I20260808 11:36:41.226496 16527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40177 every 8 connection(s)
I20260808 11:36:41.227823 16456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:36:41.231541 16528 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:41.233217 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 16456
I20260808 11:36:41.233415 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:36:41.233883 26890 external_mini_cluster.cc:1428] Setting key 87038ff888891a337caf02a7a48d7ee7
I20260808 11:36:41.241573 16531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:41.235596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47615 (local address 127.0.0.1:40177)
0808 11:36:41.236556 (+ 960us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:41.236567 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:41.236612 (+ 45us) server_negotiation.cc:407] Connection header received
0808 11:36:41.238160 (+ 1548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:41.238182 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:41.238519 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:41.238833 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:41.240041 (+ 1208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:41.240047 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:41.240059 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:41.240078 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:41.240139 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:41.240162 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:41.240340 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:41.240457 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 11:36:41.240654 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":739,"thread_start_us":521,"threads_started":1}
I20260808 11:36:41.244932 16528 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25e5849335254e2282b1980c7e1c4d88: Bootstrap starting.
I20260808 11:36:41.245311 26890 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 11:36:41.248842 16528 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25e5849335254e2282b1980c7e1c4d88: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:41.250255 16528 log.cc:824] T 00000000000000000000000000000000 P 25e5849335254e2282b1980c7e1c4d88: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:41.253068 16528 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25e5849335254e2282b1980c7e1c4d88: No bootstrap required, opened a new log
I20260808 11:36:41.253492 16531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:41.250743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40351 (local address 127.0.0.1:40177)
0808 11:36:41.250903 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:41.250907 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:41.251466 (+ 559us) server_negotiation.cc:407] Connection header received
0808 11:36:41.251659 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:41.251664 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:41.251723 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:41.251828 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:41.252811 (+ 983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:41.252817 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:41.252822 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:41.252839 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:41.252886 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:41.252901 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:41.253023 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:41.253158 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 11:36:41.253219 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 11:36:41.261511 16528 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25e5849335254e2282b1980c7e1c4d88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e5849335254e2282b1980c7e1c4d88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40177 } }
I20260808 11:36:41.261898 16528 raft_consensus.cc:374] T 00000000000000000000000000000000 P 25e5849335254e2282b1980c7e1c4d88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:41.262006 16528 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25e5849335254e2282b1980c7e1c4d88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25e5849335254e2282b1980c7e1c4d88, State: Initialized, Role: FOLLOWER
I20260808 11:36:41.262652 16528 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25e5849335254e2282b1980c7e1c4d88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e5849335254e2282b1980c7e1c4d88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40177 } }
I20260808 11:36:41.262931 16528 raft_consensus.cc:388] T 00000000000000000000000000000000 P 25e5849335254e2282b1980c7e1c4d88 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:36:41.263090 16528 raft_consensus.cc:482] T 00000000000000000000000000000000 P 25e5849335254e2282b1980c7e1c4d88 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:36:41.263285 16528 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25e5849335254e2282b1980c7e1c4d88 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:41.265502 16528 raft_consensus.cc:504] T 00000000000000000000000000000000 P 25e5849335254e2282b1980c7e1c4d88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e5849335254e2282b1980c7e1c4d88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40177 } }
I20260808 11:36:41.265981 16528 leader_election.cc:302] T 00000000000000000000000000000000 P 25e5849335254e2282b1980c7e1c4d88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25e5849335254e2282b1980c7e1c4d88; no voters:
I20260808 11:36:41.266582 16528 leader_election.cc:288] T 00000000000000000000000000000000 P 25e5849335254e2282b1980c7e1c4d88 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:36:41.266710 16538 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 25e5849335254e2282b1980c7e1c4d88 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:36:41.267437 16538 raft_consensus.cc:686] T 00000000000000000000000000000000 P 25e5849335254e2282b1980c7e1c4d88 [term 1 LEADER]: Becoming Leader. State: Replica: 25e5849335254e2282b1980c7e1c4d88, State: Running, Role: LEADER
I20260808 11:36:41.268054 16538 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25e5849335254e2282b1980c7e1c4d88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e5849335254e2282b1980c7e1c4d88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40177 } }
I20260808 11:36:41.268754 16528 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25e5849335254e2282b1980c7e1c4d88 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:36:41.272153 16539 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25e5849335254e2282b1980c7e1c4d88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25e5849335254e2282b1980c7e1c4d88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e5849335254e2282b1980c7e1c4d88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40177 } } }
I20260808 11:36:41.272091 16540 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25e5849335254e2282b1980c7e1c4d88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25e5849335254e2282b1980c7e1c4d88. Latest consensus state: current_term: 1 leader_uuid: "25e5849335254e2282b1980c7e1c4d88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e5849335254e2282b1980c7e1c4d88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40177 } } }
I20260808 11:36:41.273391 16540 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25e5849335254e2282b1980c7e1c4d88 [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:41.273391 16539 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25e5849335254e2282b1980c7e1c4d88 [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:41.280413 16549 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:36:41.285657 16549 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:36:41.294766 16549 catalog_manager.cc:1347] Generated new cluster ID: ebcbc8c3592d4b839f684bb88ce9411f
I20260808 11:36:41.294885 16549 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:36:41.321103 16549 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:36:41.321555 16549 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:36:41.332002 16549 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 25e5849335254e2282b1980c7e1c4d88: Generated new TSK 0
I20260808 11:36:41.333092 16549 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:36:41.346701 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 16456
W20260808 11:36:41.348781 16523 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:47615
W20260808 11:36:41.349567 26890 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 16456: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 11:36:41.349726 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 16456
2026-08-08T11:36:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2096 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:36:41 dist-test-slave-zkpd krb5kdc[16562](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:36:41 dist-test-slave-zkpd krb5kdc[16562](info): set up 2 sockets
Aug 08 11:36:41 dist-test-slave-zkpd krb5kdc[16562](info): commencing operation
krb5kdc: starting...
W20260808 11:36:42.522279 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.131s user 0.010s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:36:42 dist-test-slave-zkpd krb5kdc[16562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:36:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:36:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 11:36:42.861057 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42625
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42625
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:36:43.213553 16577 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:43.213861 16577 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:43.214039 16577 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:43.221098 16577 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:36:43.221200 16577 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:43.221323 16577 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:43.221451 16577 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:36:43.221516 16577 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:36:43.230957 16577 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42625
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42625
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:43.232221 16577 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:43.233543 16577 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:43.245836 16582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:43.245852 16583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:43.245867 16585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:43.246726 16577 server_base.cc:1034] running on GCE node
I20260808 11:36:43.247594 16577 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:43.249111 16577 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:43.250362 16577 hybrid_clock.cc:648] HybridClock initialized: now 1786189003250320 us; error 63 us; skew 500 ppm
I20260808 11:36:43.250726 16577 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:36:43 dist-test-slave-zkpd krb5kdc[16562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189003, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:36:43.258594 16577 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 11:36:43.260164 16577 webserver.cc:460] Webserver started at http://127.0.0.1:35125/ using document root <none> and password file <none>
I20260808 11:36:43.260797 16577 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:43.260921 16577 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:43.261178 16577 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:43.264292 16577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "0c51dba610d84c5796618ba2ac8fd86f"
format_stamp: "Formatted at 2026-08-08 11:36:43 on dist-test-slave-zkpd"
server_key: "2857603897c9bf473152d6ac978c300a"
server_key_iv: "49645283ebd47478c2aeeb8cd773080d"
server_key_version: "encryptionkey@0"
I20260808 11:36:43.265048 16577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "0c51dba610d84c5796618ba2ac8fd86f"
format_stamp: "Formatted at 2026-08-08 11:36:43 on dist-test-slave-zkpd"
server_key: "2857603897c9bf473152d6ac978c300a"
server_key_iv: "49645283ebd47478c2aeeb8cd773080d"
server_key_version: "encryptionkey@0"
I20260808 11:36:43.270263 16577 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260808 11:36:43.273874 16592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:43.275282 16577 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 11:36:43.275472 16577 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "0c51dba610d84c5796618ba2ac8fd86f"
format_stamp: "Formatted at 2026-08-08 11:36:43 on dist-test-slave-zkpd"
server_key: "2857603897c9bf473152d6ac978c300a"
server_key_iv: "49645283ebd47478c2aeeb8cd773080d"
server_key_version: "encryptionkey@0"
I20260808 11:36:43.275678 16577 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:43.291342 16577 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:43.295821 16577 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:43.296157 16577 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:43.315743 16577 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42625
I20260808 11:36:43.315829 16646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42625 every 8 connection(s)
I20260808 11:36:43.317152 16577 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:36:43.320991 16647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:43.326864 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 16577
I20260808 11:36:43.327054 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:36:43.327644 26890 external_mini_cluster.cc:1428] Setting key 027d4a12bde3956d1b78fc86bda61a20
I20260808 11:36:43.333046 16647 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c51dba610d84c5796618ba2ac8fd86f: Bootstrap starting.
I20260808 11:36:43.337097 16647 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c51dba610d84c5796618ba2ac8fd86f: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:43.338471 16647 log.cc:824] T 00000000000000000000000000000000 P 0c51dba610d84c5796618ba2ac8fd86f: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:43.342232 16647 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c51dba610d84c5796618ba2ac8fd86f: No bootstrap required, opened a new log
Aug 08 11:36:43 dist-test-slave-zkpd krb5kdc[16562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 11:36:43.354879 16650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:43.329668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.39:47453 (local address 127.0.0.1:42625)
0808 11:36:43.330505 (+ 837us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:43.330517 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:43.330560 (+ 43us) server_negotiation.cc:407] Connection header received
0808 11:36:43.332302 (+ 1742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:43.332335 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:43.332703 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:43.333032 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:43.335104 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:43.336473 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:43.338581 (+ 2108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:43.339615 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:43.339834 (+ 219us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:43.345016 (+ 5182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:43.345029 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:43.345055 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:43.345103 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:43.349662 (+ 4559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:43.350458 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:43.350473 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:43.350483 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:43.350753 (+ 270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:43.351209 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:43.351217 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:43.351224 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:43.352112 (+ 888us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:43.352532 (+ 420us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:43.352896 (+ 364us) server_negotiation.cc:299] Negotiation successful
0808 11:36:43.353294 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":390,"threads_started":1}
I20260808 11:36:43.354473 16647 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c51dba610d84c5796618ba2ac8fd86f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c51dba610d84c5796618ba2ac8fd86f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42625 } }
I20260808 11:36:43.355116 16647 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c51dba610d84c5796618ba2ac8fd86f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:43.355304 16647 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c51dba610d84c5796618ba2ac8fd86f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c51dba610d84c5796618ba2ac8fd86f, State: Initialized, Role: FOLLOWER
I20260808 11:36:43.356088 16647 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c51dba610d84c5796618ba2ac8fd86f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c51dba610d84c5796618ba2ac8fd86f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42625 } }
I20260808 11:36:43.356380 16647 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c51dba610d84c5796618ba2ac8fd86f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:36:43.356554 16647 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c51dba610d84c5796618ba2ac8fd86f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:36:43.356765 16647 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c51dba610d84c5796618ba2ac8fd86f [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:43.359191 26890 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 11:36:43.359808 16647 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c51dba610d84c5796618ba2ac8fd86f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c51dba610d84c5796618ba2ac8fd86f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42625 } }
I20260808 11:36:43.360463 16647 leader_election.cc:302] T 00000000000000000000000000000000 P 0c51dba610d84c5796618ba2ac8fd86f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c51dba610d84c5796618ba2ac8fd86f; no voters:
I20260808 11:36:43.361156 16647 leader_election.cc:288] T 00000000000000000000000000000000 P 0c51dba610d84c5796618ba2ac8fd86f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:36:43.361275 16652 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c51dba610d84c5796618ba2ac8fd86f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:36:43.362784 16652 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c51dba610d84c5796618ba2ac8fd86f [term 1 LEADER]: Becoming Leader. State: Replica: 0c51dba610d84c5796618ba2ac8fd86f, State: Running, Role: LEADER
I20260808 11:36:43.363384 16652 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c51dba610d84c5796618ba2ac8fd86f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c51dba610d84c5796618ba2ac8fd86f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42625 } }
I20260808 11:36:43.363826 16647 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c51dba610d84c5796618ba2ac8fd86f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:36:43.366168 16654 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c51dba610d84c5796618ba2ac8fd86f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c51dba610d84c5796618ba2ac8fd86f. Latest consensus state: current_term: 1 leader_uuid: "0c51dba610d84c5796618ba2ac8fd86f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c51dba610d84c5796618ba2ac8fd86f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42625 } } }
I20260808 11:36:43.366580 16654 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c51dba610d84c5796618ba2ac8fd86f [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:43.367182 16653 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c51dba610d84c5796618ba2ac8fd86f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c51dba610d84c5796618ba2ac8fd86f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c51dba610d84c5796618ba2ac8fd86f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42625 } } }
I20260808 11:36:43.367488 16653 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c51dba610d84c5796618ba2ac8fd86f [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:43.368871 16659 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:36:43.374022 16659 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:36:43.385015 16659 catalog_manager.cc:1347] Generated new cluster ID: 7a980ee314ae4cd2a5316adc7cc39bf0
I20260808 11:36:43.385169 16659 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:36:43.408720 16650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:43.382939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.39:53363 (local address 127.0.0.1:42625)
0808 11:36:43.383133 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:43.383140 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:43.390229 (+ 7089us) server_negotiation.cc:407] Connection header received
0808 11:36:43.390701 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:43.390708 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:43.390820 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:43.390900 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:43.393139 (+ 2239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:43.394414 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:43.396368 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:43.397088 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:43.397192 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:43.400802 (+ 3610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:43.400809 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:43.400815 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:43.400852 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:43.404590 (+ 3738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:43.405591 (+ 1001us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:43.405598 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:43.405601 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:43.405790 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:43.406535 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:43.406541 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:43.406544 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:43.406943 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:43.407197 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:43.408152 (+ 955us) server_negotiation.cc:299] Negotiation successful
0808 11:36:43.408379 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":67}
I20260808 11:36:43.412241 16659 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:36:43.414419 16659 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:36:43.424988 16659 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0c51dba610d84c5796618ba2ac8fd86f: Generated new TSK 0
I20260808 11:36:43.425902 16659 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:36:43.435551 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 16577
I20260808 11:36:43.436899 16641 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:43.532838 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 16577
W20260808 11:36:43.554486 16560 connection.cc:535] client connection to 127.0.0.1:42625 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42625): Connection reset by peer (error 104)
2026-08-08T11:36:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2182 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:36:43 dist-test-slave-zkpd krb5kdc[16679](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:36:43 dist-test-slave-zkpd krb5kdc[16679](info): set up 2 sockets
Aug 08 11:36:43 dist-test-slave-zkpd krb5kdc[16679](info): commencing operation
krb5kdc: starting...
W20260808 11:36:44.706372 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.003s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:36:44 dist-test-slave-zkpd krb5kdc[16679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:36:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:36:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 11:36:45.051020 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42549
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42549
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:36:45.397531 16692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:45.397814 16692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:45.397995 16692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:45.404872 16692 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:36:45.404989 16692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:45.405068 16692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:45.405164 16692 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:36:45.405226 16692 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:36:45.414588 16692 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42549
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42549
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:45.415764 16692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:45.417068 16692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:45.428580 16697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:45.428498 16700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:45.428613 16698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:45.429673 16692 server_base.cc:1034] running on GCE node
I20260808 11:36:45.430477 16692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:45.431805 16692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:45.433048 16692 hybrid_clock.cc:648] HybridClock initialized: now 1786189005432993 us; error 44 us; skew 500 ppm
I20260808 11:36:45.433413 16692 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:36:45 dist-test-slave-zkpd krb5kdc[16679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189005, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:36:45.436632 16692 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 11:36:45.438071 16692 webserver.cc:460] Webserver started at http://127.0.0.1:39415/ using document root <none> and password file <none>
I20260808 11:36:45.438771 16692 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:45.438921 16692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:45.439242 16692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:45.442514 16692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "8e1cf1a41dba49cc9c97318f5a4aa3d1"
format_stamp: "Formatted at 2026-08-08 11:36:45 on dist-test-slave-zkpd"
server_key: "772d0b0d7158503dd928a7447958403e"
server_key_iv: "ef53b65b4354f6b4cf9bd95e980919a0"
server_key_version: "encryptionkey@0"
I20260808 11:36:45.443320 16692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "8e1cf1a41dba49cc9c97318f5a4aa3d1"
format_stamp: "Formatted at 2026-08-08 11:36:45 on dist-test-slave-zkpd"
server_key: "772d0b0d7158503dd928a7447958403e"
server_key_iv: "ef53b65b4354f6b4cf9bd95e980919a0"
server_key_version: "encryptionkey@0"
I20260808 11:36:45.448581 16692 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.006s
I20260808 11:36:45.452000 16707 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:45.453379 16692 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:36:45.453557 16692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "8e1cf1a41dba49cc9c97318f5a4aa3d1"
format_stamp: "Formatted at 2026-08-08 11:36:45 on dist-test-slave-zkpd"
server_key: "772d0b0d7158503dd928a7447958403e"
server_key_iv: "ef53b65b4354f6b4cf9bd95e980919a0"
server_key_version: "encryptionkey@0"
I20260808 11:36:45.453774 16692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:45.477888 16692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:45.482100 16692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:45.482391 16692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:45.500944 16692 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42549
I20260808 11:36:45.500983 16766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42549 every 8 connection(s)
I20260808 11:36:45.502238 16692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:36:45.503579 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 16692
I20260808 11:36:45.503757 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:36:45.504367 26890 external_mini_cluster.cc:1428] Setting key 5d0721275b727a17f3028d6e53726a14
I20260808 11:36:45.506789 16767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:45.517925 16770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:45.506171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.39:56355 (local address 127.0.0.1:42549)
0808 11:36:45.506995 (+ 824us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:45.507007 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:45.507057 (+ 50us) server_negotiation.cc:407] Connection header received
0808 11:36:45.508746 (+ 1689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:45.508768 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:45.509128 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:45.509463 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:45.510043 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:45.511364 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:45.513296 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:45.513976 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:45.514107 (+ 131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:45.515528 (+ 1421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:45.515536 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:45.515549 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:45.516174 (+ 625us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:45.516262 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:45.516289 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:45.516422 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:45.516760 (+ 338us) server_negotiation.cc:299] Negotiation successful
0808 11:36:45.516962 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":587,"thread_start_us":370,"threads_started":1}
I20260808 11:36:45.519304 16767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e1cf1a41dba49cc9c97318f5a4aa3d1: Bootstrap starting.
I20260808 11:36:45.521905 26890 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 11:36:45.522631 16767 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e1cf1a41dba49cc9c97318f5a4aa3d1: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:45.523620 16767 log.cc:824] T 00000000000000000000000000000000 P 8e1cf1a41dba49cc9c97318f5a4aa3d1: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:45.526594 16767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e1cf1a41dba49cc9c97318f5a4aa3d1: No bootstrap required, opened a new log
I20260808 11:36:45.533545 16770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:45.526737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.39:58335 (local address 127.0.0.1:42549)
0808 11:36:45.526916 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:45.526922 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:45.527336 (+ 414us) server_negotiation.cc:407] Connection header received
0808 11:36:45.527465 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:45.527469 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:45.527540 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:45.527644 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:45.528164 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:45.529349 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:45.530736 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:45.531441 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:45.531577 (+ 136us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:45.532749 (+ 1172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:45.532755 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:45.532760 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:45.532780 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:45.532845 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:45.532870 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:45.532992 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:45.533164 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 11:36:45.533213 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 11:36:45.536387 16767 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e1cf1a41dba49cc9c97318f5a4aa3d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e1cf1a41dba49cc9c97318f5a4aa3d1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42549 } }
I20260808 11:36:45.536747 16767 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8e1cf1a41dba49cc9c97318f5a4aa3d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:45.536872 16767 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e1cf1a41dba49cc9c97318f5a4aa3d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e1cf1a41dba49cc9c97318f5a4aa3d1, State: Initialized, Role: FOLLOWER
I20260808 11:36:45.537453 16767 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e1cf1a41dba49cc9c97318f5a4aa3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e1cf1a41dba49cc9c97318f5a4aa3d1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42549 } }
I20260808 11:36:45.537690 16767 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8e1cf1a41dba49cc9c97318f5a4aa3d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:36:45.537849 16767 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8e1cf1a41dba49cc9c97318f5a4aa3d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:36:45.538017 16767 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e1cf1a41dba49cc9c97318f5a4aa3d1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:45.540656 16767 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8e1cf1a41dba49cc9c97318f5a4aa3d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e1cf1a41dba49cc9c97318f5a4aa3d1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42549 } }
I20260808 11:36:45.541173 16767 leader_election.cc:302] T 00000000000000000000000000000000 P 8e1cf1a41dba49cc9c97318f5a4aa3d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e1cf1a41dba49cc9c97318f5a4aa3d1; no voters:
I20260808 11:36:45.541783 16767 leader_election.cc:288] T 00000000000000000000000000000000 P 8e1cf1a41dba49cc9c97318f5a4aa3d1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:36:45.541918 16777 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8e1cf1a41dba49cc9c97318f5a4aa3d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:36:45.542634 16777 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8e1cf1a41dba49cc9c97318f5a4aa3d1 [term 1 LEADER]: Becoming Leader. State: Replica: 8e1cf1a41dba49cc9c97318f5a4aa3d1, State: Running, Role: LEADER
I20260808 11:36:45.543208 16777 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e1cf1a41dba49cc9c97318f5a4aa3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e1cf1a41dba49cc9c97318f5a4aa3d1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42549 } }
I20260808 11:36:45.544028 16767 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e1cf1a41dba49cc9c97318f5a4aa3d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:36:45.546049 16779 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e1cf1a41dba49cc9c97318f5a4aa3d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e1cf1a41dba49cc9c97318f5a4aa3d1. Latest consensus state: current_term: 1 leader_uuid: "8e1cf1a41dba49cc9c97318f5a4aa3d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e1cf1a41dba49cc9c97318f5a4aa3d1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42549 } } }
I20260808 11:36:45.546532 16779 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e1cf1a41dba49cc9c97318f5a4aa3d1 [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:45.547446 16784 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:36:45.547371 16778 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e1cf1a41dba49cc9c97318f5a4aa3d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8e1cf1a41dba49cc9c97318f5a4aa3d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e1cf1a41dba49cc9c97318f5a4aa3d1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42549 } } }
I20260808 11:36:45.548959 16778 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e1cf1a41dba49cc9c97318f5a4aa3d1 [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:45.553289 16784 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:36:45.561697 16784 catalog_manager.cc:1347] Generated new cluster ID: adcb400997804363ab52afa925f7d23f
I20260808 11:36:45.561808 16784 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:36:45.587037 16784 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:36:45.588363 16784 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:36:45.600278 16784 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8e1cf1a41dba49cc9c97318f5a4aa3d1: Generated new TSK 0
I20260808 11:36:45.601114 16784 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:36:45.610249 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 16692
W20260808 11:36:45.611913 16760 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.39:56355
W20260808 11:36:45.612720 26890 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 16692: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 11:36:45.612901 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 16692
W20260808 11:36:45.635007 16677 connection.cc:535] client connection to 127.0.0.1:42549 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42549): Connection reset by peer (error 104)
2026-08-08T11:36:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2080 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:36:45 dist-test-slave-zkpd krb5kdc[16799](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:36:45 dist-test-slave-zkpd krb5kdc[16799](info): set up 2 sockets
Aug 08 11:36:45 dist-test-slave-zkpd krb5kdc[16799](info): commencing operation
krb5kdc: starting...
W20260808 11:36:46.798468 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.144s user 0.000s sys 0.055s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:36:47 dist-test-slave-zkpd krb5kdc[16799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189007, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:36:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:36:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 11:36:47.131488 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45775
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45775
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:36:47.484045 16814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:47.484326 16814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:47.484429 16814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:47.491616 16814 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:36:47.491751 16814 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:47.491807 16814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:47.491863 16814 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:36:47.491969 16814 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:36:47.501780 16814 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45775
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:47.502995 16814 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:47.504382 16814 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:47.516436 16820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:47.516536 16819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:47.516413 16822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:47.518571 16814 server_base.cc:1034] running on GCE node
I20260808 11:36:47.519305 16814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:47.520725 16814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:47.521934 16814 hybrid_clock.cc:648] HybridClock initialized: now 1786189007521888 us; error 33 us; skew 500 ppm
I20260808 11:36:47.522324 16814 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:36:47 dist-test-slave-zkpd krb5kdc[16799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189007, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:36:47.525594 16814 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 11:36:47.527169 16814 webserver.cc:460] Webserver started at http://127.0.0.1:40685/ using document root <none> and password file <none>
I20260808 11:36:47.527864 16814 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:47.528048 16814 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:47.528326 16814 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:47.531236 16814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "4f08c66d213a49689685bb976dcf62d6"
format_stamp: "Formatted at 2026-08-08 11:36:47 on dist-test-slave-zkpd"
server_key: "a4b3df55bbad90ba4990510c677c1183"
server_key_iv: "faf652392c662db8080c71c92234e412"
server_key_version: "encryptionkey@0"
I20260808 11:36:47.532032 16814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "4f08c66d213a49689685bb976dcf62d6"
format_stamp: "Formatted at 2026-08-08 11:36:47 on dist-test-slave-zkpd"
server_key: "a4b3df55bbad90ba4990510c677c1183"
server_key_iv: "faf652392c662db8080c71c92234e412"
server_key_version: "encryptionkey@0"
I20260808 11:36:47.537295 16814 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260808 11:36:47.540856 16829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:47.542162 16814 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:36:47.542346 16814 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "4f08c66d213a49689685bb976dcf62d6"
format_stamp: "Formatted at 2026-08-08 11:36:47 on dist-test-slave-zkpd"
server_key: "a4b3df55bbad90ba4990510c677c1183"
server_key_iv: "faf652392c662db8080c71c92234e412"
server_key_version: "encryptionkey@0"
I20260808 11:36:47.542542 16814 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:47.548317 16814 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:47.552522 16814 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:47.552821 16814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:47.572458 16814 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45775
I20260808 11:36:47.572544 16882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45775 every 8 connection(s)
I20260808 11:36:47.573931 16814 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:36:47.577785 16884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:47.583362 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 16814
I20260808 11:36:47.583534 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:36:47.584088 26890 external_mini_cluster.cc:1428] Setting key 8e99f57f9187ba9063ba7b264d563ba9
I20260808 11:36:47.589426 16884 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f08c66d213a49689685bb976dcf62d6: Bootstrap starting.
I20260808 11:36:47.592123 16887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:47.586013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.39:56355 (local address 127.0.0.1:45775)
0808 11:36:47.586905 (+ 892us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:47.586916 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:47.586958 (+ 42us) server_negotiation.cc:407] Connection header received
0808 11:36:47.588709 (+ 1751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:47.588731 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:47.589059 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:47.589378 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:47.590458 (+ 1080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:47.590465 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:47.590478 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:47.590492 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:47.590554 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:47.590573 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:47.590792 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:47.590886 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 11:36:47.591109 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":647,"thread_start_us":432,"threads_started":1}
I20260808 11:36:47.593111 16884 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f08c66d213a49689685bb976dcf62d6: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:47.594276 16884 log.cc:824] T 00000000000000000000000000000000 P 4f08c66d213a49689685bb976dcf62d6: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:47.595832 26890 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 11:36:47.597258 16884 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f08c66d213a49689685bb976dcf62d6: No bootstrap required, opened a new log
I20260808 11:36:47.603149 16887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:47.600496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.39:47569 (local address 127.0.0.1:45775)
0808 11:36:47.600693 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:47.600700 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:47.600972 (+ 272us) server_negotiation.cc:407] Connection header received
0808 11:36:47.601192 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:47.601215 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:47.601261 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:47.601366 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:47.602320 (+ 954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:47.602325 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:47.602333 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:47.602351 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:47.602439 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:47.602459 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:47.602722 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:47.602811 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 11:36:47.602888 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 11:36:47.605911 16884 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f08c66d213a49689685bb976dcf62d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f08c66d213a49689685bb976dcf62d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45775 } }
I20260808 11:36:47.606292 16884 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4f08c66d213a49689685bb976dcf62d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:47.606401 16884 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f08c66d213a49689685bb976dcf62d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f08c66d213a49689685bb976dcf62d6, State: Initialized, Role: FOLLOWER
I20260808 11:36:47.607000 16884 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f08c66d213a49689685bb976dcf62d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f08c66d213a49689685bb976dcf62d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45775 } }
I20260808 11:36:47.607252 16884 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4f08c66d213a49689685bb976dcf62d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:36:47.607398 16884 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f08c66d213a49689685bb976dcf62d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:36:47.607570 16884 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f08c66d213a49689685bb976dcf62d6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:47.610100 16884 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f08c66d213a49689685bb976dcf62d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f08c66d213a49689685bb976dcf62d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45775 } }
I20260808 11:36:47.610580 16884 leader_election.cc:302] T 00000000000000000000000000000000 P 4f08c66d213a49689685bb976dcf62d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f08c66d213a49689685bb976dcf62d6; no voters:
I20260808 11:36:47.611145 16884 leader_election.cc:288] T 00000000000000000000000000000000 P 4f08c66d213a49689685bb976dcf62d6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:36:47.611286 16894 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f08c66d213a49689685bb976dcf62d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:36:47.611990 16894 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f08c66d213a49689685bb976dcf62d6 [term 1 LEADER]: Becoming Leader. State: Replica: 4f08c66d213a49689685bb976dcf62d6, State: Running, Role: LEADER
I20260808 11:36:47.612571 16894 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f08c66d213a49689685bb976dcf62d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f08c66d213a49689685bb976dcf62d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45775 } }
I20260808 11:36:47.613291 16884 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f08c66d213a49689685bb976dcf62d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:36:47.615317 16895 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f08c66d213a49689685bb976dcf62d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4f08c66d213a49689685bb976dcf62d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f08c66d213a49689685bb976dcf62d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45775 } } }
I20260808 11:36:47.615736 16895 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f08c66d213a49689685bb976dcf62d6 [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:47.618542 16896 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f08c66d213a49689685bb976dcf62d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f08c66d213a49689685bb976dcf62d6. Latest consensus state: current_term: 1 leader_uuid: "4f08c66d213a49689685bb976dcf62d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f08c66d213a49689685bb976dcf62d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45775 } } }
I20260808 11:36:47.618999 16896 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f08c66d213a49689685bb976dcf62d6 [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:47.629410 16900 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:36:47.634610 16900 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:36:47.644842 16900 catalog_manager.cc:1347] Generated new cluster ID: d3d64ec9e42e43d8aa89567a910ebff5
I20260808 11:36:47.644975 16900 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:36:47.657157 16900 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:36:47.657560 16900 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:36:47.664014 16900 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4f08c66d213a49689685bb976dcf62d6: Generated new TSK 0
I20260808 11:36:47.664748 16900 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:36:47.670608 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 16814
W20260808 11:36:47.671700 16878 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.39:56355
W20260808 11:36:47.672387 26890 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 16814: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 11:36:47.672530 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 16814
2026-08-08T11:36:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2055 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:36:47 dist-test-slave-zkpd krb5kdc[16916](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:36:47 dist-test-slave-zkpd krb5kdc[16916](info): set up 2 sockets
Aug 08 11:36:47 dist-test-slave-zkpd krb5kdc[16916](info): commencing operation
krb5kdc: starting...
W20260808 11:36:48.829690 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.002s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:36:49 dist-test-slave-zkpd krb5kdc[16916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189009, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:36:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:36:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 11:36:49.194933 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42545
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42545
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:36:49.546680 16930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:49.546952 16930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:49.547111 16930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:49.554414 16930 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:36:49.554513 16930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:49.554598 16930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:49.554697 16930 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:36:49.554790 16930 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:36:49.564389 16930 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42545
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42545
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:49.565641 16930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:49.566923 16930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:49.581085 16935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:49.581022 16936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:49.581403 16939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:49.582563 16930 server_base.cc:1034] running on GCE node
I20260808 11:36:49.583345 16930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:49.584865 16930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:49.586082 16930 hybrid_clock.cc:648] HybridClock initialized: now 1786189009586048 us; error 32 us; skew 500 ppm
I20260808 11:36:49.586468 16930 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:36:49 dist-test-slave-zkpd krb5kdc[16916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189009, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:36:49.595014 16930 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 11:36:49.596658 16930 webserver.cc:460] Webserver started at http://127.0.0.1:35911/ using document root <none> and password file <none>
I20260808 11:36:49.597416 16930 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:49.597554 16930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:49.597883 16930 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:49.600973 16930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "52fc83efa1b64d45acae991d6945909c"
format_stamp: "Formatted at 2026-08-08 11:36:49 on dist-test-slave-zkpd"
server_key: "70e032b5407e7b43442cb4c6e549754c"
server_key_iv: "5a0338f0960d68dcfdb6bf664493a9c9"
server_key_version: "encryptionkey@0"
I20260808 11:36:49.601780 16930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "52fc83efa1b64d45acae991d6945909c"
format_stamp: "Formatted at 2026-08-08 11:36:49 on dist-test-slave-zkpd"
server_key: "70e032b5407e7b43442cb4c6e549754c"
server_key_iv: "5a0338f0960d68dcfdb6bf664493a9c9"
server_key_version: "encryptionkey@0"
I20260808 11:36:49.606971 16930 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 11:36:49.610404 16947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:49.611668 16930 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 11:36:49.611857 16930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "52fc83efa1b64d45acae991d6945909c"
format_stamp: "Formatted at 2026-08-08 11:36:49 on dist-test-slave-zkpd"
server_key: "70e032b5407e7b43442cb4c6e549754c"
server_key_iv: "5a0338f0960d68dcfdb6bf664493a9c9"
server_key_version: "encryptionkey@0"
I20260808 11:36:49.612105 16930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:49.634763 16930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:49.639091 16930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:49.639413 16930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:49.658871 16930 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42545
I20260808 11:36:49.658959 16999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42545 every 8 connection(s)
I20260808 11:36:49.660246 16930 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:36:49.660574 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 16930
I20260808 11:36:49.660763 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:36:49.661304 26890 external_mini_cluster.cc:1428] Setting key 5aca189f6a5451696e069eeccf635f66
I20260808 11:36:49.665066 17000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 11:36:49 dist-test-slave-zkpd krb5kdc[16916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189009, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 11:36:49.677409 17000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52fc83efa1b64d45acae991d6945909c: Bootstrap starting.
I20260808 11:36:49.681663 17000 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 52fc83efa1b64d45acae991d6945909c: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:49.682952 17000 log.cc:824] T 00000000000000000000000000000000 P 52fc83efa1b64d45acae991d6945909c: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:49.686350 17003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:49.663249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.39:57751 (local address 127.0.0.1:42545)
0808 11:36:49.664105 (+ 856us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:49.664120 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:49.664172 (+ 52us) server_negotiation.cc:407] Connection header received
0808 11:36:49.666487 (+ 2315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:49.666515 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:49.666995 (+ 480us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:49.667431 (+ 436us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:49.668946 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:49.670999 (+ 2053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:49.672305 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:49.673330 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:49.673514 (+ 184us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:49.677476 (+ 3962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:49.677489 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:49.677508 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:49.677551 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:49.681448 (+ 3897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:49.682302 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:49.682310 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:49.682317 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:49.682517 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:49.683051 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:49.683056 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:49.683060 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:49.683805 (+ 745us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:49.684133 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:49.684730 (+ 597us) server_negotiation.cc:299] Negotiation successful
0808 11:36:49.685072 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":313,"threads_started":1}
I20260808 11:36:49.686453 17000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52fc83efa1b64d45acae991d6945909c: No bootstrap required, opened a new log
I20260808 11:36:49.690536 26890 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 11:36:49.694700 17000 raft_consensus.cc:348] T 00000000000000000000000000000000 P 52fc83efa1b64d45acae991d6945909c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52fc83efa1b64d45acae991d6945909c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42545 } }
I20260808 11:36:49.695299 17000 raft_consensus.cc:374] T 00000000000000000000000000000000 P 52fc83efa1b64d45acae991d6945909c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:49.695436 17000 raft_consensus.cc:729] T 00000000000000000000000000000000 P 52fc83efa1b64d45acae991d6945909c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52fc83efa1b64d45acae991d6945909c, State: Initialized, Role: FOLLOWER
I20260808 11:36:49.696105 17000 consensus_queue.cc:260] T 00000000000000000000000000000000 P 52fc83efa1b64d45acae991d6945909c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52fc83efa1b64d45acae991d6945909c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42545 } }
I20260808 11:36:49.696355 17000 raft_consensus.cc:388] T 00000000000000000000000000000000 P 52fc83efa1b64d45acae991d6945909c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:36:49.696506 17000 raft_consensus.cc:482] T 00000000000000000000000000000000 P 52fc83efa1b64d45acae991d6945909c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:36:49.696691 17000 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 52fc83efa1b64d45acae991d6945909c [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:49.698871 17000 raft_consensus.cc:504] T 00000000000000000000000000000000 P 52fc83efa1b64d45acae991d6945909c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52fc83efa1b64d45acae991d6945909c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42545 } }
I20260808 11:36:49.699374 17000 leader_election.cc:302] T 00000000000000000000000000000000 P 52fc83efa1b64d45acae991d6945909c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 52fc83efa1b64d45acae991d6945909c; no voters:
I20260808 11:36:49.700093 17000 leader_election.cc:288] T 00000000000000000000000000000000 P 52fc83efa1b64d45acae991d6945909c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:36:49.700214 17010 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 52fc83efa1b64d45acae991d6945909c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:36:49.700980 17010 raft_consensus.cc:686] T 00000000000000000000000000000000 P 52fc83efa1b64d45acae991d6945909c [term 1 LEADER]: Becoming Leader. State: Replica: 52fc83efa1b64d45acae991d6945909c, State: Running, Role: LEADER
I20260808 11:36:49.701644 17010 consensus_queue.cc:237] T 00000000000000000000000000000000 P 52fc83efa1b64d45acae991d6945909c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52fc83efa1b64d45acae991d6945909c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42545 } }
I20260808 11:36:49.703876 17010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52fc83efa1b64d45acae991d6945909c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 52fc83efa1b64d45acae991d6945909c. Latest consensus state: current_term: 1 leader_uuid: "52fc83efa1b64d45acae991d6945909c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52fc83efa1b64d45acae991d6945909c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42545 } } }
I20260808 11:36:49.704365 17010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52fc83efa1b64d45acae991d6945909c [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:49.704710 17012 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52fc83efa1b64d45acae991d6945909c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "52fc83efa1b64d45acae991d6945909c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52fc83efa1b64d45acae991d6945909c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42545 } } }
I20260808 11:36:49.705417 17012 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52fc83efa1b64d45acae991d6945909c [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:49.708751 17000 sys_catalog.cc:564] T 00000000000000000000000000000000 P 52fc83efa1b64d45acae991d6945909c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:36:49.709901 17014 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:36:49.712831 17003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:49.695146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.39:39675 (local address 127.0.0.1:42545)
0808 11:36:49.695326 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:49.695332 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:49.695662 (+ 330us) server_negotiation.cc:407] Connection header received
0808 11:36:49.695846 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:49.695856 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:49.695980 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:49.696083 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:49.697810 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:49.698572 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:49.700022 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:49.700681 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:49.700842 (+ 161us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:49.703880 (+ 3038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:49.703891 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:49.703895 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:49.703965 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:49.707861 (+ 3896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:49.708828 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:49.708833 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:49.708836 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:49.709034 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:49.709526 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:49.709532 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:49.709536 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:49.709987 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:49.712072 (+ 2085us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:49.712225 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 11:36:49.712435 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 11:36:49.716626 17014 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:36:49.724596 17014 catalog_manager.cc:1347] Generated new cluster ID: 460ddb486bc84dbca5c567c8b7e9f4fb
I20260808 11:36:49.724716 17014 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:36:49.746255 17014 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:36:49.748189 17014 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:36:49.760298 17014 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 52fc83efa1b64d45acae991d6945909c: Generated new TSK 0
I20260808 11:36:49.761147 17014 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:36:49.770752 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 16930
I20260808 11:36:49.772177 16995 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:49.862797 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 16930
W20260808 11:36:49.884344 16914 connection.cc:535] client connection to 127.0.0.1:42545 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42545): Connection reset by peer (error 104)
2026-08-08T11:36:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2193 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:36:49 dist-test-slave-zkpd krb5kdc[17032](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:36:49 dist-test-slave-zkpd krb5kdc[17032](info): set up 2 sockets
Aug 08 11:36:49 dist-test-slave-zkpd krb5kdc[17032](info): commencing operation
krb5kdc: starting...
W20260808 11:36:51.026782 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.000s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:36:51 dist-test-slave-zkpd krb5kdc[17032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189011, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:36:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:36:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 11:36:51.393745 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43857
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43857
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:36:51.763715 17046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:51.764099 17046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:51.764272 17046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:51.773305 17046 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:36:51.773523 17046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:51.773679 17046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:51.773850 17046 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:36:51.773969 17046 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:36:51.790243 17046 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43857
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43857
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:51.791955 17046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:51.793531 17046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:51.806844 17054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:51.806792 17052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:51.806880 17051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:51.807588 17046 server_base.cc:1034] running on GCE node
I20260808 11:36:51.808383 17046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:51.809669 17046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:51.810871 17046 hybrid_clock.cc:648] HybridClock initialized: now 1786189011810822 us; error 51 us; skew 500 ppm
I20260808 11:36:51.811198 17046 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:36:51 dist-test-slave-zkpd krb5kdc[17032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189011, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:36:51.814397 17046 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 11:36:51.815860 17046 webserver.cc:460] Webserver started at http://127.0.0.1:35857/ using document root <none> and password file <none>
I20260808 11:36:51.816658 17046 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:51.816818 17046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:51.817239 17046 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:51.821730 17046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "6ab448e3cae94d5baef1c708f33a8fc5"
format_stamp: "Formatted at 2026-08-08 11:36:51 on dist-test-slave-zkpd"
server_key: "1f5df9234c9bec7f0ccea4d4580efb5e"
server_key_iv: "2bec67b98daf10e45d6753fe357308f1"
server_key_version: "encryptionkey@0"
I20260808 11:36:51.822834 17046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "6ab448e3cae94d5baef1c708f33a8fc5"
format_stamp: "Formatted at 2026-08-08 11:36:51 on dist-test-slave-zkpd"
server_key: "1f5df9234c9bec7f0ccea4d4580efb5e"
server_key_iv: "2bec67b98daf10e45d6753fe357308f1"
server_key_version: "encryptionkey@0"
I20260808 11:36:51.829672 17046 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.002s
I20260808 11:36:51.833089 17061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:51.834470 17046 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260808 11:36:51.834614 17046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "6ab448e3cae94d5baef1c708f33a8fc5"
format_stamp: "Formatted at 2026-08-08 11:36:51 on dist-test-slave-zkpd"
server_key: "1f5df9234c9bec7f0ccea4d4580efb5e"
server_key_iv: "2bec67b98daf10e45d6753fe357308f1"
server_key_version: "encryptionkey@0"
I20260808 11:36:51.834786 17046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:51.869753 17046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:51.874338 17046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:51.874581 17046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:51.893941 17046 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43857
I20260808 11:36:51.893980 17117 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43857 every 8 connection(s)
I20260808 11:36:51.895371 17046 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:36:51.899142 17118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:51.899740 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 17046
I20260808 11:36:51.900046 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:36:51.900534 26890 external_mini_cluster.cc:1428] Setting key 3577d30966b1c65526e48efe7224d174
I20260808 11:36:51.911293 17118 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ab448e3cae94d5baef1c708f33a8fc5: Bootstrap starting.
I20260808 11:36:51.913774 17121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:51.902409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.39:34947 (local address 127.0.0.1:43857)
0808 11:36:51.903250 (+ 841us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:51.903261 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:51.903303 (+ 42us) server_negotiation.cc:407] Connection header received
0808 11:36:51.905311 (+ 2008us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:51.905336 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:51.905727 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:51.906134 (+ 407us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:51.906691 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:51.908020 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:51.909344 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:51.910024 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:51.910219 (+ 195us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:51.911549 (+ 1330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:51.911558 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:51.911570 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:51.912184 (+ 614us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:51.912262 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:51.912286 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:51.912460 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:51.912748 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 11:36:51.912889 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":629,"thread_start_us":361,"threads_started":1}
I20260808 11:36:51.914744 17118 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ab448e3cae94d5baef1c708f33a8fc5: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:51.915927 17118 log.cc:824] T 00000000000000000000000000000000 P 6ab448e3cae94d5baef1c708f33a8fc5: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:51.917699 26890 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 11:36:51.919303 17118 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ab448e3cae94d5baef1c708f33a8fc5: No bootstrap required, opened a new log
I20260808 11:36:51.929461 17118 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ab448e3cae94d5baef1c708f33a8fc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ab448e3cae94d5baef1c708f33a8fc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43857 } }
I20260808 11:36:51.929908 17121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:51.922992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.39:49941 (local address 127.0.0.1:43857)
0808 11:36:51.923235 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:51.923241 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:51.923725 (+ 484us) server_negotiation.cc:407] Connection header received
0808 11:36:51.923857 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:51.923862 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:51.923973 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:51.924069 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:51.924626 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:51.925843 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:51.927144 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:51.927875 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:51.928059 (+ 184us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:51.929131 (+ 1072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:51.929137 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:51.929141 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:51.929163 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:51.929235 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:51.929259 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:51.929374 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:51.929555 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 11:36:51.929603 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 11:36:51.929936 17118 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6ab448e3cae94d5baef1c708f33a8fc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:51.930059 17118 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ab448e3cae94d5baef1c708f33a8fc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ab448e3cae94d5baef1c708f33a8fc5, State: Initialized, Role: FOLLOWER
I20260808 11:36:51.930671 17118 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ab448e3cae94d5baef1c708f33a8fc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ab448e3cae94d5baef1c708f33a8fc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43857 } }
I20260808 11:36:51.930944 17118 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6ab448e3cae94d5baef1c708f33a8fc5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:36:51.931123 17118 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ab448e3cae94d5baef1c708f33a8fc5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:36:51.931345 17118 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ab448e3cae94d5baef1c708f33a8fc5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:51.933601 17118 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ab448e3cae94d5baef1c708f33a8fc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ab448e3cae94d5baef1c708f33a8fc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43857 } }
I20260808 11:36:51.934122 17118 leader_election.cc:302] T 00000000000000000000000000000000 P 6ab448e3cae94d5baef1c708f33a8fc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ab448e3cae94d5baef1c708f33a8fc5; no voters:
I20260808 11:36:51.934717 17118 leader_election.cc:288] T 00000000000000000000000000000000 P 6ab448e3cae94d5baef1c708f33a8fc5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:36:51.934914 17129 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ab448e3cae94d5baef1c708f33a8fc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:36:51.936455 17129 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6ab448e3cae94d5baef1c708f33a8fc5 [term 1 LEADER]: Becoming Leader. State: Replica: 6ab448e3cae94d5baef1c708f33a8fc5, State: Running, Role: LEADER
I20260808 11:36:51.936921 17118 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ab448e3cae94d5baef1c708f33a8fc5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:36:51.936959 17129 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ab448e3cae94d5baef1c708f33a8fc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ab448e3cae94d5baef1c708f33a8fc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43857 } }
I20260808 11:36:51.940192 17131 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ab448e3cae94d5baef1c708f33a8fc5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ab448e3cae94d5baef1c708f33a8fc5. Latest consensus state: current_term: 1 leader_uuid: "6ab448e3cae94d5baef1c708f33a8fc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ab448e3cae94d5baef1c708f33a8fc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43857 } } }
I20260808 11:36:51.940703 17131 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ab448e3cae94d5baef1c708f33a8fc5 [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:51.940244 17130 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ab448e3cae94d5baef1c708f33a8fc5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6ab448e3cae94d5baef1c708f33a8fc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ab448e3cae94d5baef1c708f33a8fc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43857 } } }
I20260808 11:36:51.941094 17130 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ab448e3cae94d5baef1c708f33a8fc5 [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:51.944391 17139 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:36:51.948374 17139 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:36:51.956723 17139 catalog_manager.cc:1347] Generated new cluster ID: 28a925fe0a474547a1eab2ae99d199c3
I20260808 11:36:51.956835 17139 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:36:51.978088 17139 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:36:51.979929 17139 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:36:51.995693 17139 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6ab448e3cae94d5baef1c708f33a8fc5: Generated new TSK 0
I20260808 11:36:51.996559 17139 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:36:52.004053 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 17046
W20260808 11:36:52.005761 17113 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.39:34947
W20260808 11:36:52.006525 26890 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 17046: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 11:36:52.006664 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 17046
W20260808 11:36:52.027859 17030 connection.cc:535] client connection to 127.0.0.1:43857 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43857): Connection reset by peer (error 104)
2026-08-08T11:36:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2143 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:36:52 dist-test-slave-zkpd krb5kdc[17150](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:36:52 dist-test-slave-zkpd krb5kdc[17150](info): set up 2 sockets
Aug 08 11:36:52 dist-test-slave-zkpd krb5kdc[17150](info): commencing operation
krb5kdc: starting...
W20260808 11:36:53.175470 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.005s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:36:53 dist-test-slave-zkpd krb5kdc[17150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189013, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:36:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:36:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 11:36:53.533123 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38087
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38087
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:36:53.881434 17163 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:53.881707 17163 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:53.881805 17163 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:53.888720 17163 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:36:53.888830 17163 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:53.888895 17163 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:53.888959 17163 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:36:53.888998 17163 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:36:53.898504 17163 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38087
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786188664137852-26890-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:53.899703 17163 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:53.901038 17163 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:53.913159 17171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:53.913126 17169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:53.913508 17168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:53.914554 17163 server_base.cc:1034] running on GCE node
I20260808 11:36:53.915359 17163 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:53.916874 17163 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:53.918082 17163 hybrid_clock.cc:648] HybridClock initialized: now 1786189013918042 us; error 29 us; skew 500 ppm
I20260808 11:36:53.918437 17163 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:36:53 dist-test-slave-zkpd krb5kdc[17150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189013, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:36:53.921599 17163 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 11:36:53.923048 17163 webserver.cc:460] Webserver started at http://127.0.0.1:41485/ using document root <none> and password file <none>
I20260808 11:36:53.923743 17163 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:53.923934 17163 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:53.924266 17163 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:53.927207 17163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "aeb501cdbe874916855f81c9dbdf786b"
format_stamp: "Formatted at 2026-08-08 11:36:53 on dist-test-slave-zkpd"
server_key: "addc4ecc03adf0b18d621acc0ed60a5f"
server_key_iv: "fcef825df0d16811153ac5e9a2100cd1"
server_key_version: "encryptionkey@0"
I20260808 11:36:53.928040 17163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "aeb501cdbe874916855f81c9dbdf786b"
format_stamp: "Formatted at 2026-08-08 11:36:53 on dist-test-slave-zkpd"
server_key: "addc4ecc03adf0b18d621acc0ed60a5f"
server_key_iv: "fcef825df0d16811153ac5e9a2100cd1"
server_key_version: "encryptionkey@0"
I20260808 11:36:53.933049 17163 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260808 11:36:53.936452 17179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:53.937661 17163 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 11:36:53.937847 17163 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "aeb501cdbe874916855f81c9dbdf786b"
format_stamp: "Formatted at 2026-08-08 11:36:53 on dist-test-slave-zkpd"
server_key: "addc4ecc03adf0b18d621acc0ed60a5f"
server_key_iv: "fcef825df0d16811153ac5e9a2100cd1"
server_key_version: "encryptionkey@0"
I20260808 11:36:53.938051 17163 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:53.943681 17163 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:53.947641 17163 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:53.947985 17163 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:53.966965 17163 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38087
I20260808 11:36:53.967044 17233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38087 every 8 connection(s)
I20260808 11:36:53.968441 17163 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:36:53.972365 17234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:53.976640 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 17163
I20260808 11:36:53.976830 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:36:53.977394 26890 external_mini_cluster.cc:1428] Setting key 87f664e62987da9ba74830e624fc2075
I20260808 11:36:53.983979 17234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aeb501cdbe874916855f81c9dbdf786b: Bootstrap starting.
I20260808 11:36:53.985674 17237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:53.979193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.39:41159 (local address 127.0.0.1:38087)
0808 11:36:53.979988 (+ 795us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:53.979999 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:53.980049 (+ 50us) server_negotiation.cc:407] Connection header received
0808 11:36:53.982334 (+ 2285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:53.982357 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:53.982658 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:53.983040 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:53.984119 (+ 1079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:53.984128 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:53.984146 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:53.984171 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:53.984234 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:53.984258 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:53.984499 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:53.984633 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 11:36:53.984813 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":301,"threads_started":1}
I20260808 11:36:53.987267 17234 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aeb501cdbe874916855f81c9dbdf786b: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:53.988564 17234 log.cc:824] T 00000000000000000000000000000000 P aeb501cdbe874916855f81c9dbdf786b: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:53.989197 26890 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 11:36:53.991223 17234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aeb501cdbe874916855f81c9dbdf786b: No bootstrap required, opened a new log
I20260808 11:36:53.996353 17237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:53.993685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.39:57159 (local address 127.0.0.1:38087)
0808 11:36:53.993851 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:53.993855 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:53.994295 (+ 440us) server_negotiation.cc:407] Connection header received
0808 11:36:53.994490 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:53.994496 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:53.994548 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:53.994664 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:53.995562 (+ 898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:53.995568 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:53.995572 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:53.995589 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:53.995671 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:53.995686 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:53.995842 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:53.995999 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 11:36:53.996061 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 11:36:53.999861 17234 raft_consensus.cc:348] T 00000000000000000000000000000000 P aeb501cdbe874916855f81c9dbdf786b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeb501cdbe874916855f81c9dbdf786b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38087 } }
I20260808 11:36:54.000389 17234 raft_consensus.cc:374] T 00000000000000000000000000000000 P aeb501cdbe874916855f81c9dbdf786b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:54.000558 17234 raft_consensus.cc:729] T 00000000000000000000000000000000 P aeb501cdbe874916855f81c9dbdf786b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aeb501cdbe874916855f81c9dbdf786b, State: Initialized, Role: FOLLOWER
I20260808 11:36:54.001202 17234 consensus_queue.cc:260] T 00000000000000000000000000000000 P aeb501cdbe874916855f81c9dbdf786b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeb501cdbe874916855f81c9dbdf786b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38087 } }
I20260808 11:36:54.001451 17234 raft_consensus.cc:388] T 00000000000000000000000000000000 P aeb501cdbe874916855f81c9dbdf786b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:36:54.001570 17234 raft_consensus.cc:482] T 00000000000000000000000000000000 P aeb501cdbe874916855f81c9dbdf786b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:36:54.001766 17234 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aeb501cdbe874916855f81c9dbdf786b [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:54.004119 17234 raft_consensus.cc:504] T 00000000000000000000000000000000 P aeb501cdbe874916855f81c9dbdf786b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeb501cdbe874916855f81c9dbdf786b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38087 } }
I20260808 11:36:54.004637 17234 leader_election.cc:302] T 00000000000000000000000000000000 P aeb501cdbe874916855f81c9dbdf786b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aeb501cdbe874916855f81c9dbdf786b; no voters:
I20260808 11:36:54.005277 17234 leader_election.cc:288] T 00000000000000000000000000000000 P aeb501cdbe874916855f81c9dbdf786b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:36:54.005409 17244 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aeb501cdbe874916855f81c9dbdf786b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:36:54.006770 17244 raft_consensus.cc:686] T 00000000000000000000000000000000 P aeb501cdbe874916855f81c9dbdf786b [term 1 LEADER]: Becoming Leader. State: Replica: aeb501cdbe874916855f81c9dbdf786b, State: Running, Role: LEADER
I20260808 11:36:54.007290 17244 consensus_queue.cc:237] T 00000000000000000000000000000000 P aeb501cdbe874916855f81c9dbdf786b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeb501cdbe874916855f81c9dbdf786b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38087 } }
I20260808 11:36:54.007558 17234 sys_catalog.cc:564] T 00000000000000000000000000000000 P aeb501cdbe874916855f81c9dbdf786b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:36:54.010561 17245 sys_catalog.cc:455] T 00000000000000000000000000000000 P aeb501cdbe874916855f81c9dbdf786b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aeb501cdbe874916855f81c9dbdf786b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeb501cdbe874916855f81c9dbdf786b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38087 } } }
I20260808 11:36:54.010571 17246 sys_catalog.cc:455] T 00000000000000000000000000000000 P aeb501cdbe874916855f81c9dbdf786b [sys.catalog]: SysCatalogTable state changed. Reason: New leader aeb501cdbe874916855f81c9dbdf786b. Latest consensus state: current_term: 1 leader_uuid: "aeb501cdbe874916855f81c9dbdf786b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeb501cdbe874916855f81c9dbdf786b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38087 } } }
I20260808 11:36:54.011019 17246 sys_catalog.cc:458] T 00000000000000000000000000000000 P aeb501cdbe874916855f81c9dbdf786b [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:54.011019 17245 sys_catalog.cc:458] T 00000000000000000000000000000000 P aeb501cdbe874916855f81c9dbdf786b [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:54.017072 17251 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:36:54.022125 17251 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:36:54.031428 17251 catalog_manager.cc:1347] Generated new cluster ID: 342690fbb8444759a8d98bcf7dc93f09
I20260808 11:36:54.031589 17251 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:36:54.051506 17251 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:36:54.052060 17251 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:36:54.065647 17251 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aeb501cdbe874916855f81c9dbdf786b: Generated new TSK 0
I20260808 11:36:54.066643 17251 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:36:54.081691 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 17163
W20260808 11:36:54.082851 17229 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.39:41159
W20260808 11:36:54.083562 26890 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 17163: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 11:36:54.083705 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 17163
2026-08-08T11:36:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2077 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:36:54 dist-test-slave-zkpd krb5kdc[17266](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:36:54 dist-test-slave-zkpd krb5kdc[17266](info): set up 2 sockets
Aug 08 11:36:54 dist-test-slave-zkpd krb5kdc[17266](info): commencing operation
krb5kdc: starting...
W20260808 11:36:55.250239 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.003s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:36:55 dist-test-slave-zkpd krb5kdc[17266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:36:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:36:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:36:55.598451 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:35213
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:40023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:35213
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:36:55.950587 17280 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:55.950928 17280 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:55.951109 17280 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:55.958164 17280 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:36:55.958316 17280 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:55.958425 17280 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:55.958544 17280 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:36:55.958631 17280 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:36:55.968453 17280 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:40023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:35213
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:35213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:55.969792 17280 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:55.971161 17280 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:55.983093 17285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:55.983175 17288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:55.983146 17286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:55.984241 17280 server_base.cc:1034] running on GCE node
I20260808 11:36:55.985005 17280 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:55.986279 17280 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:55.987490 17280 hybrid_clock.cc:648] HybridClock initialized: now 1786189015987453 us; error 27 us; skew 500 ppm
I20260808 11:36:55.987828 17280 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:36:55 dist-test-slave-zkpd krb5kdc[17266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189015, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:36:55.996275 17280 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:36:55.998063 17280 webserver.cc:460] Webserver started at http://127.26.66.190:45631/ using document root <none> and password file <none>
I20260808 11:36:55.998773 17280 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:55.998912 17280 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:55.999245 17280 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:56.002274 17280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "0ca26ce7f3aa4c0f9e6f2fc67adc203d"
format_stamp: "Formatted at 2026-08-08 11:36:55 on dist-test-slave-zkpd"
server_key: "e53bc120bde6775b286675e1ec0723cd"
server_key_iv: "db10b5f5a8e0888fc2ecf5689f82ba2a"
server_key_version: "encryptionkey@0"
I20260808 11:36:56.003047 17280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "0ca26ce7f3aa4c0f9e6f2fc67adc203d"
format_stamp: "Formatted at 2026-08-08 11:36:55 on dist-test-slave-zkpd"
server_key: "e53bc120bde6775b286675e1ec0723cd"
server_key_iv: "db10b5f5a8e0888fc2ecf5689f82ba2a"
server_key_version: "encryptionkey@0"
I20260808 11:36:56.008291 17280 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260808 11:36:56.011821 17295 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:56.013371 17280 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:36:56.013553 17280 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "0ca26ce7f3aa4c0f9e6f2fc67adc203d"
format_stamp: "Formatted at 2026-08-08 11:36:55 on dist-test-slave-zkpd"
server_key: "e53bc120bde6775b286675e1ec0723cd"
server_key_iv: "db10b5f5a8e0888fc2ecf5689f82ba2a"
server_key_version: "encryptionkey@0"
I20260808 11:36:56.013779 17280 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:56.053900 17280 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:56.058239 17280 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:56.058564 17280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:56.077706 17280 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:35213
I20260808 11:36:56.077710 17348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:35213 every 8 connection(s)
I20260808 11:36:56.079094 17280 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:36:56.083067 17349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:56.083712 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 17280
I20260808 11:36:56.083918 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:36:56.084496 26890 external_mini_cluster.cc:1428] Setting key cf11eb0a97cc5d71024c5fcbc62d09e7
I20260808 11:36:56.097543 17349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ca26ce7f3aa4c0f9e6f2fc67adc203d: Bootstrap starting.
Aug 08 11:36:56 dist-test-slave-zkpd krb5kdc[17266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:36:56.100528 17349 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ca26ce7f3aa4c0f9e6f2fc67adc203d: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:56.101910 17349 log.cc:824] T 00000000000000000000000000000000 P 0ca26ce7f3aa4c0f9e6f2fc67adc203d: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:56.104992 17349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ca26ce7f3aa4c0f9e6f2fc67adc203d: No bootstrap required, opened a new log
I20260808 11:36:56.109133 17353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:56.086656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38583 (local address 127.26.66.190:35213)
0808 11:36:56.087635 (+ 979us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:56.087651 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:56.088087 (+ 436us) server_negotiation.cc:407] Connection header received
0808 11:36:56.089939 (+ 1852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:56.089966 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:56.090480 (+ 514us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:56.090953 (+ 473us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:56.092259 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:56.094318 (+ 2059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:56.095583 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:56.096618 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:56.096797 (+ 179us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:56.101014 (+ 4217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:56.101025 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:56.101052 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:56.101104 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:56.104960 (+ 3856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:56.105764 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:56.105771 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:56.105776 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:56.105946 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:56.106440 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:56.106444 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:56.106446 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:56.106949 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:56.107298 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:56.107817 (+ 519us) server_negotiation.cc:299] Negotiation successful
0808 11:36:56.108163 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":705,"thread_start_us":424,"threads_started":1}
I20260808 11:36:56.113263 26890 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 11:36:56.114063 17349 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ca26ce7f3aa4c0f9e6f2fc67adc203d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ca26ce7f3aa4c0f9e6f2fc67adc203d" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 35213 } }
I20260808 11:36:56.114413 17349 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ca26ce7f3aa4c0f9e6f2fc67adc203d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:56.114537 17349 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ca26ce7f3aa4c0f9e6f2fc67adc203d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ca26ce7f3aa4c0f9e6f2fc67adc203d, State: Initialized, Role: FOLLOWER
I20260808 11:36:56.115108 17349 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ca26ce7f3aa4c0f9e6f2fc67adc203d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ca26ce7f3aa4c0f9e6f2fc67adc203d" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 35213 } }
I20260808 11:36:56.115347 17349 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0ca26ce7f3aa4c0f9e6f2fc67adc203d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:36:56.115478 17349 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ca26ce7f3aa4c0f9e6f2fc67adc203d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:36:56.115653 17349 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ca26ce7f3aa4c0f9e6f2fc67adc203d [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:56.118419 17349 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ca26ce7f3aa4c0f9e6f2fc67adc203d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ca26ce7f3aa4c0f9e6f2fc67adc203d" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 35213 } }
I20260808 11:36:56.119084 17349 leader_election.cc:302] T 00000000000000000000000000000000 P 0ca26ce7f3aa4c0f9e6f2fc67adc203d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ca26ce7f3aa4c0f9e6f2fc67adc203d; no voters:
I20260808 11:36:56.119813 17349 leader_election.cc:288] T 00000000000000000000000000000000 P 0ca26ce7f3aa4c0f9e6f2fc67adc203d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:36:56.119948 17360 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ca26ce7f3aa4c0f9e6f2fc67adc203d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:36:56.121784 17360 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ca26ce7f3aa4c0f9e6f2fc67adc203d [term 1 LEADER]: Becoming Leader. State: Replica: 0ca26ce7f3aa4c0f9e6f2fc67adc203d, State: Running, Role: LEADER
I20260808 11:36:56.122256 17349 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ca26ce7f3aa4c0f9e6f2fc67adc203d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:36:56.122502 17360 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ca26ce7f3aa4c0f9e6f2fc67adc203d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ca26ce7f3aa4c0f9e6f2fc67adc203d" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 35213 } }
I20260808 11:36:56.125294 17362 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ca26ce7f3aa4c0f9e6f2fc67adc203d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ca26ce7f3aa4c0f9e6f2fc67adc203d. Latest consensus state: current_term: 1 leader_uuid: "0ca26ce7f3aa4c0f9e6f2fc67adc203d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ca26ce7f3aa4c0f9e6f2fc67adc203d" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 35213 } } }
I20260808 11:36:56.125800 17362 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ca26ce7f3aa4c0f9e6f2fc67adc203d [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:56.136093 17366 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:36:56.132092 17361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ca26ce7f3aa4c0f9e6f2fc67adc203d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ca26ce7f3aa4c0f9e6f2fc67adc203d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ca26ce7f3aa4c0f9e6f2fc67adc203d" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 35213 } } }
I20260808 11:36:56.136616 17361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ca26ce7f3aa4c0f9e6f2fc67adc203d [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:56.141268 17353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:56.118432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58005 (local address 127.26.66.190:35213)
0808 11:36:56.118666 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:56.118676 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:56.119082 (+ 406us) server_negotiation.cc:407] Connection header received
0808 11:36:56.119327 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:56.119333 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:56.119407 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:56.119490 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:56.121566 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:56.122827 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:56.125074 (+ 2247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:56.126370 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:56.126511 (+ 141us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:56.132148 (+ 5637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:56.132157 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:56.132165 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:36:56.132217 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:56.136941 (+ 4724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:56.137917 (+ 976us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:56.137922 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:56.137943 (+ 21us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:56.138098 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:36:56.138738 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:36:56.138746 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:36:56.138752 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:36:56.139226 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:56.140524 (+ 1298us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:56.140723 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 11:36:56.140905 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 11:36:56.142416 17366 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:36:56.154261 17366 catalog_manager.cc:1347] Generated new cluster ID: e371890a6fdc4e52a9368168fad47e25
I20260808 11:36:56.154374 17366 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:36:56.162122 17366 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:36:56.163266 17366 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:36:56.172617 17366 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0ca26ce7f3aa4c0f9e6f2fc67adc203d: Generated new TSK 0
I20260808 11:36:56.173396 17366 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:36:56.184554 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 17280
I20260808 11:36:56.185756 17344 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:36:56.276281 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 17280
W20260808 11:36:56.298063 17264 connection.cc:535] client connection to 127.26.66.190:35213 recv error: Network error: failed to read from TLS socket (remote: 127.26.66.190:35213): Connection reset by peer (error 104)
2026-08-08T11:36:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2192 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:36:56 dist-test-slave-zkpd krb5kdc[17382](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:36:56 dist-test-slave-zkpd krb5kdc[17382](info): set up 2 sockets
Aug 08 11:36:56 dist-test-slave-zkpd krb5kdc[17382](info): commencing operation
krb5kdc: starting...
W20260808 11:36:57.445936 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.004s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:36:57 dist-test-slave-zkpd krb5kdc[17382](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189017, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:36:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:36:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:36:57.801156 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:45975
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:35379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:45975
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:36:58.157625 17395 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:36:58.157995 17395 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:36:58.158243 17395 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:36:58.166109 17395 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:36:58.166231 17395 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:36:58.166281 17395 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:36:58.166344 17395 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:36:58.166396 17395 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:36:58.176797 17395 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:35379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:45975
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:45975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:36:58.178047 17395 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:36:58.179323 17395 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:36:58.191118 17400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:58.191193 17404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:36:58.191218 17402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:36:58.192052 17395 server_base.cc:1034] running on GCE node
I20260808 11:36:58.192866 17395 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:36:58.194257 17395 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:36:58.195489 17395 hybrid_clock.cc:648] HybridClock initialized: now 1786189018195432 us; error 54 us; skew 500 ppm
I20260808 11:36:58.195830 17395 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:36:58 dist-test-slave-zkpd krb5kdc[17382](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189018, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:36:58.198956 17395 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:36:58.200389 17395 webserver.cc:460] Webserver started at http://127.26.66.190:46573/ using document root <none> and password file <none>
I20260808 11:36:58.200996 17395 fs_manager.cc:359] Metadata directory not provided
I20260808 11:36:58.201097 17395 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:36:58.201349 17395 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:36:58.204803 17395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "f445f357fc88463e9a6510c4f3bb05da"
format_stamp: "Formatted at 2026-08-08 11:36:58 on dist-test-slave-zkpd"
server_key: "cc0d8a58b5cbe968f49aefbb50a6a183"
server_key_iv: "b6ab39e4907bd87eff65871c2d89ace7"
server_key_version: "encryptionkey@0"
I20260808 11:36:58.205843 17395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "f445f357fc88463e9a6510c4f3bb05da"
format_stamp: "Formatted at 2026-08-08 11:36:58 on dist-test-slave-zkpd"
server_key: "cc0d8a58b5cbe968f49aefbb50a6a183"
server_key_iv: "b6ab39e4907bd87eff65871c2d89ace7"
server_key_version: "encryptionkey@0"
I20260808 11:36:58.211397 17395 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260808 11:36:58.215006 17411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:36:58.216516 17395 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:36:58.216704 17395 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "f445f357fc88463e9a6510c4f3bb05da"
format_stamp: "Formatted at 2026-08-08 11:36:58 on dist-test-slave-zkpd"
server_key: "cc0d8a58b5cbe968f49aefbb50a6a183"
server_key_iv: "b6ab39e4907bd87eff65871c2d89ace7"
server_key_version: "encryptionkey@0"
I20260808 11:36:58.216917 17395 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:36:58.303646 17395 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:36:58.308211 17395 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:36:58.308555 17395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:36:58.328217 17395 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:45975
I20260808 11:36:58.328248 17465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:45975 every 8 connection(s)
I20260808 11:36:58.329617 17395 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:36:58.333267 17466 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:36:58.337220 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 17395
I20260808 11:36:58.337423 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:36:58.337872 26890 external_mini_cluster.cc:1428] Setting key e627a0729fe1c342deb0c5917a8c8ba9
I20260808 11:36:58.346976 17466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f445f357fc88463e9a6510c4f3bb05da: Bootstrap starting.
I20260808 11:36:58.350787 17466 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f445f357fc88463e9a6510c4f3bb05da: Neither blocks nor log segments found. Creating new log.
I20260808 11:36:58.352188 17466 log.cc:824] T 00000000000000000000000000000000 P f445f357fc88463e9a6510c4f3bb05da: Log is configured to *not* fsync() on all Append() calls
I20260808 11:36:58.352897 17469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:58.339835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41265 (local address 127.26.66.190:45975)
0808 11:36:58.340705 (+ 870us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:58.340721 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:58.340772 (+ 51us) server_negotiation.cc:407] Connection header received
0808 11:36:58.342509 (+ 1737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:58.342542 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:58.343066 (+ 524us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:58.343501 (+ 435us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:58.344074 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:58.346108 (+ 2034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:58.347477 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:58.348498 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:58.348727 (+ 229us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:58.349876 (+ 1149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:58.349888 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:58.349905 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:58.350592 (+ 687us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:58.350693 (+ 101us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:58.350731 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:58.350890 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:58.351237 (+ 347us) server_negotiation.cc:299] Negotiation successful
0808 11:36:58.351436 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":621,"thread_start_us":327,"threads_started":1}
I20260808 11:36:58.355223 17466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f445f357fc88463e9a6510c4f3bb05da: No bootstrap required, opened a new log
I20260808 11:36:58.356897 26890 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 11:36:58.365718 17466 raft_consensus.cc:348] T 00000000000000000000000000000000 P f445f357fc88463e9a6510c4f3bb05da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f445f357fc88463e9a6510c4f3bb05da" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45975 } }
I20260808 11:36:58.366189 17466 raft_consensus.cc:374] T 00000000000000000000000000000000 P f445f357fc88463e9a6510c4f3bb05da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:36:58.366297 17466 raft_consensus.cc:729] T 00000000000000000000000000000000 P f445f357fc88463e9a6510c4f3bb05da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f445f357fc88463e9a6510c4f3bb05da, State: Initialized, Role: FOLLOWER
I20260808 11:36:58.366916 17466 consensus_queue.cc:260] T 00000000000000000000000000000000 P f445f357fc88463e9a6510c4f3bb05da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f445f357fc88463e9a6510c4f3bb05da" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45975 } }
I20260808 11:36:58.367177 17466 raft_consensus.cc:388] T 00000000000000000000000000000000 P f445f357fc88463e9a6510c4f3bb05da [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:36:58.367352 17466 raft_consensus.cc:482] T 00000000000000000000000000000000 P f445f357fc88463e9a6510c4f3bb05da [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:36:58.367532 17466 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f445f357fc88463e9a6510c4f3bb05da [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:36:58.369379 17469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:36:58.362302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38611 (local address 127.26.66.190:45975)
0808 11:36:58.362552 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0808 11:36:58.362558 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:36:58.362942 (+ 384us) server_negotiation.cc:407] Connection header received
0808 11:36:58.363125 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:36:58.363129 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:36:58.363190 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:36:58.363276 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:36:58.363873 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:58.364717 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:58.366619 (+ 1902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:36:58.367134 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:36:58.367285 (+ 151us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:36:58.368607 (+ 1322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:36:58.368612 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:36:58.368615 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:36:58.368633 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:36:58.368673 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:36:58.368689 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:36:58.368832 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 11:36:58.369038 (+ 206us) server_negotiation.cc:299] Negotiation successful
0808 11:36:58.369096 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 11:36:58.370352 17466 raft_consensus.cc:504] T 00000000000000000000000000000000 P f445f357fc88463e9a6510c4f3bb05da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f445f357fc88463e9a6510c4f3bb05da" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45975 } }
I20260808 11:36:58.370921 17466 leader_election.cc:302] T 00000000000000000000000000000000 P f445f357fc88463e9a6510c4f3bb05da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f445f357fc88463e9a6510c4f3bb05da; no voters:
I20260808 11:36:58.371587 17466 leader_election.cc:288] T 00000000000000000000000000000000 P f445f357fc88463e9a6510c4f3bb05da [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:36:58.371707 17476 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f445f357fc88463e9a6510c4f3bb05da [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:36:58.372479 17476 raft_consensus.cc:686] T 00000000000000000000000000000000 P f445f357fc88463e9a6510c4f3bb05da [term 1 LEADER]: Becoming Leader. State: Replica: f445f357fc88463e9a6510c4f3bb05da, State: Running, Role: LEADER
I20260808 11:36:58.373055 17476 consensus_queue.cc:237] T 00000000000000000000000000000000 P f445f357fc88463e9a6510c4f3bb05da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f445f357fc88463e9a6510c4f3bb05da" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45975 } }
I20260808 11:36:58.373780 17466 sys_catalog.cc:564] T 00000000000000000000000000000000 P f445f357fc88463e9a6510c4f3bb05da [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:36:58.376077 17477 sys_catalog.cc:455] T 00000000000000000000000000000000 P f445f357fc88463e9a6510c4f3bb05da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f445f357fc88463e9a6510c4f3bb05da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f445f357fc88463e9a6510c4f3bb05da" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45975 } } }
I20260808 11:36:58.376572 17477 sys_catalog.cc:458] T 00000000000000000000000000000000 P f445f357fc88463e9a6510c4f3bb05da [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:58.377249 17478 sys_catalog.cc:455] T 00000000000000000000000000000000 P f445f357fc88463e9a6510c4f3bb05da [sys.catalog]: SysCatalogTable state changed. Reason: New leader f445f357fc88463e9a6510c4f3bb05da. Latest consensus state: current_term: 1 leader_uuid: "f445f357fc88463e9a6510c4f3bb05da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f445f357fc88463e9a6510c4f3bb05da" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45975 } } }
I20260808 11:36:58.377465 17483 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:36:58.377563 17478 sys_catalog.cc:458] T 00000000000000000000000000000000 P f445f357fc88463e9a6510c4f3bb05da [sys.catalog]: This master's current role is: LEADER
I20260808 11:36:58.383388 17483 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:36:58.393841 17483 catalog_manager.cc:1347] Generated new cluster ID: d08ab116c00448bd80b59809fe0d3f41
I20260808 11:36:58.393966 17483 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:36:58.408896 17483 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:36:58.410137 17483 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:36:58.422222 17483 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f445f357fc88463e9a6510c4f3bb05da: Generated new TSK 0
I20260808 11:36:58.423243 17483 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:36:58.438300 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 17395
W20260808 11:36:58.439466 17461 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:41265
W20260808 11:36:58.440301 26890 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 17395: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 11:36:58.440466 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 17395
W20260808 11:36:58.462221 17380 connection.cc:535] client connection to 127.26.66.190:45975 recv error: Network error: failed to read from TLS socket (remote: 127.26.66.190:45975): Connection reset by peer (error 104)
2026-08-08T11:36:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2164 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:36:58 dist-test-slave-zkpd krb5kdc[17498](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:36:58 dist-test-slave-zkpd krb5kdc[17498](info): set up 2 sockets
Aug 08 11:36:58 dist-test-slave-zkpd krb5kdc[17498](info): commencing operation
krb5kdc: starting...
W20260808 11:36:59.616631 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.136s user 0.004s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:36:59 dist-test-slave-zkpd krb5kdc[17498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:36:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:36:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:36:59.967012 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:45359
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:45213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:45359
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:37:00.317911 17511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:37:00.318192 17511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:37:00.318375 17511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:37:00.325402 17511 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:37:00.325503 17511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:37:00.325592 17511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:37:00.325708 17511 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:37:00.325769 17511 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:37:00.335297 17511 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:45359
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:45359
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:37:00.336545 17511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:37:00.337855 17511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:37:00.349793 17516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:37:00.349742 17519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:37:00.349843 17517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:37:00.350793 17511 server_base.cc:1034] running on GCE node
I20260808 11:37:00.351584 17511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:37:00.353058 17511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:37:00.354271 17511 hybrid_clock.cc:648] HybridClock initialized: now 1786189020354231 us; error 28 us; skew 500 ppm
I20260808 11:37:00.354638 17511 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:37:00 dist-test-slave-zkpd krb5kdc[17498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189020, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:37:00.357867 17511 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:37:00.359493 17511 webserver.cc:460] Webserver started at http://127.26.66.190:39293/ using document root <none> and password file <none>
I20260808 11:37:00.360357 17511 fs_manager.cc:359] Metadata directory not provided
I20260808 11:37:00.360504 17511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:37:00.360821 17511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:37:00.363746 17511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "fac45afb861f48e2b87cc1b7a3f5a695"
format_stamp: "Formatted at 2026-08-08 11:37:00 on dist-test-slave-zkpd"
server_key: "8cafcc6c98f0af93c42fcb9fc3096003"
server_key_iv: "3113131ab86845f7a59557af051fa4ac"
server_key_version: "encryptionkey@0"
I20260808 11:37:00.364596 17511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "fac45afb861f48e2b87cc1b7a3f5a695"
format_stamp: "Formatted at 2026-08-08 11:37:00 on dist-test-slave-zkpd"
server_key: "8cafcc6c98f0af93c42fcb9fc3096003"
server_key_iv: "3113131ab86845f7a59557af051fa4ac"
server_key_version: "encryptionkey@0"
I20260808 11:37:00.369781 17511 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260808 11:37:00.373334 17527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:37:00.374830 17511 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:37:00.375017 17511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "fac45afb861f48e2b87cc1b7a3f5a695"
format_stamp: "Formatted at 2026-08-08 11:37:00 on dist-test-slave-zkpd"
server_key: "8cafcc6c98f0af93c42fcb9fc3096003"
server_key_iv: "3113131ab86845f7a59557af051fa4ac"
server_key_version: "encryptionkey@0"
I20260808 11:37:00.375228 17511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:37:00.380955 17511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:37:00.384986 17511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:37:00.385295 17511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:37:00.403467 17511 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:45359
I20260808 11:37:00.403504 17583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:45359 every 8 connection(s)
I20260808 11:37:00.404932 17511 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:37:00.408648 17584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:37:00.410876 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 17511
I20260808 11:37:00.411068 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:37:00.411636 26890 external_mini_cluster.cc:1428] Setting key a685e646b2da85b9ee05e1b5e9234a29
I20260808 11:37:00.420285 17587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:00.413507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49675 (local address 127.26.66.190:45359)
0808 11:37:00.415034 (+ 1527us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:00.415045 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:00.415085 (+ 40us) server_negotiation.cc:407] Connection header received
0808 11:37:00.416803 (+ 1718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:00.416825 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:00.417166 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:00.417502 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:00.418611 (+ 1109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:00.418617 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:00.418629 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:37:00.418645 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:00.418753 (+ 108us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:37:00.418776 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:00.418960 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:00.419055 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 11:37:00.419276 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1312,"thread_start_us":1103,"threads_started":1}
I20260808 11:37:00.421036 17584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fac45afb861f48e2b87cc1b7a3f5a695: Bootstrap starting.
I20260808 11:37:00.424386 26890 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 11:37:00.424908 17584 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fac45afb861f48e2b87cc1b7a3f5a695: Neither blocks nor log segments found. Creating new log.
I20260808 11:37:00.426155 17584 log.cc:824] T 00000000000000000000000000000000 P fac45afb861f48e2b87cc1b7a3f5a695: Log is configured to *not* fsync() on all Append() calls
I20260808 11:37:00.429612 17584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fac45afb861f48e2b87cc1b7a3f5a695: No bootstrap required, opened a new log
I20260808 11:37:00.432387 17587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:00.429639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40243 (local address 127.26.66.190:45359)
0808 11:37:00.429872 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:00.429880 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:00.430348 (+ 468us) server_negotiation.cc:407] Connection header received
0808 11:37:00.430523 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:00.430527 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:00.430579 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:00.430661 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:00.431629 (+ 968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:00.431633 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:00.431636 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:37:00.431651 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:00.431691 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:37:00.431706 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:00.431806 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:00.431994 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 11:37:00.432048 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 11:37:00.438846 17584 raft_consensus.cc:348] T 00000000000000000000000000000000 P fac45afb861f48e2b87cc1b7a3f5a695 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fac45afb861f48e2b87cc1b7a3f5a695" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45359 } }
I20260808 11:37:00.439234 17584 raft_consensus.cc:374] T 00000000000000000000000000000000 P fac45afb861f48e2b87cc1b7a3f5a695 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:37:00.439352 17584 raft_consensus.cc:729] T 00000000000000000000000000000000 P fac45afb861f48e2b87cc1b7a3f5a695 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac45afb861f48e2b87cc1b7a3f5a695, State: Initialized, Role: FOLLOWER
I20260808 11:37:00.439980 17584 consensus_queue.cc:260] T 00000000000000000000000000000000 P fac45afb861f48e2b87cc1b7a3f5a695 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fac45afb861f48e2b87cc1b7a3f5a695" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45359 } }
I20260808 11:37:00.440235 17584 raft_consensus.cc:388] T 00000000000000000000000000000000 P fac45afb861f48e2b87cc1b7a3f5a695 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:37:00.440397 17584 raft_consensus.cc:482] T 00000000000000000000000000000000 P fac45afb861f48e2b87cc1b7a3f5a695 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:37:00.440572 17584 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fac45afb861f48e2b87cc1b7a3f5a695 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:37:00.442862 17584 raft_consensus.cc:504] T 00000000000000000000000000000000 P fac45afb861f48e2b87cc1b7a3f5a695 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fac45afb861f48e2b87cc1b7a3f5a695" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45359 } }
I20260808 11:37:00.443368 17584 leader_election.cc:302] T 00000000000000000000000000000000 P fac45afb861f48e2b87cc1b7a3f5a695 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fac45afb861f48e2b87cc1b7a3f5a695; no voters:
I20260808 11:37:00.444098 17584 leader_election.cc:288] T 00000000000000000000000000000000 P fac45afb861f48e2b87cc1b7a3f5a695 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:37:00.444257 17594 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fac45afb861f48e2b87cc1b7a3f5a695 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:37:00.445080 17594 raft_consensus.cc:686] T 00000000000000000000000000000000 P fac45afb861f48e2b87cc1b7a3f5a695 [term 1 LEADER]: Becoming Leader. State: Replica: fac45afb861f48e2b87cc1b7a3f5a695, State: Running, Role: LEADER
I20260808 11:37:00.445657 17594 consensus_queue.cc:237] T 00000000000000000000000000000000 P fac45afb861f48e2b87cc1b7a3f5a695 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fac45afb861f48e2b87cc1b7a3f5a695" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45359 } }
I20260808 11:37:00.446218 17584 sys_catalog.cc:564] T 00000000000000000000000000000000 P fac45afb861f48e2b87cc1b7a3f5a695 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:37:00.448504 17595 sys_catalog.cc:455] T 00000000000000000000000000000000 P fac45afb861f48e2b87cc1b7a3f5a695 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fac45afb861f48e2b87cc1b7a3f5a695" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fac45afb861f48e2b87cc1b7a3f5a695" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45359 } } }
I20260808 11:37:00.448905 17595 sys_catalog.cc:458] T 00000000000000000000000000000000 P fac45afb861f48e2b87cc1b7a3f5a695 [sys.catalog]: This master's current role is: LEADER
I20260808 11:37:00.449453 17596 sys_catalog.cc:455] T 00000000000000000000000000000000 P fac45afb861f48e2b87cc1b7a3f5a695 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fac45afb861f48e2b87cc1b7a3f5a695. Latest consensus state: current_term: 1 leader_uuid: "fac45afb861f48e2b87cc1b7a3f5a695" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fac45afb861f48e2b87cc1b7a3f5a695" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45359 } } }
I20260808 11:37:00.449795 17596 sys_catalog.cc:458] T 00000000000000000000000000000000 P fac45afb861f48e2b87cc1b7a3f5a695 [sys.catalog]: This master's current role is: LEADER
I20260808 11:37:00.450055 17601 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:37:00.460197 17601 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:37:00.469025 17601 catalog_manager.cc:1347] Generated new cluster ID: 382a1d2b72184da09cbf7879f833200d
I20260808 11:37:00.469223 17601 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:37:00.482736 17601 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:37:00.483211 17601 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:37:00.492817 17601 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fac45afb861f48e2b87cc1b7a3f5a695: Generated new TSK 0
I20260808 11:37:00.493769 17601 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:37:00.501978 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 17511
W20260808 11:37:00.503540 17578 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:49675
W20260808 11:37:00.504302 26890 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 17511: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 11:37:00.504453 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 17511
2026-08-08T11:37:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2064 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:37:00 dist-test-slave-zkpd krb5kdc[17616](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:37:00 dist-test-slave-zkpd krb5kdc[17616](info): set up 2 sockets
Aug 08 11:37:00 dist-test-slave-zkpd krb5kdc[17616](info): commencing operation
krb5kdc: starting...
W20260808 11:37:01.686384 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.004s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:37:01 dist-test-slave-zkpd krb5kdc[17616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:37:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:37:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:37:02.039170 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:40159
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:36511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:40159
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:37:02.392331 17632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:37:02.392670 17632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:37:02.392846 17632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:37:02.400127 17632 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:37:02.400285 17632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:37:02.400388 17632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:37:02.400501 17632 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:37:02.400604 17632 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:37:02.410564 17632 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:36511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:40159
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:40159
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:37:02.411952 17632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:37:02.413306 17632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:37:02.425386 17638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:37:02.425354 17641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:37:02.425300 17639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:37:02.426321 17632 server_base.cc:1034] running on GCE node
I20260808 11:37:02.427126 17632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:37:02.428630 17632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:37:02.429850 17632 hybrid_clock.cc:648] HybridClock initialized: now 1786189022429807 us; error 35 us; skew 500 ppm
I20260808 11:37:02.430286 17632 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:37:02 dist-test-slave-zkpd krb5kdc[17616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189022, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:37:02.438225 17632 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:37:02.439765 17632 webserver.cc:460] Webserver started at http://127.26.66.190:44275/ using document root <none> and password file <none>
I20260808 11:37:02.440510 17632 fs_manager.cc:359] Metadata directory not provided
I20260808 11:37:02.440670 17632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:37:02.441006 17632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:37:02.444110 17632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "36d5945bdfc8444aadd8a1d8a8485523"
format_stamp: "Formatted at 2026-08-08 11:37:02 on dist-test-slave-zkpd"
server_key: "a03bf6a0c5b7894890a44e9ebdf85d51"
server_key_iv: "860c97b052eb8f5ce92ae67d44b20e74"
server_key_version: "encryptionkey@0"
I20260808 11:37:02.444906 17632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "36d5945bdfc8444aadd8a1d8a8485523"
format_stamp: "Formatted at 2026-08-08 11:37:02 on dist-test-slave-zkpd"
server_key: "a03bf6a0c5b7894890a44e9ebdf85d51"
server_key_iv: "860c97b052eb8f5ce92ae67d44b20e74"
server_key_version: "encryptionkey@0"
I20260808 11:37:02.450132 17632 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 11:37:02.453792 17648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:37:02.455080 17632 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 11:37:02.455277 17632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "36d5945bdfc8444aadd8a1d8a8485523"
format_stamp: "Formatted at 2026-08-08 11:37:02 on dist-test-slave-zkpd"
server_key: "a03bf6a0c5b7894890a44e9ebdf85d51"
server_key_iv: "860c97b052eb8f5ce92ae67d44b20e74"
server_key_version: "encryptionkey@0"
I20260808 11:37:02.455474 17632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:37:02.479570 17632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:37:02.484107 17632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:37:02.484411 17632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:37:02.503401 17632 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:40159
I20260808 11:37:02.503432 17701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:40159 every 8 connection(s)
I20260808 11:37:02.504843 17632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:37:02.508595 17702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:37:02.512627 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 17632
I20260808 11:37:02.512832 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:37:02.513386 26890 external_mini_cluster.cc:1428] Setting key 8a11dc8aef9da362ba8e64b497d2777b
I20260808 11:37:02.521777 17702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36d5945bdfc8444aadd8a1d8a8485523: Bootstrap starting.
I20260808 11:37:02.525620 17702 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 36d5945bdfc8444aadd8a1d8a8485523: Neither blocks nor log segments found. Creating new log.
I20260808 11:37:02.526971 17702 log.cc:824] T 00000000000000000000000000000000 P 36d5945bdfc8444aadd8a1d8a8485523: Log is configured to *not* fsync() on all Append() calls
Aug 08 11:37:02 dist-test-slave-zkpd krb5kdc[17616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:37:02.529947 17702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36d5945bdfc8444aadd8a1d8a8485523: No bootstrap required, opened a new log
I20260808 11:37:02.536990 17705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:02.515240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34605 (local address 127.26.66.190:40159)
0808 11:37:02.516032 (+ 792us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:02.516042 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:02.516082 (+ 40us) server_negotiation.cc:407] Connection header received
0808 11:37:02.517648 (+ 1566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:02.517669 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:02.518054 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:02.518383 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:02.520263 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:02.521612 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:02.523454 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:02.524180 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:02.524328 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:02.529555 (+ 5227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:02.529563 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:02.529577 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:02.529612 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:02.532898 (+ 3286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:02.533600 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:02.533616 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:02.533622 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:02.533795 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:02.534219 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:02.534227 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:02.534230 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:02.534750 (+ 520us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:02.535084 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:02.535541 (+ 457us) server_negotiation.cc:299] Negotiation successful
0808 11:37:02.536014 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":371,"threads_started":1}
I20260808 11:37:02.537997 17702 raft_consensus.cc:348] T 00000000000000000000000000000000 P 36d5945bdfc8444aadd8a1d8a8485523 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36d5945bdfc8444aadd8a1d8a8485523" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 40159 } }
I20260808 11:37:02.538371 17702 raft_consensus.cc:374] T 00000000000000000000000000000000 P 36d5945bdfc8444aadd8a1d8a8485523 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:37:02.538496 17702 raft_consensus.cc:729] T 00000000000000000000000000000000 P 36d5945bdfc8444aadd8a1d8a8485523 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36d5945bdfc8444aadd8a1d8a8485523, State: Initialized, Role: FOLLOWER
I20260808 11:37:02.539106 17702 consensus_queue.cc:260] T 00000000000000000000000000000000 P 36d5945bdfc8444aadd8a1d8a8485523 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36d5945bdfc8444aadd8a1d8a8485523" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 40159 } }
I20260808 11:37:02.539391 17702 raft_consensus.cc:388] T 00000000000000000000000000000000 P 36d5945bdfc8444aadd8a1d8a8485523 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:37:02.539544 17702 raft_consensus.cc:482] T 00000000000000000000000000000000 P 36d5945bdfc8444aadd8a1d8a8485523 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:37:02.539731 17702 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 36d5945bdfc8444aadd8a1d8a8485523 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:37:02.540686 26890 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 11:37:02.542122 17702 raft_consensus.cc:504] T 00000000000000000000000000000000 P 36d5945bdfc8444aadd8a1d8a8485523 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36d5945bdfc8444aadd8a1d8a8485523" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 40159 } }
I20260808 11:37:02.542608 17702 leader_election.cc:302] T 00000000000000000000000000000000 P 36d5945bdfc8444aadd8a1d8a8485523 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 36d5945bdfc8444aadd8a1d8a8485523; no voters:
I20260808 11:37:02.543251 17702 leader_election.cc:288] T 00000000000000000000000000000000 P 36d5945bdfc8444aadd8a1d8a8485523 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:37:02.543344 17707 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 36d5945bdfc8444aadd8a1d8a8485523 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:37:02.544718 17707 raft_consensus.cc:686] T 00000000000000000000000000000000 P 36d5945bdfc8444aadd8a1d8a8485523 [term 1 LEADER]: Becoming Leader. State: Replica: 36d5945bdfc8444aadd8a1d8a8485523, State: Running, Role: LEADER
I20260808 11:37:02.545356 17707 consensus_queue.cc:237] T 00000000000000000000000000000000 P 36d5945bdfc8444aadd8a1d8a8485523 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36d5945bdfc8444aadd8a1d8a8485523" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 40159 } }
I20260808 11:37:02.546003 17702 sys_catalog.cc:564] T 00000000000000000000000000000000 P 36d5945bdfc8444aadd8a1d8a8485523 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:37:02.549881 17710 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36d5945bdfc8444aadd8a1d8a8485523 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 36d5945bdfc8444aadd8a1d8a8485523. Latest consensus state: current_term: 1 leader_uuid: "36d5945bdfc8444aadd8a1d8a8485523" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36d5945bdfc8444aadd8a1d8a8485523" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 40159 } } }
I20260808 11:37:02.550293 17710 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36d5945bdfc8444aadd8a1d8a8485523 [sys.catalog]: This master's current role is: LEADER
I20260808 11:37:02.550757 17711 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36d5945bdfc8444aadd8a1d8a8485523 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "36d5945bdfc8444aadd8a1d8a8485523" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36d5945bdfc8444aadd8a1d8a8485523" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 40159 } } }
I20260808 11:37:02.551085 17711 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36d5945bdfc8444aadd8a1d8a8485523 [sys.catalog]: This master's current role is: LEADER
I20260808 11:37:02.570690 17705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:02.547001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36909 (local address 127.26.66.190:40159)
0808 11:37:02.547246 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:02.547255 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:02.548602 (+ 1347us) server_negotiation.cc:407] Connection header received
0808 11:37:02.548923 (+ 321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:02.548936 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:02.549040 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:02.549138 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:02.551729 (+ 2591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:02.553251 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:02.555750 (+ 2499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:02.556717 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:02.556850 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:02.561288 (+ 4438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:02.561297 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:02.561305 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:02.561358 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:02.566111 (+ 4753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:02.567320 (+ 1209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:02.567330 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:02.567336 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:02.567551 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:02.568152 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:02.568160 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:02.568166 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:02.568739 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:02.569024 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:02.569825 (+ 801us) server_negotiation.cc:299] Negotiation successful
0808 11:37:02.570140 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 11:37:02.573956 17717 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:37:02.579708 17717 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:37:02.589162 17717 catalog_manager.cc:1347] Generated new cluster ID: 11f2509b9f7d437ab97c912464c51298
I20260808 11:37:02.589336 17717 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:37:02.602262 17717 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:37:02.603543 17717 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:37:02.610991 17717 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 36d5945bdfc8444aadd8a1d8a8485523: Generated new TSK 0
I20260808 11:37:02.611788 17717 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:37:02.617344 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 17632
I20260808 11:37:02.619041 17697 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:37:02.709702 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 17632
2026-08-08T11:37:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2202 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:37:02 dist-test-slave-zkpd krb5kdc[17736](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:37:02 dist-test-slave-zkpd krb5kdc[17736](info): set up 2 sockets
Aug 08 11:37:02 dist-test-slave-zkpd krb5kdc[17736](info): commencing operation
krb5kdc: starting...
W20260808 11:37:03.877859 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.003s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:37:04 dist-test-slave-zkpd krb5kdc[17736](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:37:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:37:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:37:04.221058 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:43569
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:46875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:43569
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:37:04.567616 17749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:37:04.567910 17749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:37:04.568112 17749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:37:04.575120 17749 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:37:04.575219 17749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:37:04.575304 17749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:37:04.575403 17749 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:37:04.575469 17749 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:37:04.585081 17749 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:46875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:43569
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:43569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:37:04.586320 17749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:37:04.587683 17749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:37:04.599591 17754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:37:04.599696 17757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:37:04.599704 17755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:37:04.600559 17749 server_base.cc:1034] running on GCE node
I20260808 11:37:04.601313 17749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:37:04.602659 17749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:37:04.603941 17749 hybrid_clock.cc:648] HybridClock initialized: now 1786189024603870 us; error 48 us; skew 500 ppm
I20260808 11:37:04.604394 17749 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:37:04 dist-test-slave-zkpd krb5kdc[17736](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189024, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:37:04.609073 17749 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:37:04.610759 17749 webserver.cc:460] Webserver started at http://127.26.66.190:44413/ using document root <none> and password file <none>
I20260808 11:37:04.611594 17749 fs_manager.cc:359] Metadata directory not provided
I20260808 11:37:04.611747 17749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:37:04.612155 17749 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:37:04.615688 17749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "253df9bba13f4e77b1976c3963059953"
format_stamp: "Formatted at 2026-08-08 11:37:04 on dist-test-slave-zkpd"
server_key: "ff383c3075f5e96f66c80b6a95e7d3d6"
server_key_iv: "f38a757153d2d385f40461805ce7a749"
server_key_version: "encryptionkey@0"
I20260808 11:37:04.616508 17749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "253df9bba13f4e77b1976c3963059953"
format_stamp: "Formatted at 2026-08-08 11:37:04 on dist-test-slave-zkpd"
server_key: "ff383c3075f5e96f66c80b6a95e7d3d6"
server_key_iv: "f38a757153d2d385f40461805ce7a749"
server_key_version: "encryptionkey@0"
I20260808 11:37:04.621593 17749 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260808 11:37:04.625083 17764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:37:04.626434 17749 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260808 11:37:04.626621 17749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "253df9bba13f4e77b1976c3963059953"
format_stamp: "Formatted at 2026-08-08 11:37:04 on dist-test-slave-zkpd"
server_key: "ff383c3075f5e96f66c80b6a95e7d3d6"
server_key_iv: "f38a757153d2d385f40461805ce7a749"
server_key_version: "encryptionkey@0"
I20260808 11:37:04.626838 17749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:37:04.646031 17749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:37:04.650157 17749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:37:04.650439 17749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:37:04.668927 17749 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:43569
I20260808 11:37:04.668958 17818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:43569 every 8 connection(s)
I20260808 11:37:04.670258 17749 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:37:04.673851 17819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:37:04.675045 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 17749
I20260808 11:37:04.675228 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:37:04.675685 26890 external_mini_cluster.cc:1428] Setting key d512161a5fdfc3454ce22140bfcdf9fc
I20260808 11:37:04.687788 17819 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 253df9bba13f4e77b1976c3963059953: Bootstrap starting.
I20260808 11:37:04.689312 17822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:04.677577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33357 (local address 127.26.66.190:43569)
0808 11:37:04.678458 (+ 881us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:04.678472 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:04.678514 (+ 42us) server_negotiation.cc:407] Connection header received
0808 11:37:04.680193 (+ 1679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:04.680217 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:04.680617 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:04.680939 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:04.681574 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:04.682851 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:04.684859 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:04.685564 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:04.685698 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:04.687019 (+ 1321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:04.687026 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:04.687040 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:37:04.687568 (+ 528us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:04.687646 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:37:04.687671 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:04.687770 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:04.688060 (+ 290us) server_negotiation.cc:299] Negotiation successful
0808 11:37:04.688378 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":412,"threads_started":1}
I20260808 11:37:04.691063 17819 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 253df9bba13f4e77b1976c3963059953: Neither blocks nor log segments found. Creating new log.
I20260808 11:37:04.692342 17819 log.cc:824] T 00000000000000000000000000000000 P 253df9bba13f4e77b1976c3963059953: Log is configured to *not* fsync() on all Append() calls
I20260808 11:37:04.693032 26890 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 11:37:04.695012 17819 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 253df9bba13f4e77b1976c3963059953: No bootstrap required, opened a new log
I20260808 11:37:04.704033 17822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:04.697396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33893 (local address 127.26.66.190:43569)
0808 11:37:04.697628 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:04.697637 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:04.698034 (+ 397us) server_negotiation.cc:407] Connection header received
0808 11:37:04.698190 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:04.698193 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:04.698251 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:04.698334 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:04.698907 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:04.699609 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:04.701604 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:04.702079 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:04.702170 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:04.703276 (+ 1106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:04.703280 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:04.703283 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:37:04.703300 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:04.703352 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:37:04.703367 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:04.703441 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:04.703599 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 11:37:04.703665 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 11:37:04.704802 17819 raft_consensus.cc:348] T 00000000000000000000000000000000 P 253df9bba13f4e77b1976c3963059953 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "253df9bba13f4e77b1976c3963059953" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 43569 } }
I20260808 11:37:04.705168 17819 raft_consensus.cc:374] T 00000000000000000000000000000000 P 253df9bba13f4e77b1976c3963059953 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:37:04.705279 17819 raft_consensus.cc:729] T 00000000000000000000000000000000 P 253df9bba13f4e77b1976c3963059953 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 253df9bba13f4e77b1976c3963059953, State: Initialized, Role: FOLLOWER
I20260808 11:37:04.705825 17819 consensus_queue.cc:260] T 00000000000000000000000000000000 P 253df9bba13f4e77b1976c3963059953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "253df9bba13f4e77b1976c3963059953" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 43569 } }
I20260808 11:37:04.706071 17819 raft_consensus.cc:388] T 00000000000000000000000000000000 P 253df9bba13f4e77b1976c3963059953 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:37:04.706210 17819 raft_consensus.cc:482] T 00000000000000000000000000000000 P 253df9bba13f4e77b1976c3963059953 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:37:04.706394 17819 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 253df9bba13f4e77b1976c3963059953 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:37:04.708622 17819 raft_consensus.cc:504] T 00000000000000000000000000000000 P 253df9bba13f4e77b1976c3963059953 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "253df9bba13f4e77b1976c3963059953" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 43569 } }
I20260808 11:37:04.709118 17819 leader_election.cc:302] T 00000000000000000000000000000000 P 253df9bba13f4e77b1976c3963059953 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 253df9bba13f4e77b1976c3963059953; no voters:
I20260808 11:37:04.709723 17819 leader_election.cc:288] T 00000000000000000000000000000000 P 253df9bba13f4e77b1976c3963059953 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:37:04.709870 17829 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 253df9bba13f4e77b1976c3963059953 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:37:04.710565 17829 raft_consensus.cc:686] T 00000000000000000000000000000000 P 253df9bba13f4e77b1976c3963059953 [term 1 LEADER]: Becoming Leader. State: Replica: 253df9bba13f4e77b1976c3963059953, State: Running, Role: LEADER
I20260808 11:37:04.711163 17829 consensus_queue.cc:237] T 00000000000000000000000000000000 P 253df9bba13f4e77b1976c3963059953 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "253df9bba13f4e77b1976c3963059953" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 43569 } }
I20260808 11:37:04.712015 17819 sys_catalog.cc:564] T 00000000000000000000000000000000 P 253df9bba13f4e77b1976c3963059953 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:37:04.714547 17831 sys_catalog.cc:455] T 00000000000000000000000000000000 P 253df9bba13f4e77b1976c3963059953 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 253df9bba13f4e77b1976c3963059953. Latest consensus state: current_term: 1 leader_uuid: "253df9bba13f4e77b1976c3963059953" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "253df9bba13f4e77b1976c3963059953" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 43569 } } }
I20260808 11:37:04.714524 17830 sys_catalog.cc:455] T 00000000000000000000000000000000 P 253df9bba13f4e77b1976c3963059953 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "253df9bba13f4e77b1976c3963059953" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "253df9bba13f4e77b1976c3963059953" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 43569 } } }
I20260808 11:37:04.715396 17831 sys_catalog.cc:458] T 00000000000000000000000000000000 P 253df9bba13f4e77b1976c3963059953 [sys.catalog]: This master's current role is: LEADER
I20260808 11:37:04.715461 17830 sys_catalog.cc:458] T 00000000000000000000000000000000 P 253df9bba13f4e77b1976c3963059953 [sys.catalog]: This master's current role is: LEADER
I20260808 11:37:04.716452 17838 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:37:04.721765 17838 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:37:04.730418 17838 catalog_manager.cc:1347] Generated new cluster ID: 752de2c488b949558ea7584a43f6c385
I20260808 11:37:04.730526 17838 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:37:04.754321 17838 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:37:04.756225 17838 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:37:04.771488 17838 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 253df9bba13f4e77b1976c3963059953: Generated new TSK 0
I20260808 11:37:04.772420 17838 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:37:04.781611 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 17749
W20260808 11:37:04.782855 17814 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:33357
W20260808 11:37:04.783598 26890 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 17749: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 11:37:04.783748 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 17749
2026-08-08T11:37:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2075 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:37:04 dist-test-slave-zkpd krb5kdc[17850](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:37:04 dist-test-slave-zkpd krb5kdc[17850](info): set up 2 sockets
Aug 08 11:37:04 dist-test-slave-zkpd krb5kdc[17850](info): commencing operation
krb5kdc: starting...
W20260808 11:37:05.950069 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.001s sys 0.056s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:37:06 dist-test-slave-zkpd krb5kdc[17850](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:37:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:37:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:37:06.291067 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:45183
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:45743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:45183
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:37:06.644694 17864 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:37:06.645066 17864 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:37:06.645228 17864 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:37:06.658919 17864 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:37:06.659078 17864 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:37:06.659178 17864 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:37:06.659283 17864 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:37:06.659364 17864 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:37:06.673938 17864 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:45743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:45183
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:45183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:37:06.675171 17864 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:37:06.676482 17864 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:37:06.687907 17869 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:37:06.688015 17870 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:37:06.688126 17872 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:37:06.689459 17864 server_base.cc:1034] running on GCE node
I20260808 11:37:06.690135 17864 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:37:06.691397 17864 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:37:06.692619 17864 hybrid_clock.cc:648] HybridClock initialized: now 1786189026692581 us; error 44 us; skew 500 ppm
I20260808 11:37:06.692953 17864 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:37:06 dist-test-slave-zkpd krb5kdc[17850](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189026, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:37:06.695971 17864 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:37:06.697418 17864 webserver.cc:460] Webserver started at http://127.26.66.190:42953/ using document root <none> and password file <none>
I20260808 11:37:06.698081 17864 fs_manager.cc:359] Metadata directory not provided
I20260808 11:37:06.698220 17864 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:37:06.698523 17864 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:37:06.701470 17864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "d0ac7332ddf1458ab56043cd6bb0714b"
format_stamp: "Formatted at 2026-08-08 11:37:06 on dist-test-slave-zkpd"
server_key: "d7ada9d1de929c9def1c69703f1db94c"
server_key_iv: "5b843bb1c748bfd6e392c696550db75b"
server_key_version: "encryptionkey@0"
I20260808 11:37:06.702186 17864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "d0ac7332ddf1458ab56043cd6bb0714b"
format_stamp: "Formatted at 2026-08-08 11:37:06 on dist-test-slave-zkpd"
server_key: "d7ada9d1de929c9def1c69703f1db94c"
server_key_iv: "5b843bb1c748bfd6e392c696550db75b"
server_key_version: "encryptionkey@0"
I20260808 11:37:06.707134 17864 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 11:37:06.710486 17880 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:37:06.711701 17864 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 11:37:06.711874 17864 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "d0ac7332ddf1458ab56043cd6bb0714b"
format_stamp: "Formatted at 2026-08-08 11:37:06 on dist-test-slave-zkpd"
server_key: "d7ada9d1de929c9def1c69703f1db94c"
server_key_iv: "5b843bb1c748bfd6e392c696550db75b"
server_key_version: "encryptionkey@0"
I20260808 11:37:06.712144 17864 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:37:06.717792 17864 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:37:06.721668 17864 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:37:06.721961 17864 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:37:06.740650 17864 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:45183
I20260808 11:37:06.740737 17932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:45183 every 8 connection(s)
I20260808 11:37:06.742003 17864 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:37:06.744107 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 17864
I20260808 11:37:06.744314 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:37:06.744864 26890 external_mini_cluster.cc:1428] Setting key fd8783fbf4b8b6b7c536435a15379366
I20260808 11:37:06.746115 17933 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:37:06.752477 17936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:06.746642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57835 (local address 127.26.66.190:45183)
0808 11:37:06.747415 (+ 773us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:06.747427 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:06.747473 (+ 46us) server_negotiation.cc:407] Connection header received
0808 11:37:06.749102 (+ 1629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:06.749123 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:06.749447 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:06.749840 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:06.750842 (+ 1002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:06.750848 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:06.750859 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:37:06.750880 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:06.750951 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:37:06.750972 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:06.751209 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:06.751349 (+ 140us) server_negotiation.cc:299] Negotiation successful
0808 11:37:06.751537 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":560,"thread_start_us":360,"threads_started":1}
I20260808 11:37:06.756001 26890 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 11:37:06.758162 17933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0ac7332ddf1458ab56043cd6bb0714b: Bootstrap starting.
I20260808 11:37:06.761516 17933 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d0ac7332ddf1458ab56043cd6bb0714b: Neither blocks nor log segments found. Creating new log.
I20260808 11:37:06.762760 17936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:06.760327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34949 (local address 127.26.66.190:45183)
0808 11:37:06.760495 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:06.760502 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:06.760907 (+ 405us) server_negotiation.cc:407] Connection header received
0808 11:37:06.761083 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:06.761088 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:06.761143 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:06.761242 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:06.762147 (+ 905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:06.762152 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:06.762157 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 11:37:06.762174 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:06.762217 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 11:37:06.762232 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:06.762384 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:06.762441 (+ 57us) server_negotiation.cc:299] Negotiation successful
0808 11:37:06.762497 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 11:37:06.762751 17933 log.cc:824] T 00000000000000000000000000000000 P d0ac7332ddf1458ab56043cd6bb0714b: Log is configured to *not* fsync() on all Append() calls
I20260808 11:37:06.765591 17933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0ac7332ddf1458ab56043cd6bb0714b: No bootstrap required, opened a new log
I20260808 11:37:06.772881 17933 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0ac7332ddf1458ab56043cd6bb0714b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0ac7332ddf1458ab56043cd6bb0714b" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45183 } }
I20260808 11:37:06.773238 17933 raft_consensus.cc:374] T 00000000000000000000000000000000 P d0ac7332ddf1458ab56043cd6bb0714b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 11:37:06.773350 17933 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0ac7332ddf1458ab56043cd6bb0714b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ac7332ddf1458ab56043cd6bb0714b, State: Initialized, Role: FOLLOWER
I20260808 11:37:06.774003 17933 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0ac7332ddf1458ab56043cd6bb0714b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0ac7332ddf1458ab56043cd6bb0714b" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45183 } }
I20260808 11:37:06.774284 17933 raft_consensus.cc:388] T 00000000000000000000000000000000 P d0ac7332ddf1458ab56043cd6bb0714b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 11:37:06.774446 17933 raft_consensus.cc:482] T 00000000000000000000000000000000 P d0ac7332ddf1458ab56043cd6bb0714b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 11:37:06.774610 17933 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0ac7332ddf1458ab56043cd6bb0714b [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:37:06.776768 17933 raft_consensus.cc:504] T 00000000000000000000000000000000 P d0ac7332ddf1458ab56043cd6bb0714b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0ac7332ddf1458ab56043cd6bb0714b" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45183 } }
I20260808 11:37:06.777241 17933 leader_election.cc:302] T 00000000000000000000000000000000 P d0ac7332ddf1458ab56043cd6bb0714b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d0ac7332ddf1458ab56043cd6bb0714b; no voters:
I20260808 11:37:06.777871 17933 leader_election.cc:288] T 00000000000000000000000000000000 P d0ac7332ddf1458ab56043cd6bb0714b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 11:37:06.777982 17944 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d0ac7332ddf1458ab56043cd6bb0714b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:37:06.779153 17944 raft_consensus.cc:686] T 00000000000000000000000000000000 P d0ac7332ddf1458ab56043cd6bb0714b [term 1 LEADER]: Becoming Leader. State: Replica: d0ac7332ddf1458ab56043cd6bb0714b, State: Running, Role: LEADER
I20260808 11:37:06.779677 17944 consensus_queue.cc:237] T 00000000000000000000000000000000 P d0ac7332ddf1458ab56043cd6bb0714b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0ac7332ddf1458ab56043cd6bb0714b" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45183 } }
I20260808 11:37:06.779966 17933 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0ac7332ddf1458ab56043cd6bb0714b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:37:06.782585 17945 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0ac7332ddf1458ab56043cd6bb0714b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d0ac7332ddf1458ab56043cd6bb0714b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0ac7332ddf1458ab56043cd6bb0714b" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45183 } } }
I20260808 11:37:06.782704 17946 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0ac7332ddf1458ab56043cd6bb0714b [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0ac7332ddf1458ab56043cd6bb0714b. Latest consensus state: current_term: 1 leader_uuid: "d0ac7332ddf1458ab56043cd6bb0714b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0ac7332ddf1458ab56043cd6bb0714b" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 45183 } } }
I20260808 11:37:06.783012 17945 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0ac7332ddf1458ab56043cd6bb0714b [sys.catalog]: This master's current role is: LEADER
I20260808 11:37:06.783097 17946 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0ac7332ddf1458ab56043cd6bb0714b [sys.catalog]: This master's current role is: LEADER
I20260808 11:37:06.786255 17952 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:37:06.791559 17952 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:37:06.800693 17952 catalog_manager.cc:1347] Generated new cluster ID: 0afb80ab3b244ae09679d8cbf22f1787
I20260808 11:37:06.800801 17952 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:37:06.820936 17952 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:37:06.821372 17952 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:37:06.835498 17952 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d0ac7332ddf1458ab56043cd6bb0714b: Generated new TSK 0
I20260808 11:37:06.836393 17952 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 11:37:06.850679 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 17864
W20260808 11:37:06.851807 17928 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:57835
W20260808 11:37:06.852514 26890 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 17864: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 11:37:06.852674 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 17864
2026-08-08T11:37:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2070 ms)
[----------] 18 tests from AuthTokenIssuingTest (38225 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:37:06 dist-test-slave-zkpd krb5kdc[17966](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:37:06 dist-test-slave-zkpd krb5kdc[17966](info): set up 2 sockets
Aug 08 11:37:06 dist-test-slave-zkpd krb5kdc[17966](info): commencing operation
krb5kdc: starting...
W20260808 11:37:08.031436 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.001s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:37:08 dist-test-slave-zkpd krb5kdc[17966](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:37:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:37:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:37:08.390972 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:46179
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:42725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:46179,127.26.66.189:36481,127.26.66.188:34639
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:37:08.731424 17980 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 11:37:08.731758 17980 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:37:08.731894 17980 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:37:08.732038 17980 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:37:08.739106 17980 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:37:08.739193 17980 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:37:08.739286 17980 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:37:08.739389 17980 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:37:08.739481 17980 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:37:08.749138 17980 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:42725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:46179,127.26.66.189:36481,127.26.66.188:34639
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:46179
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:37:08.750380 17980 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:37:08.751693 17980 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:37:08.763404 17985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:37:08.763423 17988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:37:08.763466 17986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:37:08.764287 17980 server_base.cc:1034] running on GCE node
I20260808 11:37:08.765072 17980 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:37:08.766357 17980 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:37:08.767590 17980 hybrid_clock.cc:648] HybridClock initialized: now 1786189028767522 us; error 47 us; skew 500 ppm
I20260808 11:37:08.767977 17980 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:37:08 dist-test-slave-zkpd krb5kdc[17966](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189028, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:37:08.770977 17980 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:37:08.772387 17980 webserver.cc:460] Webserver started at http://127.26.66.190:35433/ using document root <none> and password file <none>
I20260808 11:37:08.773057 17980 fs_manager.cc:359] Metadata directory not provided
I20260808 11:37:08.773183 17980 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:37:08.773494 17980 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:37:08.776463 17980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "af8dacb765bc439392b434395011d4d5"
format_stamp: "Formatted at 2026-08-08 11:37:08 on dist-test-slave-zkpd"
server_key: "a787d63bef6bdba7996f7094754934e0"
server_key_iv: "28165e530d349a3459b379d7de641d81"
server_key_version: "encryptionkey@0"
I20260808 11:37:08.777251 17980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "af8dacb765bc439392b434395011d4d5"
format_stamp: "Formatted at 2026-08-08 11:37:08 on dist-test-slave-zkpd"
server_key: "a787d63bef6bdba7996f7094754934e0"
server_key_iv: "28165e530d349a3459b379d7de641d81"
server_key_version: "encryptionkey@0"
I20260808 11:37:08.782269 17980 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 11:37:08.785624 17996 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:37:08.786836 17980 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 11:37:08.787024 17980 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "af8dacb765bc439392b434395011d4d5"
format_stamp: "Formatted at 2026-08-08 11:37:08 on dist-test-slave-zkpd"
server_key: "a787d63bef6bdba7996f7094754934e0"
server_key_iv: "28165e530d349a3459b379d7de641d81"
server_key_version: "encryptionkey@0"
I20260808 11:37:08.787235 17980 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:37:08.800434 17980 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:37:08.804208 17980 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:37:08.804478 17980 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:37:08.822444 17980 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:46179
I20260808 11:37:08.822467 18049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:46179 every 8 connection(s)
I20260808 11:37:08.823760 17980 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:37:08.827409 18050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:37:08.831616 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 17980
I20260808 11:37:08.831828 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:37:08.832527 26890 external_mini_cluster.cc:1428] Setting key 8dadfc11c541f18db3455abe5f631eca
I20260808 11:37:08.833880 18050 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46179 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 11:37:08 dist-test-slave-zkpd krb5kdc[17966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189028, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:37:08.855705 18054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:08.836754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50686 (local address 127.26.66.190:46179)
0808 11:37:08.838375 (+ 1621us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:08.838384 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:08.838442 (+ 58us) server_negotiation.cc:407] Connection header received
0808 11:37:08.839843 (+ 1401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:08.839848 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:08.840110 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:08.840300 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:08.841574 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:08.842745 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:08.844181 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:08.844698 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:08.844902 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:08.848123 (+ 3221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:08.848138 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:08.848155 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:08.848198 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:08.851554 (+ 3356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:08.852533 (+ 979us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:08.852539 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:08.852541 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:08.852684 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:08.853140 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:08.853143 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:08.853145 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:08.853598 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:08.853791 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:08.854442 (+ 651us) server_negotiation.cc:299] Negotiation successful
0808 11:37:08.854673 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1388,"thread_start_us":1185,"threads_started":1}
I20260808 11:37:08.855742 18053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:08.836753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:46179 (local address 127.0.0.1:50686)
0808 11:37:08.837534 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:08.837590 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 11:37:08.839506 (+ 1916us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:37:08.840351 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:37:08.840357 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:37:08.841043 (+ 686us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:37:08.841362 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:08.841379 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:08.842911 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:08.842916 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:08.844050 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:08.844063 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:08.844933 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:08.844940 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:08.845119 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:08.845731 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:37:08.845753 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:37:08.847821 (+ 2068us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:37:08.851713 (+ 3892us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:08.851730 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:08.851744 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:08.852403 (+ 659us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:08.852804 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:08.852811 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:08.852817 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:08.853028 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:08.853774 (+ 746us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:37:08.853785 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:37:08.854057 (+ 272us) client_negotiation.cc:769] Sending connection context
0808 11:37:08.854315 (+ 258us) client_negotiation.cc:240] Negotiation successful
0808 11:37:08.854904 (+ 589us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"mutex_wait_us":74,"thread_start_us":336,"threads_started":1}
I20260808 11:37:08.858587 18050 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.189" port: 36481 } has no permanent_uuid. Determining permanent_uuid...
I20260808 11:37:08.859589 18053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:08.859226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:36481 (local address 127.0.0.1:37050)
0808 11:37:08.859380 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:08.859483 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:36481: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 11:37:08.859824 17999 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.66.189:36481: connect: Connection refused (error 111)
I20260808 11:37:08.861402 18053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:08.861064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:36481 (local address 127.0.0.1:37060)
0808 11:37:08.861198 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:08.861269 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:36481: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 11:37:08.861621 18050 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.189:36481: Network error: Client connection negotiation failed: client connection to 127.26.66.189:36481: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.26.66.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.189.keytab.
Entry for principal kudu/127.26.66.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.189.keytab.
I20260808 11:37:08.910598 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.189:36481
--webserver_interface=127.26.66.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.189.keytab
--principal=kudu/127.26.66.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:42725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:46179,127.26.66.189:36481,127.26.66.188:34639
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 11:37:08.910934 18050 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.189" port: 36481 } attempt: 1
I20260808 11:37:08.912313 18053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:08.911624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:36481 (local address 127.0.0.1:37074)
0808 11:37:08.911928 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:08.912095 (+ 167us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:36481: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260808 11:37:08.913524 18053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:08.913025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:36481 (local address 127.0.0.1:37084)
0808 11:37:08.913219 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:08.913328 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:36481: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 11:37:08.913785 18050 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.189:36481: Network error: Client connection negotiation failed: client connection to 127.26.66.189:36481: connect: Connection refused (error 111)
I20260808 11:37:08.982074 18050 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.189" port: 36481 } attempt: 2
I20260808 11:37:08.983357 18053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:08.982852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:36481 (local address 127.0.0.1:37086)
0808 11:37:08.983103 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:08.983197 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:36481: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260808 11:37:08.984417 18053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:08.984048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:36481 (local address 127.0.0.1:37098)
0808 11:37:08.984213 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:08.984291 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:36481: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 11:37:08.984604 18050 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.189:36481: Network error: Client connection negotiation failed: client connection to 127.26.66.189:36481: connect: Connection refused (error 111)
I20260808 11:37:09.075862 18050 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.189" port: 36481 } attempt: 3
I20260808 11:37:09.077039 18053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.076600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:36481 (local address 127.0.0.1:37114)
0808 11:37:09.076806 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.076905 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:36481: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260808 11:37:09.078002 18053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.077659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:36481 (local address 127.0.0.1:37120)
0808 11:37:09.077804 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.077875 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:36481: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 11:37:09.078172 18050 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.189:36481: Network error: Client connection negotiation failed: client connection to 127.26.66.189:36481: connect: Connection refused (error 111)
I20260808 11:37:09.221427 18050 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.189" port: 36481 } attempt: 4
I20260808 11:37:09.222637 18053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.222104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:36481 (local address 127.0.0.1:37128)
0808 11:37:09.222417 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.222505 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:36481: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149}
I20260808 11:37:09.223625 18053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.223265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:36481 (local address 127.0.0.1:37138)
0808 11:37:09.223426 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.223504 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:36481: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260808 11:37:09.223814 18050 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.189:36481: Network error: Client connection negotiation failed: client connection to 127.26.66.189:36481: connect: Connection refused (error 111)
W20260808 11:37:09.279421 18058 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 11:37:09.279843 18058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:37:09.279987 18058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:37:09.280136 18058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:37:09.287950 18058 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:37:09.288072 18058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:37:09.288343 18058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:37:09.288511 18058 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:37:09.288672 18058 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:37:09.299412 18058 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:42725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:46179,127.26.66.189:36481,127.26.66.188:34639
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.189.keytab
--principal=kudu/127.26.66.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.189:36481
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.66.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:37:09.300813 18058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:37:09.302194 18058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:37:09.314006 18064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:37:09.314078 18067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:37:09.314039 18065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:37:09.314922 18058 server_base.cc:1034] running on GCE node
I20260808 11:37:09.315632 18058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:37:09.316968 18058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:37:09.318219 18058 hybrid_clock.cc:648] HybridClock initialized: now 1786189029318159 us; error 37 us; skew 500 ppm
I20260808 11:37:09.318540 18058 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:37:09 dist-test-slave-zkpd krb5kdc[17966](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189029, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:37:09.321825 18058 init.cc:377] Logged in from keytab as kudu/127.26.66.189@KRBTEST.COM (short username kudu)
I20260808 11:37:09.323239 18058 webserver.cc:460] Webserver started at http://127.26.66.189:42423/ using document root <none> and password file <none>
I20260808 11:37:09.323872 18058 fs_manager.cc:359] Metadata directory not provided
I20260808 11:37:09.324020 18058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:37:09.324299 18058 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:37:09.327214 18058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-1/data/instance:
uuid: "4d3d4bb34e4b4d6d9f0d9faaefd1b2a0"
format_stamp: "Formatted at 2026-08-08 11:37:09 on dist-test-slave-zkpd"
server_key: "0c1066c7f7098ce7978e8139344eaed2"
server_key_iv: "c8c6136554f942a68e2c4e1fab003959"
server_key_version: "encryptionkey@0"
I20260808 11:37:09.328047 18058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-1/wal/instance:
uuid: "4d3d4bb34e4b4d6d9f0d9faaefd1b2a0"
format_stamp: "Formatted at 2026-08-08 11:37:09 on dist-test-slave-zkpd"
server_key: "0c1066c7f7098ce7978e8139344eaed2"
server_key_iv: "c8c6136554f942a68e2c4e1fab003959"
server_key_version: "encryptionkey@0"
I20260808 11:37:09.333232 18058 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260808 11:37:09.336848 18074 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:37:09.338229 18058 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 11:37:09.338376 18058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-1/wal
uuid: "4d3d4bb34e4b4d6d9f0d9faaefd1b2a0"
format_stamp: "Formatted at 2026-08-08 11:37:09 on dist-test-slave-zkpd"
server_key: "0c1066c7f7098ce7978e8139344eaed2"
server_key_iv: "c8c6136554f942a68e2c4e1fab003959"
server_key_version: "encryptionkey@0"
I20260808 11:37:09.338560 18058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:37:09.349382 18058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:37:09.353605 18058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:37:09.353854 18058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:37:09.373034 18058 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.189:36481
I20260808 11:37:09.373057 18125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.189:36481 every 8 connection(s)
I20260808 11:37:09.374439 18058 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-1/data/info.pb
I20260808 11:37:09.375804 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 18058
I20260808 11:37:09.376051 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-1/wal/instance
I20260808 11:37:09.376629 26890 external_mini_cluster.cc:1428] Setting key 263a4ceddd23a6cdbda4ab131e6484f8
I20260808 11:37:09.378994 18126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:37:09.389060 18126 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46179 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 11:37:09 dist-test-slave-zkpd krb5kdc[17966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189029, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.189@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:37:09.414469 18128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.392587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50698 (local address 127.26.66.190:46179)
0808 11:37:09.393140 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:09.393148 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:09.394275 (+ 1127us) server_negotiation.cc:407] Connection header received
0808 11:37:09.396784 (+ 2509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:09.396788 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:09.396861 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:09.396967 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:09.399175 (+ 2208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.400221 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.402795 (+ 2574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.403205 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.403299 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:09.407723 (+ 4424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:09.407729 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:09.407732 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:09.407781 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:09.410721 (+ 2940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:09.411609 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:09.411618 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:09.411624 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:09.411794 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:09.412298 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:09.412304 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:09.412309 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:09.412748 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:09.412937 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:09.413728 (+ 791us) server_negotiation.cc:299] Negotiation successful
0808 11:37:09.413997 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":258,"threads_started":1}
I20260808 11:37:09.415179 18129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.393126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:46179 (local address 127.0.0.1:50698)
0808 11:37:09.394085 (+ 959us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.394144 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 11:37:09.396495 (+ 2351us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:37:09.397217 (+ 722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:37:09.397230 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:37:09.398054 (+ 824us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:37:09.398936 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:09.398964 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.400391 (+ 1427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.400399 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:09.402647 (+ 2248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:09.402665 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.403463 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.403475 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:09.403810 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:09.404598 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:37:09.404634 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:37:09.407466 (+ 2832us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:37:09.410878 (+ 3412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:09.410888 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:09.410907 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:09.411448 (+ 541us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:09.411953 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:09.411962 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:09.411965 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:09.412148 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:09.412913 (+ 765us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:37:09.412920 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:37:09.413311 (+ 391us) client_negotiation.cc:769] Sending connection context
0808 11:37:09.413550 (+ 239us) client_negotiation.cc:240] Negotiation successful
0808 11:37:09.413990 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":363,"threads_started":1}
WARNING: no policy specified for kudu/127.26.66.188@KRBTEST.COM; defaulting to no policy
I20260808 11:37:09.417145 18126 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.189" port: 36481 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.188@KRBTEST.COM" created.
Aug 08 11:37:09 dist-test-slave-zkpd krb5kdc[17966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189029, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.189@KRBTEST.COM for kudu/127.26.66.189@KRBTEST.COM
I20260808 11:37:09.434033 18129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.418069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:36481 (local address 127.0.0.1:37144)
0808 11:37:09.418265 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.418287 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 11:37:09.418414 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:37:09.419674 (+ 1260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:37:09.419683 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:37:09.420259 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:37:09.420510 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:09.420527 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.421982 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.421991 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:09.423690 (+ 1699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:09.423710 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.424661 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.424669 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:09.424908 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:09.425560 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:37:09.425590 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:37:09.428319 (+ 2729us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:37:09.431526 (+ 3207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:09.431534 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:09.431540 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:09.431872 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:09.432245 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:09.432252 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:09.432257 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:09.432412 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:09.432991 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:37:09.432995 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:37:09.433136 (+ 141us) client_negotiation.cc:769] Sending connection context
0808 11:37:09.433271 (+ 135us) client_negotiation.cc:240] Negotiation successful
0808 11:37:09.433579 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 11:37:09.434077 18131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.418405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37144 (local address 127.26.66.189:36481)
0808 11:37:09.419225 (+ 820us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:09.419232 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:09.419260 (+ 28us) server_negotiation.cc:407] Connection header received
0808 11:37:09.419308 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:09.419313 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:09.419494 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:09.419625 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:09.420720 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.421827 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.423853 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.424501 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.424601 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:09.428526 (+ 3925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:09.428537 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:09.428551 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:09.428578 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:09.431405 (+ 2827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:09.432019 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:09.432030 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:09.432032 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:09.432140 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:09.432519 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:09.432523 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:09.432526 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:09.432871 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:09.433084 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:09.433455 (+ 371us) server_negotiation.cc:299] Negotiation successful
0808 11:37:09.433668 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":637,"thread_start_us":466,"threads_started":1}
I20260808 11:37:09.436944 18126 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } has no permanent_uuid. Determining permanent_uuid...
I20260808 11:37:09.438434 18129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.437856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:34639 (local address 127.0.0.1:57570)
0808 11:37:09.438072 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.438229 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260808 11:37:09.438714 18076 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
I20260808 11:37:09.440398 18129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.440053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:34639 (local address 127.0.0.1:57580)
0808 11:37:09.440193 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.440279 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 11:37:09.440603 18126 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.188:34639: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.188.keytab.
Entry for principal kudu/127.26.66.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.188.keytab.
I20260808 11:37:09.464251 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.188:34639
--webserver_interface=127.26.66.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.188.keytab
--principal=kudu/127.26.66.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:42725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:46179,127.26.66.189:36481,127.26.66.188:34639
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 11:37:09.489897 18126 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } attempt: 1
I20260808 11:37:09.491145 18129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.490663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:34639 (local address 127.0.0.1:57596)
0808 11:37:09.490883 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.490987 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 11:37:09.492161 18129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.491812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:34639 (local address 127.0.0.1:57610)
0808 11:37:09.491989 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.492058 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 11:37:09.492391 18126 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.188:34639: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
I20260808 11:37:09.523087 18050 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.189" port: 36481 } attempt: 5
Aug 08 11:37:09 dist-test-slave-zkpd krb5kdc[17966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189028, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for kudu/127.26.66.189@KRBTEST.COM
I20260808 11:37:09.537272 18131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.523920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37152 (local address 127.26.66.189:36481)
0808 11:37:09.524124 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:09.524130 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:09.524155 (+ 25us) server_negotiation.cc:407] Connection header received
0808 11:37:09.524293 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:09.524298 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:09.524399 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:09.524519 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:09.525320 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.526550 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.527708 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.528577 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.528747 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:09.531922 (+ 3175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:09.531930 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:09.531935 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:09.531974 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:09.534721 (+ 2747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:09.535496 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:09.535500 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:09.535503 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:09.535616 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:09.536034 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:09.536038 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:09.536040 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:09.536317 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:09.536428 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:09.536888 (+ 460us) server_negotiation.cc:299] Negotiation successful
0808 11:37:09.537056 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 11:37:09.537412 18053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.523813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:36481 (local address 127.0.0.1:37152)
0808 11:37:09.524034 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.524053 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 11:37:09.524169 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:37:09.524567 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:37:09.524570 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:37:09.524965 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:37:09.525160 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:09.525169 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.526694 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.526698 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:09.527553 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:09.527564 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.528737 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.528741 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:09.528917 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:09.529555 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:37:09.529573 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:37:09.531708 (+ 2135us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:37:09.534868 (+ 3160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:09.534873 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:09.534877 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:09.535378 (+ 501us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:09.535719 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:09.535723 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:09.535726 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:09.535934 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:09.536441 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:37:09.536446 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:37:09.536610 (+ 164us) client_negotiation.cc:769] Sending connection context
0808 11:37:09.536809 (+ 199us) client_negotiation.cc:240] Negotiation successful
0808 11:37:09.537074 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 11:37:09.538556 18050 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } has no permanent_uuid. Determining permanent_uuid...
I20260808 11:37:09.539739 18053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.539281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:34639 (local address 127.0.0.1:57626)
0808 11:37:09.539468 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.539562 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 11:37:09.540778 18053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.540402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:34639 (local address 127.0.0.1:57638)
0808 11:37:09.540548 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.540649 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 11:37:09.540977 18050 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.188:34639: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
I20260808 11:37:09.560580 18126 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } attempt: 2
I20260808 11:37:09.561632 18129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.561102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:34639 (local address 127.0.0.1:57640)
0808 11:37:09.561297 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.561455 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 11:37:09.562654 18129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.562286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:34639 (local address 127.0.0.1:57652)
0808 11:37:09.562435 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.562517 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 11:37:09.562875 18126 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.188:34639: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
I20260808 11:37:09.592192 18050 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } attempt: 1
I20260808 11:37:09.593442 18053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.592838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:34639 (local address 127.0.0.1:57668)
0808 11:37:09.593087 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.593217 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260808 11:37:09.594595 18053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.594218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:34639 (local address 127.0.0.1:57674)
0808 11:37:09.594387 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.594466 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260808 11:37:09.594882 18050 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.188:34639: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
I20260808 11:37:09.654106 18126 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } attempt: 3
I20260808 11:37:09.655401 18129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.654764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:34639 (local address 127.0.0.1:57680)
0808 11:37:09.655024 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.655157 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260808 11:37:09.656680 18129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.656147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:34639 (local address 127.0.0.1:57690)
0808 11:37:09.656411 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.656524 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137}
W20260808 11:37:09.656929 18126 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.188:34639: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
I20260808 11:37:09.663120 18050 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } attempt: 2
I20260808 11:37:09.664304 18053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.663662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:34639 (local address 127.0.0.1:57692)
0808 11:37:09.663968 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.664084 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260808 11:37:09.665427 18053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.665045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:34639 (local address 127.0.0.1:57694)
0808 11:37:09.665202 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.665307 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 11:37:09.665665 18050 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.188:34639: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
I20260808 11:37:09.771920 18050 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } attempt: 3
I20260808 11:37:09.773264 18053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.772637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:34639 (local address 127.0.0.1:57704)
0808 11:37:09.772895 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.773017 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260808 11:37:09.774461 18053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.773992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:34639 (local address 127.0.0.1:57708)
0808 11:37:09.774199 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.774306 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
W20260808 11:37:09.774718 18050 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.188:34639: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
I20260808 11:37:09.800175 18126 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } attempt: 4
I20260808 11:37:09.801457 18129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.800866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:34639 (local address 127.0.0.1:57710)
0808 11:37:09.801131 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.801246 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260808 11:37:09.802556 18129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.802179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:34639 (local address 127.0.0.1:57718)
0808 11:37:09.802339 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.802426 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 11:37:09.802840 18126 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.188:34639: Network error: Client connection negotiation failed: client connection to 127.26.66.188:34639: connect: Connection refused (error 111)
W20260808 11:37:09.822985 18134 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 11:37:09.823298 18134 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:37:09.823414 18134 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:37:09.823549 18134 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:37:09.830904 18134 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:37:09.830977 18134 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:37:09.831096 18134 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:37:09.831171 18134 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:37:09.831279 18134 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:37:09.841003 18134 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:42725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:46179,127.26.66.189:36481,127.26.66.188:34639
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.188.keytab
--principal=kudu/127.26.66.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.188:34639
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.66.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:37:09.842165 18134 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:37:09.843420 18134 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:37:09.855305 18139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:37:09.855355 18140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:37:09.855950 18143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:37:09.856436 18134 server_base.cc:1034] running on GCE node
I20260808 11:37:09.857123 18134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:37:09.858350 18134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:37:09.859565 18134 hybrid_clock.cc:648] HybridClock initialized: now 1786189029859507 us; error 27 us; skew 500 ppm
I20260808 11:37:09.859851 18134 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:37:09 dist-test-slave-zkpd krb5kdc[17966](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189029, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:37:09.862933 18134 init.cc:377] Logged in from keytab as kudu/127.26.66.188@KRBTEST.COM (short username kudu)
I20260808 11:37:09.864454 18134 webserver.cc:460] Webserver started at http://127.26.66.188:44371/ using document root <none> and password file <none>
I20260808 11:37:09.865108 18134 fs_manager.cc:359] Metadata directory not provided
I20260808 11:37:09.865232 18134 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:37:09.865552 18134 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:37:09.868515 18134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-2/data/instance:
uuid: "5d5e2ae87645427d8265a627caf4e355"
format_stamp: "Formatted at 2026-08-08 11:37:09 on dist-test-slave-zkpd"
server_key: "9343030061cdbec7fbbed386662974de"
server_key_iv: "b004ddfa7aa9f6d7da06b46e1634c5b7"
server_key_version: "encryptionkey@0"
I20260808 11:37:09.869316 18134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-2/wal/instance:
uuid: "5d5e2ae87645427d8265a627caf4e355"
format_stamp: "Formatted at 2026-08-08 11:37:09 on dist-test-slave-zkpd"
server_key: "9343030061cdbec7fbbed386662974de"
server_key_iv: "b004ddfa7aa9f6d7da06b46e1634c5b7"
server_key_version: "encryptionkey@0"
I20260808 11:37:09.874292 18134 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 11:37:09.877583 18150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:37:09.878842 18134 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 11:37:09.879014 18134 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-2/wal
uuid: "5d5e2ae87645427d8265a627caf4e355"
format_stamp: "Formatted at 2026-08-08 11:37:09 on dist-test-slave-zkpd"
server_key: "9343030061cdbec7fbbed386662974de"
server_key_iv: "b004ddfa7aa9f6d7da06b46e1634c5b7"
server_key_version: "encryptionkey@0"
I20260808 11:37:09.879240 18134 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:37:09.897171 18134 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:37:09.901357 18134 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:37:09.901643 18134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:37:09.920172 18134 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.188:34639
I20260808 11:37:09.920193 18202 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.188:34639 every 8 connection(s)
I20260808 11:37:09.921471 18134 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-2/data/info.pb
I20260808 11:37:09.925005 18203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:37:09.928864 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 18134
I20260808 11:37:09.929078 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786188664137852-26890-0/minicluster-data/master-2/wal/instance
I20260808 11:37:09.929615 26890 external_mini_cluster.cc:1428] Setting key b969292a4be794edd194f9ac4c035ef4
I20260808 11:37:09.932693 18203 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46179 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 11:37:09 dist-test-slave-zkpd krb5kdc[17966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.188@KRBTEST.COM
Aug 08 11:37:09 dist-test-slave-zkpd krb5kdc[17966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189029, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.188@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:37:09.951953 18050 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } attempt: 4
I20260808 11:37:09.952711 18207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.936154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50704 (local address 127.26.66.190:46179)
0808 11:37:09.936711 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:09.936718 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:09.937261 (+ 543us) server_negotiation.cc:407] Connection header received
0808 11:37:09.937465 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:09.937470 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:09.937551 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:09.937648 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:09.939018 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.940162 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.942095 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.942894 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.943041 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:09.946769 (+ 3728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:09.946779 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:09.946784 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:09.946839 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:09.949623 (+ 2784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:09.950462 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:09.950467 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:09.950470 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:09.950602 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:09.950972 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:09.950978 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:09.950982 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:09.951251 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:09.951422 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:09.952016 (+ 594us) server_negotiation.cc:299] Negotiation successful
0808 11:37:09.952289 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":258,"threads_started":1}
I20260808 11:37:09.953409 18208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.936149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:46179 (local address 127.0.0.1:50704)
0808 11:37:09.937092 (+ 943us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.937146 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 11:37:09.937308 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:37:09.937744 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:37:09.937751 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:37:09.938580 (+ 829us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:37:09.938857 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:09.938866 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.940338 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.940343 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:09.941912 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:09.941922 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.943105 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.943110 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:09.943336 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:09.943969 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:37:09.944005 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:37:09.946512 (+ 2507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:37:09.949793 (+ 3281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:09.949805 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:09.949812 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:09.950335 (+ 523us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:09.950714 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:09.950719 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:09.950723 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:09.950857 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:09.951398 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:37:09.951405 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:37:09.951595 (+ 190us) client_negotiation.cc:769] Sending connection context
0808 11:37:09.951827 (+ 232us) client_negotiation.cc:240] Negotiation successful
0808 11:37:09.952173 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":712,"spinlock_wait_cycles":17280,"thread_start_us":551,"threads_started":1}
I20260808 11:37:09.953460 18206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.931492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57730 (local address 127.26.66.188:34639)
0808 11:37:09.932282 (+ 790us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:09.932299 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:09.932339 (+ 40us) server_negotiation.cc:407] Connection header received
0808 11:37:09.933860 (+ 1521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:09.933880 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:09.934242 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:09.934605 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:09.936383 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.938480 (+ 2097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.940372 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.941426 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.941599 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:09.946242 (+ 4643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:09.946250 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:09.946260 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:09.946292 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:09.948951 (+ 2659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:09.949606 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:09.949612 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:09.949618 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:09.949774 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:09.950197 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:09.950231 (+ 34us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:09.950233 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:09.950710 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:09.951063 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:09.951516 (+ 453us) server_negotiation.cc:299] Negotiation successful
0808 11:37:09.951977 (+ 461us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":587,"thread_start_us":386,"threads_started":1}
I20260808 11:37:09.955173 18203 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.189" port: 36481 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 11:37:09 dist-test-slave-zkpd krb5kdc[17966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189028, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for kudu/127.26.66.188@KRBTEST.COM
Aug 08 11:37:09 dist-test-slave-zkpd krb5kdc[17966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189029, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.188@KRBTEST.COM for kudu/127.26.66.189@KRBTEST.COM
Aug 08 11:37:09 dist-test-slave-zkpd krb5kdc[17966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:37:09.969735 18053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.952541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:34639 (local address 127.0.0.1:57744)
0808 11:37:09.952900 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.952918 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 11:37:09.953018 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:37:09.955101 (+ 2083us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:37:09.955105 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:37:09.955570 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:37:09.955783 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:09.955800 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.957447 (+ 1647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.957454 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:09.958937 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:09.958953 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.960075 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.960082 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:09.960349 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:09.960979 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:37:09.961002 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:37:09.963492 (+ 2490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:37:09.966655 (+ 3163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:09.966660 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:09.966664 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:09.967210 (+ 546us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:09.967687 (+ 477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:09.967692 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:09.967695 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:09.967866 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:09.968554 (+ 688us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:37:09.968558 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:37:09.968773 (+ 215us) client_negotiation.cc:769] Sending connection context
0808 11:37:09.968922 (+ 149us) client_negotiation.cc:240] Negotiation successful
0808 11:37:09.969228 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242}
I20260808 11:37:09.970901 18206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.953324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57744 (local address 127.26.66.188:34639)
0808 11:37:09.954717 (+ 1393us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:09.954724 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:09.954741 (+ 17us) server_negotiation.cc:407] Connection header received
0808 11:37:09.954784 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:09.954790 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:09.954870 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:09.955050 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:09.956190 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.957280 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.959125 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.959840 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.960053 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:09.963672 (+ 3619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:09.963677 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:09.963680 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:09.963707 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:09.966517 (+ 2810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:09.967375 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:09.967380 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:09.967384 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:09.967531 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:09.968043 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:09.968048 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:09.968053 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:09.968424 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:09.970142 (+ 1718us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:09.970295 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 11:37:09.970513 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1281,"thread_start_us":1114,"threads_started":1}
I20260808 11:37:09.972159 18208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.956141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:36481 (local address 127.0.0.1:37156)
0808 11:37:09.956400 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.956416 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 11:37:09.956522 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:37:09.957375 (+ 853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:37:09.957382 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:37:09.957836 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:37:09.958008 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:09.958020 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.959499 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.959504 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:09.960820 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:09.960837 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.961546 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.961551 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:09.961738 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:09.962276 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:37:09.962299 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:37:09.965115 (+ 2816us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:37:09.969170 (+ 4055us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:09.969177 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:09.969183 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:09.969639 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:09.970105 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:09.970108 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:09.970110 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:09.970253 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:09.970858 (+ 605us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:37:09.970862 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:37:09.971358 (+ 496us) client_negotiation.cc:769] Sending connection context
0808 11:37:09.971498 (+ 140us) client_negotiation.cc:240] Negotiation successful
0808 11:37:09.971767 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174}
I20260808 11:37:09.972477 18131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.955954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37156 (local address 127.26.66.189:36481)
0808 11:37:09.956163 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:09.956170 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:09.956627 (+ 457us) server_negotiation.cc:407] Connection header received
0808 11:37:09.956696 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:09.956701 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:09.956792 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:09.956882 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:09.958202 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.959348 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.960965 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.961394 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.961524 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:09.965375 (+ 3851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:09.965382 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:09.965388 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:09.965431 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:09.968991 (+ 3560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:09.969766 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:09.969771 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:09.969775 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:09.969953 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:09.970417 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:09.970425 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:09.970431 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:09.970721 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:09.970890 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:09.971609 (+ 719us) server_negotiation.cc:299] Negotiation successful
0808 11:37:09.971823 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 11:37:09.973394 18203 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } has no permanent_uuid. Determining permanent_uuid...
I20260808 11:37:09.975652 18207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.956719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50710 (local address 127.26.66.190:46179)
0808 11:37:09.956898 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:09.956903 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:09.957033 (+ 130us) server_negotiation.cc:407] Connection header received
0808 11:37:09.957196 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:09.957201 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:09.957281 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:09.958962 (+ 1681us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:09.959112 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.960155 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.962247 (+ 2092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.962936 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.963063 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:09.968524 (+ 5461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:09.968533 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:09.968537 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:09.968571 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:09.971950 (+ 3379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:09.972802 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:09.972807 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:09.972810 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:09.972984 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:09.973591 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:09.973598 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:09.973602 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:09.973978 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:09.974279 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:09.975119 (+ 840us) server_negotiation.cc:299] Negotiation successful
0808 11:37:09.975347 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 11:37:09.977372 18050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5: Bootstrap starting.
I20260808 11:37:09.981410 18050 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5: Neither blocks nor log segments found. Creating new log.
Aug 08 11:37:09 dist-test-slave-zkpd krb5kdc[17966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189029, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.188@KRBTEST.COM for kudu/127.26.66.188@KRBTEST.COM
I20260808 11:37:09.982800 18050 log.cc:824] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5: Log is configured to *not* fsync() on all Append() calls
I20260808 11:37:09.985941 18050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5: No bootstrap required, opened a new log
Aug 08 11:37:09 dist-test-slave-zkpd krb5kdc[17966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.189@KRBTEST.COM
I20260808 11:37:09.989400 18208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.974139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:34639 (local address 127.0.0.1:57748)
0808 11:37:09.974449 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:09.974466 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 11:37:09.974562 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:37:09.974833 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:37:09.974837 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:37:09.975349 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:37:09.975472 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:09.975481 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.977135 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.977140 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:09.978465 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:09.978480 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.979503 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.979510 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:09.979718 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:09.980354 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:37:09.980383 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:37:09.982965 (+ 2582us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:37:09.986809 (+ 3844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:09.986823 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:09.986827 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:09.987246 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:09.987601 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:09.987605 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:09.987609 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:09.987736 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:09.988409 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:37:09.988414 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:37:09.988580 (+ 166us) client_negotiation.cc:769] Sending connection context
0808 11:37:09.988707 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 11:37:09.988995 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211}
I20260808 11:37:09.990808 18206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.974422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57748 (local address 127.26.66.188:34639)
0808 11:37:09.974570 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:09.974574 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:09.974591 (+ 17us) server_negotiation.cc:407] Connection header received
0808 11:37:09.974662 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:09.974666 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:09.974724 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:09.974823 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:09.975600 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.976982 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.978623 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.979340 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.979457 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:09.983154 (+ 3697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:09.983161 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:09.983166 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:09.983206 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:09.986687 (+ 3481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:09.987360 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:09.987366 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:09.987369 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:09.987489 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:09.987845 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:09.987853 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:09.987856 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:09.988258 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:09.990070 (+ 1812us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:09.990226 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 11:37:09.990455 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 11:37:09.996146 18050 raft_consensus.cc:348] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8dacb765bc439392b434395011d4d5" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46179 } } peers { permanent_uuid: "4d3d4bb34e4b4d6d9f0d9faaefd1b2a0" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 36481 } } peers { permanent_uuid: "5d5e2ae87645427d8265a627caf4e355" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } }
I20260808 11:37:09.996553 18050 raft_consensus.cc:729] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af8dacb765bc439392b434395011d4d5, State: Initialized, Role: FOLLOWER
I20260808 11:37:09.996937 18203 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d5e2ae87645427d8265a627caf4e355: Bootstrap starting.
I20260808 11:37:09.997102 18050 consensus_queue.cc:260] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8dacb765bc439392b434395011d4d5" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46179 } } peers { permanent_uuid: "4d3d4bb34e4b4d6d9f0d9faaefd1b2a0" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 36481 } } peers { permanent_uuid: "5d5e2ae87645427d8265a627caf4e355" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } }
I20260808 11:37:09.998152 18211 sys_catalog.cc:455] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8dacb765bc439392b434395011d4d5" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46179 } } peers { permanent_uuid: "4d3d4bb34e4b4d6d9f0d9faaefd1b2a0" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 36481 } } peers { permanent_uuid: "5d5e2ae87645427d8265a627caf4e355" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } } }
I20260808 11:37:09.998726 18211 sys_catalog.cc:458] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 11:37:09.998888 18131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:09.977584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37164 (local address 127.26.66.189:36481)
0808 11:37:09.977732 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:09.977737 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:09.977753 (+ 16us) server_negotiation.cc:407] Connection header received
0808 11:37:09.977804 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:09.977807 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:09.977890 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:09.977992 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:09.979452 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.980423 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.981657 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:09.982355 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:09.982474 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:09.988228 (+ 5754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:09.988235 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:09.988239 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:09.988276 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:09.991857 (+ 3581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:09.995951 (+ 4094us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:09.995959 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:09.995964 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:09.996112 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:09.996551 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:09.996556 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:09.996559 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:09.996900 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:09.997174 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:09.998249 (+ 1075us) server_negotiation.cc:299] Negotiation successful
0808 11:37:09.998516 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 11:37:09.999539 18050 sys_catalog.cc:564] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:37:10.001166 18203 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d5e2ae87645427d8265a627caf4e355: Neither blocks nor log segments found. Creating new log.
I20260808 11:37:10.002833 18203 log.cc:824] T 00000000000000000000000000000000 P 5d5e2ae87645427d8265a627caf4e355: Log is configured to *not* fsync() on all Append() calls
I20260808 11:37:10.003953 26890 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 11:37:10.008544 18025 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "af8dacb765bc439392b434395011d4d5"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50710
I20260808 11:37:10.008987 18025 raft_consensus.cc:482] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 11:37:10.009210 18025 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:37:10.009977 18203 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d5e2ae87645427d8265a627caf4e355: No bootstrap required, opened a new log
I20260808 11:37:10.011838 18025 raft_consensus.cc:504] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8dacb765bc439392b434395011d4d5" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46179 } } peers { permanent_uuid: "4d3d4bb34e4b4d6d9f0d9faaefd1b2a0" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 36481 } } peers { permanent_uuid: "5d5e2ae87645427d8265a627caf4e355" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } }
I20260808 11:37:10.015556 18025 leader_election.cc:288] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5 [CANDIDATE]: Term 1 election: Requested vote from peers 4d3d4bb34e4b4d6d9f0d9faaefd1b2a0 (127.26.66.189:36481), 5d5e2ae87645427d8265a627caf4e355 (127.26.66.188:34639)
W20260808 11:37:10.019969 18223 catalog_manager.cc:1558] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 11:37:10.020095 18223 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 11:37:10.027778 18203 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d5e2ae87645427d8265a627caf4e355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8dacb765bc439392b434395011d4d5" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46179 } } peers { permanent_uuid: "4d3d4bb34e4b4d6d9f0d9faaefd1b2a0" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 36481 } } peers { permanent_uuid: "5d5e2ae87645427d8265a627caf4e355" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } }
I20260808 11:37:10.028232 18203 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d5e2ae87645427d8265a627caf4e355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d5e2ae87645427d8265a627caf4e355, State: Initialized, Role: FOLLOWER
I20260808 11:37:10.028733 18203 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d5e2ae87645427d8265a627caf4e355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8dacb765bc439392b434395011d4d5" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46179 } } peers { permanent_uuid: "4d3d4bb34e4b4d6d9f0d9faaefd1b2a0" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 36481 } } peers { permanent_uuid: "5d5e2ae87645427d8265a627caf4e355" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } }
I20260808 11:37:10.017679 17980 master_runner.cc:186] Error getting master registration for 127.26.66.189:36481: OK, instance_id { permanent_uuid: "4d3d4bb34e4b4d6d9f0d9faaefd1b2a0" instance_seqno: 1786189029367745 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 11:37:10.030277 17980 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 11:37:10.031268 18227 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d5e2ae87645427d8265a627caf4e355 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8dacb765bc439392b434395011d4d5" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46179 } } peers { permanent_uuid: "4d3d4bb34e4b4d6d9f0d9faaefd1b2a0" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 36481 } } peers { permanent_uuid: "5d5e2ae87645427d8265a627caf4e355" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } } }
I20260808 11:37:10.031772 18227 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d5e2ae87645427d8265a627caf4e355 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 11:37:10.035550 18177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "af8dacb765bc439392b434395011d4d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "5d5e2ae87645427d8265a627caf4e355"
I20260808 11:37:10.036155 18177 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d5e2ae87645427d8265a627caf4e355 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:37:10.040418 18177 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5d5e2ae87645427d8265a627caf4e355 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af8dacb765bc439392b434395011d4d5 in term 1.
I20260808 11:37:10.041181 17998 leader_election.cc:302] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d5e2ae87645427d8265a627caf4e355, af8dacb765bc439392b434395011d4d5; no voters:
I20260808 11:37:10.041750 18211 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:37:10.035527 18203 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d5e2ae87645427d8265a627caf4e355 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 11:37:10.057159 18002 tablet.cc:2369] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:37:10.057204 18211 raft_consensus.cc:686] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5 [term 1 LEADER]: Becoming Leader. State: Replica: af8dacb765bc439392b434395011d4d5, State: Running, Role: LEADER
I20260808 11:37:10.057929 18211 consensus_queue.cc:237] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8dacb765bc439392b434395011d4d5" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46179 } } peers { permanent_uuid: "4d3d4bb34e4b4d6d9f0d9faaefd1b2a0" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 36481 } } peers { permanent_uuid: "5d5e2ae87645427d8265a627caf4e355" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } }
I20260808 11:37:10.073107 18233 sys_catalog.cc:455] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af8dacb765bc439392b434395011d4d5. Latest consensus state: current_term: 1 leader_uuid: "af8dacb765bc439392b434395011d4d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8dacb765bc439392b434395011d4d5" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46179 } } peers { permanent_uuid: "4d3d4bb34e4b4d6d9f0d9faaefd1b2a0" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 36481 } } peers { permanent_uuid: "5d5e2ae87645427d8265a627caf4e355" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } } }
I20260808 11:37:10.073593 18233 sys_catalog.cc:458] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5 [sys.catalog]: This master's current role is: LEADER
I20260808 11:37:10.074890 18239 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:37:10.077109 18207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:10.034645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50718 (local address 127.26.66.190:46179)
0808 11:37:10.034876 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:10.034883 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:10.044124 (+ 9241us) server_negotiation.cc:407] Connection header received
0808 11:37:10.044937 (+ 813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:10.044944 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:10.045040 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:10.045116 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:10.054412 (+ 9296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:10.056488 (+ 2076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:10.061370 (+ 4882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:10.062090 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:10.062198 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:10.066710 (+ 4512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:10.066720 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:10.066728 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:10.066778 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:10.071215 (+ 4437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:10.072691 (+ 1476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:10.072699 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:10.072745 (+ 46us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:10.073091 (+ 346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:10.075048 (+ 1957us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:10.075053 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:10.075057 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:10.075485 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:10.075827 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:10.076434 (+ 607us) server_negotiation.cc:299] Negotiation successful
0808 11:37:10.076700 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 11:37:10.079378 18239 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 11:37:10.086958 18206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:10.034800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57760 (local address 127.26.66.188:34639)
0808 11:37:10.034978 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:10.034984 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:10.056121 (+ 21137us) server_negotiation.cc:407] Connection header received
0808 11:37:10.057549 (+ 1428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:10.057557 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:10.057658 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:10.057735 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:10.066639 (+ 8904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:10.068019 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:10.070341 (+ 2322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:10.071101 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:10.071200 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:10.078856 (+ 7656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:10.078864 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:10.078869 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:10.078915 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:10.083558 (+ 4643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:10.084518 (+ 960us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:10.084523 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:10.084527 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:10.084686 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:10.085137 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:10.085142 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:10.085146 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:10.085515 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:10.085757 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:10.086356 (+ 599us) server_negotiation.cc:299] Negotiation successful
0808 11:37:10.086599 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 11:37:10.096374 18131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:10.038071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37168 (local address 127.26.66.189:36481)
0808 11:37:10.038247 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:10.038253 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:10.065227 (+ 26974us) server_negotiation.cc:407] Connection header received
0808 11:37:10.067180 (+ 1953us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:10.067187 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:10.067404 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:10.067495 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:10.076262 (+ 8767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:10.077386 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:10.080022 (+ 2636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:10.080712 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:10.080844 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:10.088688 (+ 7844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:10.088697 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:10.088705 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:10.088756 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:10.092819 (+ 4063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:10.093748 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:10.093754 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:10.093757 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:10.093974 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:10.094485 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:10.094492 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:10.094497 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:10.094899 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:10.095146 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:10.095734 (+ 588us) server_negotiation.cc:299] Negotiation successful
0808 11:37:10.095997 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 11:37:10.102010 18126 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } attempt: 5
I20260808 11:37:10.109686 18177 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5d5e2ae87645427d8265a627caf4e355 [term 1 FOLLOWER]: Refusing update from remote peer af8dacb765bc439392b434395011d4d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260808 11:37:10.110699 18247 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5d5e2ae87645427d8265a627caf4e355: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 11:37:10.110844 18247 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 11:37:10.111845 18233 consensus_queue.cc:1035] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d5e2ae87645427d8265a627caf4e355" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Aug 08 11:37:10 dist-test-slave-zkpd krb5kdc[17966](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189029, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.189@KRBTEST.COM for kudu/127.26.66.188@KRBTEST.COM
I20260808 11:37:10.129171 18206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:10.102758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57764 (local address 127.26.66.188:34639)
0808 11:37:10.103036 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:10.103042 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:10.103060 (+ 18us) server_negotiation.cc:407] Connection header received
0808 11:37:10.103229 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:10.103241 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:10.103322 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:10.103434 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:10.104862 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:10.106382 (+ 1520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:10.108688 (+ 2306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:10.110151 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:10.110322 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:10.116113 (+ 5791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:10.116120 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:10.116125 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:10.116166 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:10.122148 (+ 5982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:10.123719 (+ 1571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:10.123751 (+ 32us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:10.123756 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:10.124046 (+ 290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:10.124743 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:10.124753 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:10.124756 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:10.125527 (+ 771us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:10.126342 (+ 815us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:10.126822 (+ 480us) server_negotiation.cc:299] Negotiation successful
0808 11:37:10.127728 (+ 906us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 11:37:10.129117 18129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:10.102611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:34639 (local address 127.0.0.1:57764)
0808 11:37:10.102947 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:10.102967 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 11:37:10.103072 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:37:10.103661 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:37:10.103669 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:37:10.104342 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:37:10.104615 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:10.104631 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:10.106623 (+ 1992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:10.106632 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:10.108518 (+ 1886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:10.108533 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:10.110587 (+ 2054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:10.110593 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:10.111029 (+ 436us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:10.111773 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:37:10.111800 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:37:10.115810 (+ 4010us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:37:10.122382 (+ 6572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:10.122388 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:10.122413 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:10.123445 (+ 1032us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:10.124280 (+ 835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:10.124285 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:10.124289 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:10.124552 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:10.125712 (+ 1160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:37:10.125718 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:37:10.126039 (+ 321us) client_negotiation.cc:769] Sending connection context
0808 11:37:10.126616 (+ 577us) client_negotiation.cc:240] Negotiation successful
0808 11:37:10.127648 (+ 1032us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136}
I20260808 11:37:10.135299 18126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d3d4bb34e4b4d6d9f0d9faaefd1b2a0: Bootstrap starting.
I20260808 11:37:10.139498 18126 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d3d4bb34e4b4d6d9f0d9faaefd1b2a0: Neither blocks nor log segments found. Creating new log.
I20260808 11:37:10.140879 18126 log.cc:824] T 00000000000000000000000000000000 P 4d3d4bb34e4b4d6d9f0d9faaefd1b2a0: Log is configured to *not* fsync() on all Append() calls
I20260808 11:37:10.143913 18227 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d5e2ae87645427d8265a627caf4e355 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af8dacb765bc439392b434395011d4d5. Latest consensus state: current_term: 1 leader_uuid: "af8dacb765bc439392b434395011d4d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8dacb765bc439392b434395011d4d5" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46179 } } peers { permanent_uuid: "4d3d4bb34e4b4d6d9f0d9faaefd1b2a0" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 36481 } } peers { permanent_uuid: "5d5e2ae87645427d8265a627caf4e355" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } } }
I20260808 11:37:10.144215 18227 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d5e2ae87645427d8265a627caf4e355 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 11:37:10.115993 18134 master_runner.cc:186] Error getting master registration for 127.26.66.189:36481: OK, instance_id { permanent_uuid: "4d3d4bb34e4b4d6d9f0d9faaefd1b2a0" instance_seqno: 1786189029367745 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 11:37:10.146684 18134 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 11:37:10.147694 18126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d3d4bb34e4b4d6d9f0d9faaefd1b2a0: No bootstrap required, opened a new log
W20260808 11:37:10.153517 18156 tablet.cc:2369] T 00000000000000000000000000000000 P 5d5e2ae87645427d8265a627caf4e355: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:37:10.160110 18126 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d3d4bb34e4b4d6d9f0d9faaefd1b2a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8dacb765bc439392b434395011d4d5" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46179 } } peers { permanent_uuid: "4d3d4bb34e4b4d6d9f0d9faaefd1b2a0" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 36481 } } peers { permanent_uuid: "5d5e2ae87645427d8265a627caf4e355" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } }
I20260808 11:37:10.160496 18126 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d3d4bb34e4b4d6d9f0d9faaefd1b2a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3d4bb34e4b4d6d9f0d9faaefd1b2a0, State: Initialized, Role: FOLLOWER
I20260808 11:37:10.161000 18126 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d3d4bb34e4b4d6d9f0d9faaefd1b2a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8dacb765bc439392b434395011d4d5" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46179 } } peers { permanent_uuid: "4d3d4bb34e4b4d6d9f0d9faaefd1b2a0" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 36481 } } peers { permanent_uuid: "5d5e2ae87645427d8265a627caf4e355" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } }
I20260808 11:37:10.167975 18254 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d3d4bb34e4b4d6d9f0d9faaefd1b2a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8dacb765bc439392b434395011d4d5" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46179 } } peers { permanent_uuid: "4d3d4bb34e4b4d6d9f0d9faaefd1b2a0" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 36481 } } peers { permanent_uuid: "5d5e2ae87645427d8265a627caf4e355" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } } }
I20260808 11:37:10.168390 18254 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d3d4bb34e4b4d6d9f0d9faaefd1b2a0 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 11:37:10.170107 18126 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d3d4bb34e4b4d6d9f0d9faaefd1b2a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:37:10.170167 18101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "af8dacb765bc439392b434395011d4d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "4d3d4bb34e4b4d6d9f0d9faaefd1b2a0"
I20260808 11:37:10.170631 18101 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d3d4bb34e4b4d6d9f0d9faaefd1b2a0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:37:10.175040 18101 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4d3d4bb34e4b4d6d9f0d9faaefd1b2a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af8dacb765bc439392b434395011d4d5 in term 1.
I20260808 11:37:10.176138 18100 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4d3d4bb34e4b4d6d9f0d9faaefd1b2a0 [term 1 FOLLOWER]: Refusing update from remote peer af8dacb765bc439392b434395011d4d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:37:10.178081 18211 consensus_queue.cc:1035] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3d4bb34e4b4d6d9f0d9faaefd1b2a0" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:37:10.195266 18227 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d5e2ae87645427d8265a627caf4e355 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "af8dacb765bc439392b434395011d4d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8dacb765bc439392b434395011d4d5" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46179 } } peers { permanent_uuid: "4d3d4bb34e4b4d6d9f0d9faaefd1b2a0" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 36481 } } peers { permanent_uuid: "5d5e2ae87645427d8265a627caf4e355" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } } }
I20260808 11:37:10.195621 18227 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d5e2ae87645427d8265a627caf4e355 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 11:37:10.198408 18239 catalog_manager.cc:1347] Generated new cluster ID: 9d42563b988f4e3cbea7311b09f4c8ba
I20260808 11:37:10.198524 18239 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:37:10.200407 18211 sys_catalog.cc:455] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "af8dacb765bc439392b434395011d4d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8dacb765bc439392b434395011d4d5" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46179 } } peers { permanent_uuid: "4d3d4bb34e4b4d6d9f0d9faaefd1b2a0" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 36481 } } peers { permanent_uuid: "5d5e2ae87645427d8265a627caf4e355" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } } }
I20260808 11:37:10.200675 18211 sys_catalog.cc:458] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5 [sys.catalog]: This master's current role is: LEADER
I20260808 11:37:10.221441 18254 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d3d4bb34e4b4d6d9f0d9faaefd1b2a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af8dacb765bc439392b434395011d4d5. Latest consensus state: current_term: 1 leader_uuid: "af8dacb765bc439392b434395011d4d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8dacb765bc439392b434395011d4d5" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46179 } } peers { permanent_uuid: "4d3d4bb34e4b4d6d9f0d9faaefd1b2a0" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 36481 } } peers { permanent_uuid: "5d5e2ae87645427d8265a627caf4e355" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } } }
I20260808 11:37:10.221765 18254 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d3d4bb34e4b4d6d9f0d9faaefd1b2a0 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 11:37:10.222057 18263 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d3d4bb34e4b4d6d9f0d9faaefd1b2a0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "af8dacb765bc439392b434395011d4d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8dacb765bc439392b434395011d4d5" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46179 } } peers { permanent_uuid: "4d3d4bb34e4b4d6d9f0d9faaefd1b2a0" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 36481 } } peers { permanent_uuid: "5d5e2ae87645427d8265a627caf4e355" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } } }
I20260808 11:37:10.222465 18263 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d3d4bb34e4b4d6d9f0d9faaefd1b2a0 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 11:37:10.225622 18233 sys_catalog.cc:455] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "af8dacb765bc439392b434395011d4d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8dacb765bc439392b434395011d4d5" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 46179 } } peers { permanent_uuid: "4d3d4bb34e4b4d6d9f0d9faaefd1b2a0" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 36481 } } peers { permanent_uuid: "5d5e2ae87645427d8265a627caf4e355" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 34639 } } }
I20260808 11:37:10.225912 18233 sys_catalog.cc:458] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5 [sys.catalog]: This master's current role is: LEADER
I20260808 11:37:10.235075 18239 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:37:10.236902 18239 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:37:10.242574 18269 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 11:37:10.263496 18239 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af8dacb765bc439392b434395011d4d5: Generated new TSK 0
I20260808 11:37:10.264628 18239 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 11:37:10.375875 18131 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:37:10.362311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33900 (local address 127.26.66.189:36481)
0808 11:37:10.362702 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:10.362710 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:10.373185 (+ 10475us) server_negotiation.cc:407] Connection header received
0808 11:37:10.374161 (+ 976us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:10.374168 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:10.374272 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:10.374353 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:10.375629 (+ 1276us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33900: BlockingRecv error: recv got EOF from 127.0.0.1:33900 (error 108)
Metrics: {"server-negotiator.queue_time_us":261}
W20260808 11:37:10.379725 18206 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:37:10.368937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59064 (local address 127.26.66.188:34639)
0808 11:37:10.369112 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:10.369118 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:10.378028 (+ 8910us) server_negotiation.cc:407] Connection header received
0808 11:37:10.378391 (+ 363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:10.378397 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:10.378477 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:10.378548 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:10.379496 (+ 948us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59064: BlockingRecv error: recv got EOF from 127.0.0.1:59064 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260808 11:37:10.381547 18207 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:37:10.362504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45236 (local address 127.26.66.190:46179)
0808 11:37:10.362725 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:10.362732 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:10.377493 (+ 14761us) server_negotiation.cc:407] Connection header received
0808 11:37:10.380119 (+ 2626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:10.380127 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:10.380217 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:10.380292 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:10.381315 (+ 1023us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45236: BlockingRecv error: recv got EOF from 127.0.0.1:45236 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260808 11:37:10.409197 18131 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:37:10.406781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33908 (local address 127.26.66.189:36481)
0808 11:37:10.406974 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:10.406980 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:10.407489 (+ 509us) server_negotiation.cc:407] Connection header received
0808 11:37:10.407746 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:10.407753 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:10.407923 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:10.408031 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:10.408931 (+ 900us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33908: BlockingRecv error: recv got EOF from 127.0.0.1:33908 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260808 11:37:10.415629 18131 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:37:10.413686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33918 (local address 127.26.66.189:36481)
0808 11:37:10.413861 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:10.413867 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:10.414342 (+ 475us) server_negotiation.cc:407] Connection header received
0808 11:37:10.414503 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:10.414508 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:10.414580 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:10.414673 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:10.415439 (+ 766us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33918: BlockingRecv error: recv got EOF from 127.0.0.1:33918 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260808 11:37:10.431643 18131 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:37:10.429436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33926 (local address 127.26.66.189:36481)
0808 11:37:10.429628 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:10.429634 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:10.430152 (+ 518us) server_negotiation.cc:407] Connection header received
0808 11:37:10.430355 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:10.430364 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:10.430478 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:10.430595 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:10.431395 (+ 800us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33926: BlockingRecv error: recv got EOF from 127.0.0.1:33926 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260808 11:37:10.440905 18131 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:37:10.438777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33940 (local address 127.26.66.189:36481)
0808 11:37:10.438984 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:10.438989 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:10.439475 (+ 486us) server_negotiation.cc:407] Connection header received
0808 11:37:10.439652 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:10.439658 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:10.439752 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:10.439865 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:10.440661 (+ 796us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33940: BlockingRecv error: recv got EOF from 127.0.0.1:33940 (error 108)
Metrics: {"server-negotiator.queue_time_us":100}
W20260808 11:37:10.455356 18131 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:37:10.453255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33950 (local address 127.26.66.189:36481)
0808 11:37:10.453417 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:10.453422 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:10.453958 (+ 536us) server_negotiation.cc:407] Connection header received
0808 11:37:10.454149 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:10.454155 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:10.454247 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:10.454351 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:10.455132 (+ 781us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33950: BlockingRecv error: recv got EOF from 127.0.0.1:33950 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260808 11:37:10.480185 18131 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:37:10.477762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33952 (local address 127.26.66.189:36481)
0808 11:37:10.477960 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:10.477969 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:10.478539 (+ 570us) server_negotiation.cc:407] Connection header received
0808 11:37:10.478772 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:10.478778 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:10.478878 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:10.478995 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:10.479935 (+ 940us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33952: BlockingRecv error: recv got EOF from 127.0.0.1:33952 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260808 11:37:10.521123 18131 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:37:10.518628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33954 (local address 127.26.66.189:36481)
0808 11:37:10.518850 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:10.518858 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:10.519416 (+ 558us) server_negotiation.cc:407] Connection header received
0808 11:37:10.519662 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:10.519669 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:10.519768 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:10.519886 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:10.520846 (+ 960us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33954: BlockingRecv error: recv got EOF from 127.0.0.1:33954 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260808 11:37:10.591117 18131 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:37:10.588946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33966 (local address 127.26.66.189:36481)
0808 11:37:10.589212 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:10.589218 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:10.589522 (+ 304us) server_negotiation.cc:407] Connection header received
0808 11:37:10.589772 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:10.589778 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:10.589853 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:10.589944 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:10.590867 (+ 923us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33966: BlockingRecv error: recv got EOF from 127.0.0.1:33966 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260808 11:37:10.725081 18131 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:37:10.723086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33970 (local address 127.26.66.189:36481)
0808 11:37:10.723288 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:10.723294 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:10.723685 (+ 391us) server_negotiation.cc:407] Connection header received
0808 11:37:10.723856 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:10.723860 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:10.723993 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:10.724096 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:10.724772 (+ 676us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33970: BlockingRecv error: recv got EOF from 127.0.0.1:33970 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260808 11:37:10.986893 18131 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:37:10.985139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33986 (local address 127.26.66.189:36481)
0808 11:37:10.985376 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:10.985382 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:10.985569 (+ 187us) server_negotiation.cc:407] Connection header received
0808 11:37:10.985742 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:10.985746 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:10.985840 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:10.985929 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:10.986644 (+ 715us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33986: BlockingRecv error: recv got EOF from 127.0.0.1:33986 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 11:37:11.112797 18247 catalog_manager.cc:1259] Loaded cluster ID: 9d42563b988f4e3cbea7311b09f4c8ba
I20260808 11:37:11.112893 18247 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5d5e2ae87645427d8265a627caf4e355: loading cluster ID for follower catalog manager: success
I20260808 11:37:11.115962 18247 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5d5e2ae87645427d8265a627caf4e355: acquiring CA information for follower catalog manager: success
I20260808 11:37:11.117733 18247 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5d5e2ae87645427d8265a627caf4e355: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 11:37:11.247030 18269 catalog_manager.cc:1259] Loaded cluster ID: 9d42563b988f4e3cbea7311b09f4c8ba
I20260808 11:37:11.247149 18269 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4d3d4bb34e4b4d6d9f0d9faaefd1b2a0: loading cluster ID for follower catalog manager: success
I20260808 11:37:11.250030 18269 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4d3d4bb34e4b4d6d9f0d9faaefd1b2a0: acquiring CA information for follower catalog manager: success
I20260808 11:37:11.252137 18269 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4d3d4bb34e4b4d6d9f0d9faaefd1b2a0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 11:37:11.511711 18338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:11.503370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33990 (local address 127.26.66.189:36481)
0808 11:37:11.504909 (+ 1539us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:11.504915 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:11.505143 (+ 228us) server_negotiation.cc:407] Connection header received
0808 11:37:11.505420 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:11.505424 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:11.505656 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:11.505772 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:37:11.506335 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:11.507247 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:11.509278 (+ 2031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:11.509752 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:11.509867 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:11.510446 (+ 579us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:37:11.511023 (+ 577us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:37:11.511128 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:11.511287 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 11:37:11.511350 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1411,"thread_start_us":1237,"threads_started":1}
I20260808 11:37:11.524940 18345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:11.518101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59076 (local address 127.26.66.188:34639)
0808 11:37:11.518643 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:11.518649 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:11.518994 (+ 345us) server_negotiation.cc:407] Connection header received
0808 11:37:11.519211 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:11.519215 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:11.519361 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:11.519537 (+ 176us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:37:11.520053 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:11.520744 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:11.522570 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:11.522977 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:11.523064 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:11.523655 (+ 591us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:37:11.524248 (+ 593us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:37:11.524373 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:11.524534 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 11:37:11.524602 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":268,"threads_started":1}
I20260808 11:37:11.553668 18338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:11.533228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33998 (local address 127.26.66.189:36481)
0808 11:37:11.533661 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:11.533669 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:11.546395 (+ 12726us) server_negotiation.cc:407] Connection header received
0808 11:37:11.546690 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:11.546697 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:11.546822 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:11.546924 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:37:11.547787 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:11.548942 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:11.551281 (+ 2339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:11.552026 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:11.552134 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:11.552759 (+ 625us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:37:11.552903 (+ 144us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:37:11.552969 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:11.553216 (+ 247us) server_negotiation.cc:299] Negotiation successful
0808 11:37:11.553306 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302}
I20260808 11:37:11.556320 18352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:11.533873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45238 (local address 127.26.66.190:46179)
0808 11:37:11.535165 (+ 1292us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:11.535171 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:11.545431 (+ 10260us) server_negotiation.cc:407] Connection header received
0808 11:37:11.545731 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:11.545739 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:11.545999 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:11.546203 (+ 204us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:37:11.546863 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:11.548477 (+ 1614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:11.552294 (+ 3817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:11.552934 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:11.553050 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:11.554784 (+ 1734us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:37:11.555235 (+ 451us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:37:11.555351 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:11.555883 (+ 532us) server_negotiation.cc:299] Negotiation successful
0808 11:37:11.556012 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1165,"thread_start_us":1061,"threads_started":1}
I20260808 11:37:11.557919 18345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:11.537187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59078 (local address 127.26.66.188:34639)
0808 11:37:11.537415 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:11.537424 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:11.550976 (+ 13552us) server_negotiation.cc:407] Connection header received
0808 11:37:11.551280 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:11.551285 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:11.551404 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:11.551474 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:37:11.552286 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:11.553376 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:11.555748 (+ 2372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:11.556382 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:11.556487 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:11.557086 (+ 599us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:37:11.557223 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:37:11.557322 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:11.557542 (+ 220us) server_negotiation.cc:299] Negotiation successful
0808 11:37:11.557627 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 11:37:11.562811 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 17980
I20260808 11:37:11.564090 18045 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:37:11.678427 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 17980
I20260808 11:37:11.705302 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 18058
I20260808 11:37:11.706430 18121 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:37:11.814846 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 18058
I20260808 11:37:11.839432 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 18134
I20260808 11:37:11.840588 18198 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:37:11.949167 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 18134
2026-08-08T11:37:11Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5100 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 11:37:12 dist-test-slave-zkpd krb5kdc[18359](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 11:37:12 dist-test-slave-zkpd krb5kdc[18359](info): set up 2 sockets
Aug 08 11:37:12 dist-test-slave-zkpd krb5kdc[18359](info): commencing operation
krb5kdc: starting...
W20260808 11:37:13.126629 26890 mini_kdc.cc:121] Time spent starting KDC: real 1.132s user 0.000s sys 0.055s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/krb5kdc/test-user.keytab.
Aug 08 11:37:13 dist-test-slave-zkpd krb5kdc[18359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T11:37:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T11:37:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.66.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
Entry for principal kudu/127.26.66.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab.
I20260808 11:37:13.479283 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:41477
--webserver_interface=127.26.66.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:41151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:41477,127.26.66.189:33773,127.26.66.188:46293
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 11:37:13.838053 18372 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 11:37:13.838450 18372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:37:13.838589 18372 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:37:13.838737 18372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:37:13.846009 18372 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:37:13.846139 18372 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:37:13.846253 18372 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:37:13.846344 18372 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:37:13.846436 18372 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:37:13.856139 18372 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:41151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:41477,127.26.66.189:33773,127.26.66.188:46293
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.190.keytab
--principal=kudu/127.26.66.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.190:41477
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.66.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:37:13.857440 18372 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:37:13.858824 18372 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:37:13.871098 18378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:37:13.871126 18377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:37:13.871380 18380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:37:13.872102 18372 server_base.cc:1034] running on GCE node
I20260808 11:37:13.872915 18372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:37:13.874334 18372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:37:13.875558 18372 hybrid_clock.cc:648] HybridClock initialized: now 1786189033875493 us; error 29 us; skew 500 ppm
I20260808 11:37:13.875955 18372 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:37:13 dist-test-slave-zkpd krb5kdc[18359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189033, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:37:13.883847 18372 init.cc:377] Logged in from keytab as kudu/127.26.66.190@KRBTEST.COM (short username kudu)
I20260808 11:37:13.885391 18372 webserver.cc:460] Webserver started at http://127.26.66.190:34677/ using document root <none> and password file <none>
I20260808 11:37:13.886090 18372 fs_manager.cc:359] Metadata directory not provided
I20260808 11:37:13.886229 18372 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:37:13.886575 18372 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:37:13.889645 18372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-0/data/instance:
uuid: "b03b9618720b4199895ab811ee0a370c"
format_stamp: "Formatted at 2026-08-08 11:37:13 on dist-test-slave-zkpd"
server_key: "723a15630f706350cfb36d58c68c0694"
server_key_iv: "e27cc97097e65733d8bc73eb4b405520"
server_key_version: "encryptionkey@0"
I20260808 11:37:13.890496 18372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-0/wal/instance:
uuid: "b03b9618720b4199895ab811ee0a370c"
format_stamp: "Formatted at 2026-08-08 11:37:13 on dist-test-slave-zkpd"
server_key: "723a15630f706350cfb36d58c68c0694"
server_key_iv: "e27cc97097e65733d8bc73eb4b405520"
server_key_version: "encryptionkey@0"
I20260808 11:37:13.895838 18372 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 11:37:13.899328 18387 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:37:13.900755 18372 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 11:37:13.900955 18372 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-0/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-0/wal
uuid: "b03b9618720b4199895ab811ee0a370c"
format_stamp: "Formatted at 2026-08-08 11:37:13 on dist-test-slave-zkpd"
server_key: "723a15630f706350cfb36d58c68c0694"
server_key_iv: "e27cc97097e65733d8bc73eb4b405520"
server_key_version: "encryptionkey@0"
I20260808 11:37:13.901180 18372 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:37:13.918597 18372 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:37:13.922808 18372 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:37:13.923079 18372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:37:13.942688 18372 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.190:41477
I20260808 11:37:13.942776 18441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.190:41477 every 8 connection(s)
I20260808 11:37:13.944085 18372 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-0/data/info.pb
I20260808 11:37:13.947820 18442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:37:13.952853 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 18372
I20260808 11:37:13.953053 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-0/wal/instance
I20260808 11:37:13.953573 26890 external_mini_cluster.cc:1428] Setting key 58103f49255a497ae5994772eca62cbe
I20260808 11:37:13.955060 18442 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.190" port: 41477 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 11:37:13 dist-test-slave-zkpd krb5kdc[18359](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189033, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:37:13.980451 18444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:13.958933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:41477 (local address 127.0.0.1:36808)
0808 11:37:13.959864 (+ 931us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:13.959947 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0808 11:37:13.962671 (+ 2724us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:37:13.963550 (+ 879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:37:13.963560 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:37:13.964459 (+ 899us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:37:13.964976 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:13.965012 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:13.966570 (+ 1558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:13.966578 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:13.968485 (+ 1907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:13.968503 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:13.969447 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:13.969457 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:13.969674 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:13.970399 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:37:13.970432 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:37:13.973084 (+ 2652us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:37:13.976319 (+ 3235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:13.976330 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:13.976340 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:13.976733 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:13.977157 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:13.977162 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:13.977166 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:13.977322 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:13.978040 (+ 718us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:37:13.978048 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:37:13.978282 (+ 234us) client_negotiation.cc:769] Sending connection context
0808 11:37:13.978521 (+ 239us) client_negotiation.cc:240] Negotiation successful
0808 11:37:13.979105 (+ 584us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":628,"mutex_wait_us":148,"thread_start_us":392,"threads_started":1}
I20260808 11:37:13.980477 18445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:13.958933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36808 (local address 127.26.66.190:41477)
0808 11:37:13.960878 (+ 1945us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:13.960883 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:13.960931 (+ 48us) server_negotiation.cc:407] Connection header received
0808 11:37:13.963070 (+ 2139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:13.963076 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:13.963305 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:13.963462 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:13.965212 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:13.966408 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:13.968639 (+ 2231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:13.969194 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:13.969322 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:13.973306 (+ 3984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:13.973314 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:13.973327 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:13.973354 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:13.976187 (+ 2833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:13.976888 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:13.976894 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:13.976896 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:13.977034 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:13.977438 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:13.977447 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:13.977449 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:13.977904 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:13.978116 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:13.978660 (+ 544us) server_negotiation.cc:299] Negotiation successful
0808 11:37:13.978958 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1756,"spinlock_wait_cycles":80768,"thread_start_us":1516,"threads_started":1}
I20260808 11:37:13.983392 18442 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.189" port: 33773 } has no permanent_uuid. Determining permanent_uuid...
I20260808 11:37:13.984462 18444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:13.984078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:33773 (local address 127.0.0.1:50396)
0808 11:37:13.984240 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:13.984351 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:33773: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 11:37:13.984761 18391 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.66.189:33773: connect: Connection refused (error 111)
I20260808 11:37:13.986304 18444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:13.985972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:33773 (local address 127.0.0.1:50406)
0808 11:37:13.986114 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:13.986188 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:33773: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 11:37:13.986529 18442 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.189:33773: Network error: Client connection negotiation failed: client connection to 127.26.66.189:33773: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.26.66.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.189.keytab.
Entry for principal kudu/127.26.66.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.189.keytab.
I20260808 11:37:14.030830 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.189:33773
--webserver_interface=127.26.66.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.189.keytab
--principal=kudu/127.26.66.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:41151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:41477,127.26.66.189:33773,127.26.66.188:46293
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 11:37:14.035821 18442 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.189" port: 33773 } attempt: 1
I20260808 11:37:14.037086 18444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.036621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:33773 (local address 127.0.0.1:50408)
0808 11:37:14.036838 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.036943 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:33773: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260808 11:37:14.038081 18444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.037719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:33773 (local address 127.0.0.1:50420)
0808 11:37:14.037884 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.037953 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:33773: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 11:37:14.038242 18442 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.189:33773: Network error: Client connection negotiation failed: client connection to 127.26.66.189:33773: connect: Connection refused (error 111)
I20260808 11:37:14.106479 18442 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.189" port: 33773 } attempt: 2
I20260808 11:37:14.107832 18444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.107187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:33773 (local address 127.0.0.1:50432)
0808 11:37:14.107485 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.107611 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:33773: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260808 11:37:14.109084 18444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.108562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:33773 (local address 127.0.0.1:50438)
0808 11:37:14.108759 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.108887 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:33773: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260808 11:37:14.109321 18442 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.189:33773: Network error: Client connection negotiation failed: client connection to 127.26.66.189:33773: connect: Connection refused (error 111)
I20260808 11:37:14.200635 18442 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.189" port: 33773 } attempt: 3
I20260808 11:37:14.201992 18444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.201414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:33773 (local address 127.0.0.1:50444)
0808 11:37:14.201684 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.201813 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:33773: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260808 11:37:14.203120 18444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.202666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:33773 (local address 127.0.0.1:50458)
0808 11:37:14.202849 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.202945 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:33773: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260808 11:37:14.203339 18442 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.189:33773: Network error: Client connection negotiation failed: client connection to 127.26.66.189:33773: connect: Connection refused (error 111)
I20260808 11:37:14.346623 18442 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.189" port: 33773 } attempt: 4
I20260808 11:37:14.348112 18444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.347388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:33773 (local address 127.0.0.1:50470)
0808 11:37:14.347761 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.347923 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:33773: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184}
I20260808 11:37:14.349310 18444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.348861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:33773 (local address 127.0.0.1:50478)
0808 11:37:14.349026 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.349138 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.189:33773: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 11:37:14.349527 18442 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.189:33773: Network error: Client connection negotiation failed: client connection to 127.26.66.189:33773: connect: Connection refused (error 111)
W20260808 11:37:14.377560 18449 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 11:37:14.377902 18449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:37:14.378021 18449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:37:14.378165 18449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:37:14.385284 18449 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:37:14.385371 18449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:37:14.385475 18449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:37:14.385562 18449 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:37:14.385650 18449 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:37:14.395277 18449 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:41151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:41477,127.26.66.189:33773,127.26.66.188:46293
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.189.keytab
--principal=kudu/127.26.66.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.189:33773
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.66.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:37:14.396582 18449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:37:14.397851 18449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:37:14.409647 18457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:37:14.409690 18454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:37:14.409597 18455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:37:14.410650 18449 server_base.cc:1034] running on GCE node
I20260808 11:37:14.411379 18449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:37:14.412714 18449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:37:14.413934 18449 hybrid_clock.cc:648] HybridClock initialized: now 1786189034413875 us; error 34 us; skew 500 ppm
I20260808 11:37:14.414263 18449 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:37:14 dist-test-slave-zkpd krb5kdc[18359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189034, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:37:14.417539 18449 init.cc:377] Logged in from keytab as kudu/127.26.66.189@KRBTEST.COM (short username kudu)
I20260808 11:37:14.418978 18449 webserver.cc:460] Webserver started at http://127.26.66.189:42039/ using document root <none> and password file <none>
I20260808 11:37:14.419663 18449 fs_manager.cc:359] Metadata directory not provided
I20260808 11:37:14.419780 18449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:37:14.420128 18449 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:37:14.423099 18449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-1/data/instance:
uuid: "6957ca68eaf84ced95553e31e3437d82"
format_stamp: "Formatted at 2026-08-08 11:37:14 on dist-test-slave-zkpd"
server_key: "4f3edb14aa7053032f70d75d07a31376"
server_key_iv: "730e2cb476076ae167eb9d5e9b5575f9"
server_key_version: "encryptionkey@0"
I20260808 11:37:14.423936 18449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-1/wal/instance:
uuid: "6957ca68eaf84ced95553e31e3437d82"
format_stamp: "Formatted at 2026-08-08 11:37:14 on dist-test-slave-zkpd"
server_key: "4f3edb14aa7053032f70d75d07a31376"
server_key_iv: "730e2cb476076ae167eb9d5e9b5575f9"
server_key_version: "encryptionkey@0"
I20260808 11:37:14.429143 18449 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 11:37:14.432530 18464 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:37:14.433809 18449 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 11:37:14.434001 18449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-1/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-1/wal
uuid: "6957ca68eaf84ced95553e31e3437d82"
format_stamp: "Formatted at 2026-08-08 11:37:14 on dist-test-slave-zkpd"
server_key: "4f3edb14aa7053032f70d75d07a31376"
server_key_iv: "730e2cb476076ae167eb9d5e9b5575f9"
server_key_version: "encryptionkey@0"
I20260808 11:37:14.434186 18449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:37:14.462081 18449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:37:14.466727 18449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:37:14.467001 18449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:37:14.486397 18449 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.189:33773
I20260808 11:37:14.486439 18517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.189:33773 every 8 connection(s)
I20260808 11:37:14.487746 18449 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-1/data/info.pb
I20260808 11:37:14.491427 18518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:37:14.493721 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 18449
I20260808 11:37:14.493922 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-1/wal/instance
I20260808 11:37:14.494483 26890 external_mini_cluster.cc:1428] Setting key 6514f13e805a7929055afd772d89395c
I20260808 11:37:14.500861 18518 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.190" port: 41477 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 11:37:14 dist-test-slave-zkpd krb5kdc[18359](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189034, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.189@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:37:14.525211 18520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.504112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36816 (local address 127.26.66.190:41477)
0808 11:37:14.504633 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:14.504640 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:14.505888 (+ 1248us) server_negotiation.cc:407] Connection header received
0808 11:37:14.508652 (+ 2764us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:14.508656 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:14.508726 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:14.508829 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:14.510905 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:14.511742 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:14.513281 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:14.514071 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:14.514216 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:14.517847 (+ 3631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:14.517859 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:14.517867 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:14.517940 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:14.521841 (+ 3901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:14.522563 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:14.522571 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:14.522577 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:14.522730 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:14.523136 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:14.523144 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:14.523149 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:14.523572 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:14.523730 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:14.524440 (+ 710us) server_negotiation.cc:299] Negotiation successful
0808 11:37:14.524722 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":264,"threads_started":1}
I20260808 11:37:14.525701 18521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.504716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:41477 (local address 127.0.0.1:36816)
0808 11:37:14.505596 (+ 880us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.505647 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 11:37:14.508375 (+ 2728us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:37:14.509090 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:37:14.509103 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:37:14.509903 (+ 800us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:37:14.510682 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:14.510710 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:14.511965 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:14.511969 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:14.513126 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:14.513139 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:14.514276 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:14.514281 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:14.514481 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:14.515160 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:37:14.515186 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:37:14.517599 (+ 2413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:37:14.521990 (+ 4391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:14.521996 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:14.522006 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:14.522428 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:14.522843 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:14.522846 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:14.522848 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:14.523005 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:14.523696 (+ 691us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:37:14.523701 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:37:14.524051 (+ 350us) client_negotiation.cc:769] Sending connection context
0808 11:37:14.524266 (+ 215us) client_negotiation.cc:240] Negotiation successful
0808 11:37:14.524642 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":347,"threads_started":1}
I20260808 11:37:14.527362 18518 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.189" port: 33773 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.66.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.66.188@KRBTEST.COM" created.
Aug 08 11:37:14 dist-test-slave-zkpd krb5kdc[18359](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189034, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.189@KRBTEST.COM for kudu/127.26.66.189@KRBTEST.COM
I20260808 11:37:14.543533 18523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.528361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50488 (local address 127.26.66.189:33773)
0808 11:37:14.529031 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:14.529040 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:14.529079 (+ 39us) server_negotiation.cc:407] Connection header received
0808 11:37:14.529122 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:14.529128 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:14.529288 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:14.529404 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:14.530445 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:14.531456 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:14.533258 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:14.533846 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:14.533951 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:14.537588 (+ 3637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:14.537600 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:14.537612 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:14.537668 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:14.540672 (+ 3004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:14.541451 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:14.541457 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:14.541459 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:14.541569 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:14.542009 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:14.542012 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:14.542014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:14.542341 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:14.542502 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:14.542923 (+ 421us) server_negotiation.cc:299] Negotiation successful
0808 11:37:14.543231 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":120,"server-negotiator.queue_time_us":458,"thread_start_us":307,"threads_started":1}
I20260808 11:37:14.543576 18521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.528128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:33773 (local address 127.0.0.1:50488)
0808 11:37:14.528360 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.528383 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 11:37:14.528486 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:37:14.529468 (+ 982us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:37:14.529476 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:37:14.530024 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:37:14.530248 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:14.530264 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:14.531607 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:14.531615 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:14.533118 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:14.533134 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:14.533979 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:14.533983 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:14.534117 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:14.534691 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:37:14.534708 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:37:14.537389 (+ 2681us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:37:14.540800 (+ 3411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:14.540807 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:14.540820 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:14.541330 (+ 510us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:14.541694 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:14.541701 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:14.541707 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:14.541895 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:14.542470 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:37:14.542477 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:37:14.542649 (+ 172us) client_negotiation.cc:769] Sending connection context
0808 11:37:14.542802 (+ 153us) client_negotiation.cc:240] Negotiation successful
0808 11:37:14.543119 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 11:37:14.546207 18518 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } has no permanent_uuid. Determining permanent_uuid...
I20260808 11:37:14.547493 18521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.546914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:46293 (local address 127.0.0.1:43976)
0808 11:37:14.547116 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.547291 (+ 175us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260808 11:37:14.547840 18467 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
I20260808 11:37:14.549602 18521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.549138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:46293 (local address 127.0.0.1:43992)
0808 11:37:14.549339 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.549451 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 11:37:14.549830 18518 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.188:46293: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.66.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.188.keytab.
Entry for principal kudu/127.26.66.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.188.keytab.
I20260808 11:37:14.577482 26890 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
/tmp/dist-test-taskmiEqRe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.188:46293
--webserver_interface=127.26.66.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.188.keytab
--principal=kudu/127.26.66.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.66.148:41151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.66.190:41477,127.26.66.189:33773,127.26.66.188:46293
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 11:37:14.599164 18518 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } attempt: 1
I20260808 11:37:14.600461 18521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.599980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:46293 (local address 127.0.0.1:43996)
0808 11:37:14.600177 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.600269 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 11:37:14.601517 18521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.601167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:46293 (local address 127.0.0.1:44012)
0808 11:37:14.601350 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.601419 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 11:37:14.601716 18518 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.188:46293: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
I20260808 11:37:14.648766 18442 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.189" port: 33773 } attempt: 5
Aug 08 11:37:14 dist-test-slave-zkpd krb5kdc[18359](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189033, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for kudu/127.26.66.189@KRBTEST.COM
I20260808 11:37:14.663064 18523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.649744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50502 (local address 127.26.66.189:33773)
0808 11:37:14.649968 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:14.649975 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:14.649999 (+ 24us) server_negotiation.cc:407] Connection header received
0808 11:37:14.650069 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:14.650077 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:14.650161 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:14.650273 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:14.651035 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:14.652192 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:14.653326 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:14.654086 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:14.654223 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:14.657679 (+ 3456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:14.657683 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:14.657687 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:14.657718 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:14.660476 (+ 2758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:14.661308 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:14.661311 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:14.661313 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:14.661422 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:14.661840 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:14.661843 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:14.661844 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:14.662092 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:14.662215 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:14.662665 (+ 450us) server_negotiation.cc:299] Negotiation successful
0808 11:37:14.662840 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 11:37:14.663321 18444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.649536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:33773 (local address 127.0.0.1:50502)
0808 11:37:14.649769 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.649792 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 11:37:14.649926 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:37:14.650328 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:37:14.650332 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:37:14.650688 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:37:14.650884 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:14.650892 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:14.652323 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:14.652327 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:14.653172 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:14.653183 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:14.654230 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:14.654233 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:14.654393 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:14.655028 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:37:14.655045 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:37:14.657498 (+ 2453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:37:14.660620 (+ 3122us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:14.660626 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:14.660630 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:14.661196 (+ 566us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:14.661536 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:14.661541 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:14.661545 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:14.661725 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:14.662237 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:37:14.662245 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:37:14.662408 (+ 163us) client_negotiation.cc:769] Sending connection context
0808 11:37:14.662589 (+ 181us) client_negotiation.cc:240] Negotiation successful
0808 11:37:14.662919 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79}
I20260808 11:37:14.664398 18442 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } has no permanent_uuid. Determining permanent_uuid...
I20260808 11:37:14.665563 18444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.665194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:46293 (local address 127.0.0.1:44024)
0808 11:37:14.665359 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.665440 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 11:37:14.666713 18444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.666411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:46293 (local address 127.0.0.1:44032)
0808 11:37:14.666539 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.666619 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 11:37:14.666991 18442 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.188:46293: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
I20260808 11:37:14.669914 18518 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } attempt: 2
I20260808 11:37:14.670730 18521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.670367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:46293 (local address 127.0.0.1:44042)
0808 11:37:14.670523 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.670604 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 11:37:14.671640 18521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.671325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:46293 (local address 127.0.0.1:44050)
0808 11:37:14.671474 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.671534 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 11:37:14.671841 18518 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.188:46293: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
I20260808 11:37:14.718215 18442 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } attempt: 1
I20260808 11:37:14.719430 18444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.718914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:46293 (local address 127.0.0.1:44062)
0808 11:37:14.719136 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.719242 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260808 11:37:14.720758 18444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.720235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:46293 (local address 127.0.0.1:44078)
0808 11:37:14.720438 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.720554 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260808 11:37:14.721031 18442 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.188:46293: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
I20260808 11:37:14.763235 18518 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } attempt: 3
I20260808 11:37:14.764482 18521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.764013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:46293 (local address 127.0.0.1:44084)
0808 11:37:14.764226 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.764326 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260808 11:37:14.765573 18521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.765176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:46293 (local address 127.0.0.1:44088)
0808 11:37:14.765402 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.765469 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
W20260808 11:37:14.765796 18518 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.188:46293: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
I20260808 11:37:14.789256 18442 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } attempt: 2
I20260808 11:37:14.790529 18444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.790046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:46293 (local address 127.0.0.1:44098)
0808 11:37:14.790273 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.790371 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260808 11:37:14.791632 18444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.791235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:46293 (local address 127.0.0.1:44110)
0808 11:37:14.791446 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.791528 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 11:37:14.791864 18442 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.188:46293: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
I20260808 11:37:14.898119 18442 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } attempt: 3
I20260808 11:37:14.899248 18444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.898778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:46293 (local address 127.0.0.1:44122)
0808 11:37:14.898991 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.899090 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260808 11:37:14.900388 18444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.900012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:46293 (local address 127.0.0.1:44130)
0808 11:37:14.900222 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.900291 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
W20260808 11:37:14.900571 18442 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.188:46293: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
I20260808 11:37:14.909054 18518 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } attempt: 4
I20260808 11:37:14.910118 18521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.909576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:46293 (local address 127.0.0.1:44144)
0808 11:37:14.909822 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.909929 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260808 11:37:14.911123 18521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:14.910803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:46293 (local address 127.0.0.1:44152)
0808 11:37:14.910950 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:14.911019 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 11:37:14.911473 18518 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.66.188:46293: Network error: Client connection negotiation failed: client connection to 127.26.66.188:46293: connect: Connection refused (error 111)
W20260808 11:37:14.938042 18527 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 11:37:14.938429 18527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 11:37:14.938565 18527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 11:37:14.938715 18527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 11:37:14.946192 18527 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 11:37:14.946283 18527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 11:37:14.946389 18527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 11:37:14.946455 18527 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 11:37:14.946580 18527 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 11:37:14.956380 18527 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.66.148:41151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.66.190:41477,127.26.66.189:33773,127.26.66.188:46293
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/krb5kdc/kudu_127.26.66.188.keytab
--principal=kudu/127.26.66.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.66.188:46293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.66.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 10:34:00 UTC on ccycloud.quasar-vgchxb.root.comops.site
build id 4574585
ASAN enabled
I20260808 11:37:14.957585 18527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 11:37:14.958926 18527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 11:37:14.970530 18535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:37:14.970577 18533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 11:37:14.970485 18532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 11:37:14.971544 18527 server_base.cc:1034] running on GCE node
I20260808 11:37:14.972360 18527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 11:37:14.973659 18527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 11:37:14.974927 18527 hybrid_clock.cc:648] HybridClock initialized: now 1786189034974869 us; error 38 us; skew 500 ppm
I20260808 11:37:14.975284 18527 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 11:37:14 dist-test-slave-zkpd krb5kdc[18359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189034, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 11:37:14.978556 18527 init.cc:377] Logged in from keytab as kudu/127.26.66.188@KRBTEST.COM (short username kudu)
I20260808 11:37:14.980043 18527 webserver.cc:460] Webserver started at http://127.26.66.188:36293/ using document root <none> and password file <none>
I20260808 11:37:14.980723 18527 fs_manager.cc:359] Metadata directory not provided
I20260808 11:37:14.980855 18527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 11:37:14.981186 18527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 11:37:14.984177 18527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-2/data/instance:
uuid: "a0637915df834decb514f45133baac31"
format_stamp: "Formatted at 2026-08-08 11:37:14 on dist-test-slave-zkpd"
server_key: "ad4779ad67d87b3e18806e52442e8b1b"
server_key_iv: "1c43218cd825e4f0aef2b98be7511fa2"
server_key_version: "encryptionkey@0"
I20260808 11:37:14.984989 18527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-2/wal/instance:
uuid: "a0637915df834decb514f45133baac31"
format_stamp: "Formatted at 2026-08-08 11:37:14 on dist-test-slave-zkpd"
server_key: "ad4779ad67d87b3e18806e52442e8b1b"
server_key_iv: "1c43218cd825e4f0aef2b98be7511fa2"
server_key_version: "encryptionkey@0"
I20260808 11:37:14.990010 18527 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 11:37:14.993328 18542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 11:37:14.994681 18527 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 11:37:14.994854 18527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-2/data,/tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-2/wal
uuid: "a0637915df834decb514f45133baac31"
format_stamp: "Formatted at 2026-08-08 11:37:14 on dist-test-slave-zkpd"
server_key: "ad4779ad67d87b3e18806e52442e8b1b"
server_key_iv: "1c43218cd825e4f0aef2b98be7511fa2"
server_key_version: "encryptionkey@0"
I20260808 11:37:14.995067 18527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 11:37:15.026072 18527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 11:37:15.030134 18527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 11:37:15.030431 18527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 11:37:15.049278 18527 rpc_server.cc:307] RPC server started. Bound to: 127.26.66.188:46293
I20260808 11:37:15.049311 18596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.66.188:46293 every 8 connection(s)
I20260808 11:37:15.050623 18527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-2/data/info.pb
I20260808 11:37:15.054070 26890 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu as pid 18527
I20260808 11:37:15.054276 26890 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmiEqRe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786188664137852-26890-0/minicluster-data/master-2/wal/instance
I20260808 11:37:15.054726 18597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 11:37:15.054904 26890 external_mini_cluster.cc:1428] Setting key 876d53874df2511432aa44786e04a131
I20260808 11:37:15.064527 18597 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.190" port: 41477 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 11:37:15 dist-test-slave-zkpd krb5kdc[18359](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.188@KRBTEST.COM
Aug 08 11:37:15 dist-test-slave-zkpd krb5kdc[18359](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189034, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.188@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
I20260808 11:37:15.077793 18442 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } attempt: 4
I20260808 11:37:15.080515 18600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:15.056745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44158 (local address 127.26.66.188:46293)
0808 11:37:15.057595 (+ 850us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:15.057609 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:15.057648 (+ 39us) server_negotiation.cc:407] Connection header received
0808 11:37:15.059467 (+ 1819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:15.059487 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:15.059948 (+ 461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:15.060296 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:15.062145 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.063398 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.065307 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.066017 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.066138 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:15.071088 (+ 4950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:15.071097 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:15.071106 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:15.071187 (+ 81us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:15.075515 (+ 4328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:15.076271 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:15.076278 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:15.076283 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:15.076444 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:15.076894 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:15.076901 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:15.076903 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:15.077462 (+ 559us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:15.077812 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:15.078527 (+ 715us) server_negotiation.cc:299] Negotiation successful
0808 11:37:15.078969 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":394,"threads_started":1}
I20260808 11:37:15.085207 18601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:15.067347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.190:41477 (local address 127.0.0.1:36820)
0808 11:37:15.068037 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:15.068085 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 11:37:15.068211 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:37:15.068884 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:37:15.068891 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:37:15.069505 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:37:15.069740 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:15.069749 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.071234 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.071244 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:15.073038 (+ 1794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:15.073066 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.073925 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.073937 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:15.074142 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:15.074722 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:37:15.074754 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:37:15.077243 (+ 2489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:37:15.081989 (+ 4746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:15.081998 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:15.082004 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:15.082602 (+ 598us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:15.083106 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:15.083110 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:15.083113 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:15.083266 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:15.084013 (+ 747us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:37:15.084020 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:37:15.084242 (+ 222us) client_negotiation.cc:769] Sending connection context
0808 11:37:15.084450 (+ 208us) client_negotiation.cc:240] Negotiation successful
0808 11:37:15.084769 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":303,"threads_started":1}
I20260808 11:37:15.085738 18602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:15.067409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36820 (local address 127.26.66.190:41477)
0808 11:37:15.068566 (+ 1157us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:15.068570 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:15.068584 (+ 14us) server_negotiation.cc:407] Connection header received
0808 11:37:15.068631 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:15.068634 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:15.068696 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:15.068822 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:15.069927 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.071056 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.073235 (+ 2179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.073681 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.073793 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:15.077449 (+ 3656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:15.077455 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:15.077460 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:15.077513 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:15.081818 (+ 4305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:15.082747 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:15.082754 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:15.082762 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:15.082954 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:15.083420 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:15.083425 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:15.083429 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:15.083782 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:15.083945 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:15.084597 (+ 652us) server_negotiation.cc:299] Negotiation successful
0808 11:37:15.084882 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1066,"thread_start_us":984,"threads_started":1}
Aug 08 11:37:15 dist-test-slave-zkpd krb5kdc[18359](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189033, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.190@KRBTEST.COM for kudu/127.26.66.188@KRBTEST.COM
I20260808 11:37:15.087293 18597 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.189" port: 33773 } has no permanent_uuid. Determining permanent_uuid...
I20260808 11:37:15.094597 18444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:15.078366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:46293 (local address 127.0.0.1:44168)
0808 11:37:15.078995 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:15.079015 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 11:37:15.079116 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:37:15.079477 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:37:15.079485 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:37:15.080060 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:37:15.080225 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:15.080233 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.081898 (+ 1665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.081904 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:15.082988 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:15.083002 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.083984 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.083990 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:15.084216 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:15.084844 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:37:15.084866 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:37:15.087804 (+ 2938us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:37:15.091728 (+ 3924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:15.091733 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:15.091737 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:15.092316 (+ 579us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:15.092763 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:15.092771 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:15.092777 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:15.092946 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:15.093634 (+ 688us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:37:15.093638 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:37:15.093771 (+ 133us) client_negotiation.cc:769] Sending connection context
0808 11:37:15.093955 (+ 184us) client_negotiation.cc:240] Negotiation successful
0808 11:37:15.094223 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514}
I20260808 11:37:15.094784 18603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:15.078578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44168 (local address 127.26.66.188:46293)
0808 11:37:15.079224 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:15.079228 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:15.079245 (+ 17us) server_negotiation.cc:407] Connection header received
0808 11:37:15.079280 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:15.079283 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:15.079331 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:15.079447 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:15.080419 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.081715 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.083153 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.083762 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.084486 (+ 724us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:15.088152 (+ 3666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:15.088159 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:15.088164 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:15.088200 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:15.091610 (+ 3410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:15.092464 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:15.092470 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:15.092472 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:15.092628 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:15.093063 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:15.093067 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:15.093069 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:15.093468 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:15.093620 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:15.094128 (+ 508us) server_negotiation.cc:299] Negotiation successful
0808 11:37:15.094380 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":598,"threads_started":1}
Aug 08 11:37:15 dist-test-slave-zkpd krb5kdc[18359](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.190@KRBTEST.COM
Aug 08 11:37:15 dist-test-slave-zkpd krb5kdc[18359](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189034, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.188@KRBTEST.COM for kudu/127.26.66.189@KRBTEST.COM
I20260808 11:37:15.100499 18442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c: Bootstrap starting.
I20260808 11:37:15.104554 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:15.083841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36824 (local address 127.26.66.190:41477)
0808 11:37:15.085828 (+ 1987us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:15.085834 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:15.085858 (+ 24us) server_negotiation.cc:407] Connection header received
0808 11:37:15.085907 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:15.085912 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:15.085989 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:15.086116 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:15.087678 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.088988 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.091589 (+ 2601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.092324 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.092431 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:15.098136 (+ 5705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:15.098141 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:15.098144 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:15.098195 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:15.101398 (+ 3203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:15.102254 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:15.102261 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:15.102265 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:15.102478 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:15.102951 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:15.102956 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:15.102959 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:15.103285 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:15.103548 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:15.103929 (+ 381us) server_negotiation.cc:299] Negotiation successful
0808 11:37:15.104141 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1851,"thread_start_us":1602,"threads_started":1}
I20260808 11:37:15.104789 18523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:15.088090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50516 (local address 127.26.66.189:33773)
0808 11:37:15.088262 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:15.088270 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:15.088290 (+ 20us) server_negotiation.cc:407] Connection header received
0808 11:37:15.088462 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:15.088467 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:15.088541 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:15.088643 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:15.089505 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.090390 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.091606 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.092159 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.092299 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:15.097860 (+ 5561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:15.097866 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:15.097873 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:15.097916 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:15.101699 (+ 3783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:15.102530 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:15.102537 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:15.102540 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:15.102684 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:15.103133 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:15.103139 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:15.103143 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:15.103494 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:15.103634 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:15.104209 (+ 575us) server_negotiation.cc:299] Negotiation successful
0808 11:37:15.104427 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 11:37:15.105434 18442 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c: Neither blocks nor log segments found. Creating new log.
I20260808 11:37:15.105638 18601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:15.087979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.189:33773 (local address 127.0.0.1:50516)
0808 11:37:15.088202 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:15.088234 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 11:37:15.088333 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:37:15.088669 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:37:15.088673 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:37:15.089199 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:37:15.089356 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:15.089365 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.090533 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.090544 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:15.091416 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:15.091427 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.092321 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.092327 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:15.092534 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:15.093761 (+ 1227us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:37:15.093783 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:37:15.097650 (+ 3867us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:37:15.101860 (+ 4210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:15.101865 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:15.101875 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:15.102407 (+ 532us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:15.102799 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:15.102804 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:15.102808 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:15.103003 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:15.103701 (+ 698us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:37:15.103706 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:37:15.103859 (+ 153us) client_negotiation.cc:769] Sending connection context
0808 11:37:15.104971 (+ 1112us) client_negotiation.cc:240] Negotiation successful
0808 11:37:15.105272 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124}
I20260808 11:37:15.106765 18442 log.cc:824] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c: Log is configured to *not* fsync() on all Append() calls
I20260808 11:37:15.107116 18597 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } has no permanent_uuid. Determining permanent_uuid...
I20260808 11:37:15.110353 18442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c: No bootstrap required, opened a new log
Aug 08 11:37:15 dist-test-slave-zkpd krb5kdc[18359](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189034, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.188@KRBTEST.COM for kudu/127.26.66.188@KRBTEST.COM
Aug 08 11:37:15 dist-test-slave-zkpd krb5kdc[18359](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.66.189@KRBTEST.COM
I20260808 11:37:15.119750 18442 raft_consensus.cc:348] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b03b9618720b4199895ab811ee0a370c" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 41477 } } peers { permanent_uuid: "6957ca68eaf84ced95553e31e3437d82" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 33773 } } peers { permanent_uuid: "a0637915df834decb514f45133baac31" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } }
I20260808 11:37:15.120172 18442 raft_consensus.cc:729] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b03b9618720b4199895ab811ee0a370c, State: Initialized, Role: FOLLOWER
I20260808 11:37:15.120767 18442 consensus_queue.cc:260] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b03b9618720b4199895ab811ee0a370c" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 41477 } } peers { permanent_uuid: "6957ca68eaf84ced95553e31e3437d82" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 33773 } } peers { permanent_uuid: "a0637915df834decb514f45133baac31" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } }
I20260808 11:37:15.121793 18606 sys_catalog.cc:455] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b03b9618720b4199895ab811ee0a370c" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 41477 } } peers { permanent_uuid: "6957ca68eaf84ced95553e31e3437d82" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 33773 } } peers { permanent_uuid: "a0637915df834decb514f45133baac31" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } } }
I20260808 11:37:15.122238 18606 sys_catalog.cc:458] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c [sys.catalog]: This master's current role is: FOLLOWER
I20260808 11:37:15.123256 18442 sys_catalog.cc:564] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:37:15.123463 18603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:15.107946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44184 (local address 127.26.66.188:46293)
0808 11:37:15.108120 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:15.108125 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:15.108273 (+ 148us) server_negotiation.cc:407] Connection header received
0808 11:37:15.108418 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:15.108421 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:15.108486 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:15.108589 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:15.109329 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.110343 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.111954 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.112389 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.112510 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:15.116493 (+ 3983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:15.116500 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:15.116505 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:15.116541 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:15.120131 (+ 3590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:15.120954 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:15.120960 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:15.120965 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:15.121121 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:15.121596 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:15.121603 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:15.121608 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:15.121960 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:15.122079 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:15.122788 (+ 709us) server_negotiation.cc:299] Negotiation successful
0808 11:37:15.123103 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":102,"server-negotiator.queue_time_us":64}
I20260808 11:37:15.124125 18523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:15.106384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50524 (local address 127.26.66.189:33773)
0808 11:37:15.106577 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:15.106582 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:15.106872 (+ 290us) server_negotiation.cc:407] Connection header received
0808 11:37:15.107102 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:15.107108 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:15.107182 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:15.107298 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:15.109116 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.109890 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.111600 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.112281 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.112421 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:15.117465 (+ 5044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:15.117473 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:15.117479 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:15.117519 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:15.120935 (+ 3416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:15.121799 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:15.121805 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:15.121809 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:15.121995 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:15.122496 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:15.122499 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:15.122502 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:15.122838 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:15.123122 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:15.123432 (+ 310us) server_negotiation.cc:299] Negotiation successful
0808 11:37:15.123748 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 11:37:15.124377 18601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:15.107919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:46293 (local address 127.0.0.1:44184)
0808 11:37:15.108171 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:15.108189 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 11:37:15.108308 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:37:15.108607 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:37:15.108612 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:37:15.108979 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:37:15.109162 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:15.109176 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.110526 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.110533 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:15.111771 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:15.111783 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.112680 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.112686 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:15.112930 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:15.113511 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:37:15.113534 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:37:15.116302 (+ 2768us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:37:15.120281 (+ 3979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:15.120288 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:15.120305 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:15.120821 (+ 516us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:15.121257 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:15.121263 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:15.121269 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:15.121473 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:15.122164 (+ 691us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:37:15.122168 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:37:15.122485 (+ 317us) client_negotiation.cc:769] Sending connection context
0808 11:37:15.122666 (+ 181us) client_negotiation.cc:240] Negotiation successful
0808 11:37:15.123839 (+ 1173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142}
I20260808 11:37:15.129739 26890 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 11:37:15.130450 18597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0637915df834decb514f45133baac31: Bootstrap starting.
I20260808 11:37:15.132951 18415 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "b03b9618720b4199895ab811ee0a370c"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36824
I20260808 11:37:15.133366 18415 raft_consensus.cc:482] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 11:37:15.133584 18415 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:37:15.134728 18597 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0637915df834decb514f45133baac31: Neither blocks nor log segments found. Creating new log.
I20260808 11:37:15.136122 18597 log.cc:824] T 00000000000000000000000000000000 P a0637915df834decb514f45133baac31: Log is configured to *not* fsync() on all Append() calls
W20260808 11:37:15.137399 18618 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 11:37:15.137516 18618 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 11:37:15.138142 18415 raft_consensus.cc:504] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b03b9618720b4199895ab811ee0a370c" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 41477 } } peers { permanent_uuid: "6957ca68eaf84ced95553e31e3437d82" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 33773 } } peers { permanent_uuid: "a0637915df834decb514f45133baac31" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } }
I20260808 11:37:15.141582 18415 leader_election.cc:288] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c [CANDIDATE]: Term 1 election: Requested vote from peers 6957ca68eaf84ced95553e31e3437d82 (127.26.66.189:33773), a0637915df834decb514f45133baac31 (127.26.66.188:46293)
I20260808 11:37:15.151188 18597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0637915df834decb514f45133baac31: No bootstrap required, opened a new log
I20260808 11:37:15.142890 18372 master_runner.cc:186] Error getting master registration for 127.26.66.189:33773: OK, instance_id { permanent_uuid: "6957ca68eaf84ced95553e31e3437d82" instance_seqno: 1786189034480844 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 11:37:15.165249 18372 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 11:37:15.173198 18597 raft_consensus.cc:348] T 00000000000000000000000000000000 P a0637915df834decb514f45133baac31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b03b9618720b4199895ab811ee0a370c" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 41477 } } peers { permanent_uuid: "6957ca68eaf84ced95553e31e3437d82" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 33773 } } peers { permanent_uuid: "a0637915df834decb514f45133baac31" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } }
I20260808 11:37:15.173641 18597 raft_consensus.cc:729] T 00000000000000000000000000000000 P a0637915df834decb514f45133baac31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0637915df834decb514f45133baac31, State: Initialized, Role: FOLLOWER
I20260808 11:37:15.174206 18597 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0637915df834decb514f45133baac31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b03b9618720b4199895ab811ee0a370c" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 41477 } } peers { permanent_uuid: "6957ca68eaf84ced95553e31e3437d82" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 33773 } } peers { permanent_uuid: "a0637915df834decb514f45133baac31" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } }
I20260808 11:37:15.175110 18626 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0637915df834decb514f45133baac31 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b03b9618720b4199895ab811ee0a370c" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 41477 } } peers { permanent_uuid: "6957ca68eaf84ced95553e31e3437d82" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 33773 } } peers { permanent_uuid: "a0637915df834decb514f45133baac31" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } } }
I20260808 11:37:15.175524 18626 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0637915df834decb514f45133baac31 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 11:37:15.176075 18393 tablet.cc:2369] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:37:15.180858 18597 sys_catalog.cc:564] T 00000000000000000000000000000000 P a0637915df834decb514f45133baac31 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:37:15.180967 18572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b03b9618720b4199895ab811ee0a370c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a0637915df834decb514f45133baac31"
I20260808 11:37:15.181488 18572 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a0637915df834decb514f45133baac31 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:37:15.185933 18572 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a0637915df834decb514f45133baac31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b03b9618720b4199895ab811ee0a370c in term 1.
I20260808 11:37:15.186892 18390 leader_election.cc:302] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0637915df834decb514f45133baac31, b03b9618720b4199895ab811ee0a370c; no voters:
I20260808 11:37:15.187744 18606 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 11:37:15.210667 18518 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } attempt: 5
Aug 08 11:37:15 dist-test-slave-zkpd krb5kdc[18359](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786189034, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.66.189@KRBTEST.COM for kudu/127.26.66.188@KRBTEST.COM
I20260808 11:37:15.227511 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:15.177100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36832 (local address 127.26.66.190:41477)
0808 11:37:15.177698 (+ 598us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:15.177708 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:15.178989 (+ 1281us) server_negotiation.cc:407] Connection header received
0808 11:37:15.179305 (+ 316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:15.179402 (+ 97us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:15.179521 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:15.179622 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:15.182128 (+ 2506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.183616 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.186343 (+ 2727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.187280 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.187421 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:15.201783 (+ 14362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:15.201792 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:15.201800 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:15.201858 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:15.207466 (+ 5608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:15.216956 (+ 9490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:15.216966 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:15.216972 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:15.217175 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:15.223652 (+ 6477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:15.223666 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:15.223672 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:15.224659 (+ 987us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:15.225312 (+ 653us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:15.226644 (+ 1332us) server_negotiation.cc:299] Negotiation successful
0808 11:37:15.226981 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392}
I20260808 11:37:15.229187 18606 raft_consensus.cc:686] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c [term 1 LEADER]: Becoming Leader. State: Replica: b03b9618720b4199895ab811ee0a370c, State: Running, Role: LEADER
I20260808 11:37:15.230050 18606 consensus_queue.cc:237] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b03b9618720b4199895ab811ee0a370c" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 41477 } } peers { permanent_uuid: "6957ca68eaf84ced95553e31e3437d82" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 33773 } } peers { permanent_uuid: "a0637915df834decb514f45133baac31" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } }
I20260808 11:37:15.234812 18600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:15.212372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44200 (local address 127.26.66.188:46293)
0808 11:37:15.212535 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:15.212541 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:15.212557 (+ 16us) server_negotiation.cc:407] Connection header received
0808 11:37:15.212602 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:15.212606 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:15.212675 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:15.212773 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:15.213944 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.215000 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.216846 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.217529 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.217652 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:15.223049 (+ 5397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:15.223056 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:15.223062 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:15.223100 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:15.228270 (+ 5170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:15.229769 (+ 1499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:15.229775 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:15.229778 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:15.230075 (+ 297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:15.230953 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:15.230959 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:15.230962 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:15.231652 (+ 690us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:15.232141 (+ 489us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:15.232747 (+ 606us) server_negotiation.cc:299] Negotiation successful
0808 11:37:15.233499 (+ 752us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 11:37:15.235531 18521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:15.211366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.66.188:46293 (local address 127.0.0.1:44200)
0808 11:37:15.211702 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0808 11:37:15.211725 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 11:37:15.211849 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 11:37:15.213000 (+ 1151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 11:37:15.213006 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 11:37:15.213527 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0808 11:37:15.213738 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:15.213750 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.215189 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.215195 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:15.216642 (+ 1447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 11:37:15.216659 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.217864 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.217871 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 11:37:15.218128 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:15.218799 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 11:37:15.218825 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 11:37:15.222790 (+ 3965us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 11:37:15.228488 (+ 5698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:15.228494 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:15.228498 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:15.229551 (+ 1053us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:15.230309 (+ 758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 11:37:15.230314 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 11:37:15.230317 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 11:37:15.230781 (+ 464us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 11:37:15.231831 (+ 1050us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 11:37:15.231836 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 11:37:15.232295 (+ 459us) client_negotiation.cc:769] Sending connection context
0808 11:37:15.232916 (+ 621us) client_negotiation.cc:240] Negotiation successful
0808 11:37:15.233945 (+ 1029us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172}
I20260808 11:37:15.242046 18518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6957ca68eaf84ced95553e31e3437d82: Bootstrap starting.
I20260808 11:37:15.250995 18603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:15.177420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44192 (local address 127.26.66.188:46293)
0808 11:37:15.177878 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:15.177886 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:15.190944 (+ 13058us) server_negotiation.cc:407] Connection header received
0808 11:37:15.191673 (+ 729us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:15.191680 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:15.191770 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:15.191848 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:15.200515 (+ 8667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.201627 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.209059 (+ 7432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.210067 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.210193 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:15.218168 (+ 7975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:15.218178 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:15.218186 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:15.218238 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:15.223313 (+ 5075us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:15.247763 (+ 24450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:15.247770 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:15.247774 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:15.247988 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:15.248470 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:15.248476 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:15.248482 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:15.248839 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:15.249121 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:15.250352 (+ 1231us) server_negotiation.cc:299] Negotiation successful
0808 11:37:15.250601 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316}
I20260808 11:37:15.254251 18518 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6957ca68eaf84ced95553e31e3437d82: Neither blocks nor log segments found. Creating new log.
I20260808 11:37:15.259021 18518 log.cc:824] T 00000000000000000000000000000000 P 6957ca68eaf84ced95553e31e3437d82: Log is configured to *not* fsync() on all Append() calls
I20260808 11:37:15.269034 18631 sys_catalog.cc:455] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c [sys.catalog]: SysCatalogTable state changed. Reason: New leader b03b9618720b4199895ab811ee0a370c. Latest consensus state: current_term: 1 leader_uuid: "b03b9618720b4199895ab811ee0a370c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b03b9618720b4199895ab811ee0a370c" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 41477 } } peers { permanent_uuid: "6957ca68eaf84ced95553e31e3437d82" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 33773 } } peers { permanent_uuid: "a0637915df834decb514f45133baac31" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } } }
I20260808 11:37:15.269574 18631 sys_catalog.cc:458] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c [sys.catalog]: This master's current role is: LEADER
I20260808 11:37:15.271485 18637 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 11:37:15.272185 18518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6957ca68eaf84ced95553e31e3437d82: No bootstrap required, opened a new log
I20260808 11:37:15.273361 18523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:15.178629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50532 (local address 127.26.66.189:33773)
0808 11:37:15.178855 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:15.178863 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:15.197127 (+ 18264us) server_negotiation.cc:407] Connection header received
0808 11:37:15.197792 (+ 665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:15.197799 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:15.197889 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:15.197962 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:15.205744 (+ 7782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.207177 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.211186 (+ 4009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:15.211872 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:15.212018 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:15.261180 (+ 49162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 11:37:15.261187 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 11:37:15.261192 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 11:37:15.261247 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 11:37:15.265792 (+ 4545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:15.267085 (+ 1293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:15.267090 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:15.267094 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:15.267259 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 11:37:15.271321 (+ 4062us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 11:37:15.271326 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 11:37:15.271330 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 11:37:15.271753 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 11:37:15.272026 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:15.272708 (+ 682us) server_negotiation.cc:299] Negotiation successful
0808 11:37:15.272997 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 11:37:15.273953 18637 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260808 11:37:15.282691 18548 tablet.cc:2369] T 00000000000000000000000000000000 P a0637915df834decb514f45133baac31: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 11:37:15.289552 18518 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6957ca68eaf84ced95553e31e3437d82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b03b9618720b4199895ab811ee0a370c" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 41477 } } peers { permanent_uuid: "6957ca68eaf84ced95553e31e3437d82" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 33773 } } peers { permanent_uuid: "a0637915df834decb514f45133baac31" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } }
I20260808 11:37:15.290194 18518 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6957ca68eaf84ced95553e31e3437d82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6957ca68eaf84ced95553e31e3437d82, State: Initialized, Role: FOLLOWER
I20260808 11:37:15.291010 18518 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6957ca68eaf84ced95553e31e3437d82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b03b9618720b4199895ab811ee0a370c" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 41477 } } peers { permanent_uuid: "6957ca68eaf84ced95553e31e3437d82" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 33773 } } peers { permanent_uuid: "a0637915df834decb514f45133baac31" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } }
I20260808 11:37:15.306401 18572 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a0637915df834decb514f45133baac31 [term 1 FOLLOWER]: Refusing update from remote peer b03b9618720b4199895ab811ee0a370c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:37:15.308378 18606 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0637915df834decb514f45133baac31" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:37:15.312494 18643 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6957ca68eaf84ced95553e31e3437d82 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b03b9618720b4199895ab811ee0a370c" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 41477 } } peers { permanent_uuid: "6957ca68eaf84ced95553e31e3437d82" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 33773 } } peers { permanent_uuid: "a0637915df834decb514f45133baac31" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } } }
I20260808 11:37:15.312969 18643 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6957ca68eaf84ced95553e31e3437d82 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 11:37:15.313915 18518 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6957ca68eaf84ced95553e31e3437d82 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 11:37:15.315820 18492 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6957ca68eaf84ced95553e31e3437d82 [term 0 FOLLOWER]: Advancing to term 1
I20260808 11:37:15.320638 18493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b03b9618720b4199895ab811ee0a370c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6957ca68eaf84ced95553e31e3437d82"
I20260808 11:37:15.327029 18492 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6957ca68eaf84ced95553e31e3437d82 [term 1 FOLLOWER]: Refusing update from remote peer b03b9618720b4199895ab811ee0a370c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 11:37:15.328097 18606 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6957ca68eaf84ced95553e31e3437d82" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 33773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 11:37:15.330981 18493 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6957ca68eaf84ced95553e31e3437d82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b03b9618720b4199895ab811ee0a370c in term 1.
I20260808 11:37:15.339378 18643 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6957ca68eaf84ced95553e31e3437d82 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b03b9618720b4199895ab811ee0a370c. Latest consensus state: current_term: 1 leader_uuid: "b03b9618720b4199895ab811ee0a370c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b03b9618720b4199895ab811ee0a370c" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 41477 } } peers { permanent_uuid: "6957ca68eaf84ced95553e31e3437d82" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 33773 } } peers { permanent_uuid: "a0637915df834decb514f45133baac31" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } } }
I20260808 11:37:15.339712 18643 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6957ca68eaf84ced95553e31e3437d82 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 11:37:15.356547 18643 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6957ca68eaf84ced95553e31e3437d82 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b03b9618720b4199895ab811ee0a370c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b03b9618720b4199895ab811ee0a370c" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 41477 } } peers { permanent_uuid: "6957ca68eaf84ced95553e31e3437d82" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 33773 } } peers { permanent_uuid: "a0637915df834decb514f45133baac31" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } } }
I20260808 11:37:15.356901 18643 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6957ca68eaf84ced95553e31e3437d82 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 11:37:15.368353 18626 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0637915df834decb514f45133baac31 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b03b9618720b4199895ab811ee0a370c. Latest consensus state: current_term: 1 leader_uuid: "b03b9618720b4199895ab811ee0a370c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b03b9618720b4199895ab811ee0a370c" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 41477 } } peers { permanent_uuid: "6957ca68eaf84ced95553e31e3437d82" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 33773 } } peers { permanent_uuid: "a0637915df834decb514f45133baac31" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } } }
I20260808 11:37:15.368691 18626 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0637915df834decb514f45133baac31 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 11:37:15.370992 18626 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0637915df834decb514f45133baac31 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b03b9618720b4199895ab811ee0a370c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b03b9618720b4199895ab811ee0a370c" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 41477 } } peers { permanent_uuid: "6957ca68eaf84ced95553e31e3437d82" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 33773 } } peers { permanent_uuid: "a0637915df834decb514f45133baac31" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } } }
I20260808 11:37:15.371268 18626 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0637915df834decb514f45133baac31 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 11:37:15.372136 18637 catalog_manager.cc:1347] Generated new cluster ID: a4b393b0da5b4c3db6d870729eeb9906
I20260808 11:37:15.372265 18637 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 11:37:15.371275 18650 mvcc.cc:205] Tried to move back new op lower bound from 7316230288585093120 to 7316230288310358016. Current Snapshot: MvccSnapshot[applied={T|T < 7316230288585093120}]
I20260808 11:37:15.375986 18665 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 11:37:15.375787 18606 sys_catalog.cc:455] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b03b9618720b4199895ab811ee0a370c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b03b9618720b4199895ab811ee0a370c" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 41477 } } peers { permanent_uuid: "6957ca68eaf84ced95553e31e3437d82" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 33773 } } peers { permanent_uuid: "a0637915df834decb514f45133baac31" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } } }
I20260808 11:37:15.376163 18606 sys_catalog.cc:458] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c [sys.catalog]: This master's current role is: LEADER
I20260808 11:37:15.376518 18606 sys_catalog.cc:455] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b03b9618720b4199895ab811ee0a370c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b03b9618720b4199895ab811ee0a370c" member_type: VOTER last_known_addr { host: "127.26.66.190" port: 41477 } } peers { permanent_uuid: "6957ca68eaf84ced95553e31e3437d82" member_type: VOTER last_known_addr { host: "127.26.66.189" port: 33773 } } peers { permanent_uuid: "a0637915df834decb514f45133baac31" member_type: VOTER last_known_addr { host: "127.26.66.188" port: 46293 } } }
I20260808 11:37:15.376736 18606 sys_catalog.cc:458] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c [sys.catalog]: This master's current role is: LEADER
I20260808 11:37:15.381544 18663 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 11:37:15.406749 18637 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 11:37:15.408388 18637 catalog_manager.cc:1504] Loading token signing keys...
I20260808 11:37:15.426011 18637 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b03b9618720b4199895ab811ee0a370c: Generated new TSK 0
I20260808 11:37:15.427026 18637 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 11:37:15.519513 18604 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:37:15.504804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36838 (local address 127.26.66.190:41477)
0808 11:37:15.505022 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:15.505029 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:15.517360 (+ 12331us) server_negotiation.cc:407] Connection header received
0808 11:37:15.517675 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:15.517682 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:15.517826 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:15.517907 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:15.519196 (+ 1289us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36838: BlockingRecv error: recv got EOF from 127.0.0.1:36838 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
W20260808 11:37:15.522028 18603 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:37:15.505099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44208 (local address 127.26.66.188:46293)
0808 11:37:15.505413 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:15.505421 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:15.520360 (+ 14939us) server_negotiation.cc:407] Connection header received
0808 11:37:15.520615 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:15.520621 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:15.520711 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:15.520799 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:15.521782 (+ 983us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44208: BlockingRecv error: recv got EOF from 127.0.0.1:44208 (error 108)
Metrics: {"server-negotiator.queue_time_us":146}
W20260808 11:37:15.523877 18523 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:37:15.517539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50540 (local address 127.26.66.189:33773)
0808 11:37:15.517783 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:15.517791 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:15.521123 (+ 3332us) server_negotiation.cc:407] Connection header received
0808 11:37:15.521639 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:15.521648 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:15.521766 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:15.521850 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:15.523649 (+ 1799us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50540: BlockingRecv error: recv got EOF from 127.0.0.1:50540 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260808 11:37:15.529618 18523 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:37:15.527932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50548 (local address 127.26.66.189:33773)
0808 11:37:15.528095 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:15.528099 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:15.528229 (+ 130us) server_negotiation.cc:407] Connection header received
0808 11:37:15.528409 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:15.528413 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:15.528501 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:15.528581 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:15.529370 (+ 789us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50548: BlockingRecv error: recv got EOF from 127.0.0.1:50548 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260808 11:37:15.535949 18523 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:37:15.534284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50550 (local address 127.26.66.189:33773)
0808 11:37:15.534501 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:15.534510 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:15.534838 (+ 328us) server_negotiation.cc:407] Connection header received
0808 11:37:15.534945 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:15.534952 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:15.535039 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:15.535147 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:15.535742 (+ 595us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50550: BlockingRecv error: recv got EOF from 127.0.0.1:50550 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260808 11:37:15.542877 18523 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:37:15.541064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50552 (local address 127.26.66.189:33773)
0808 11:37:15.541265 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:15.541270 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:15.541587 (+ 317us) server_negotiation.cc:407] Connection header received
0808 11:37:15.541827 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:15.541830 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:15.541899 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:15.541976 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:15.542675 (+ 699us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50552: BlockingRecv error: recv got EOF from 127.0.0.1:50552 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260808 11:37:15.552062 18523 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:37:15.550192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50566 (local address 127.26.66.189:33773)
0808 11:37:15.550430 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:15.550437 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:15.550780 (+ 343us) server_negotiation.cc:407] Connection header received
0808 11:37:15.550932 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:15.550938 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:15.551024 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:15.551137 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:15.551819 (+ 682us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50566: BlockingRecv error: recv got EOF from 127.0.0.1:50566 (error 108)
Metrics: {"server-negotiator.queue_time_us":115}
W20260808 11:37:15.565399 18523 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:37:15.563455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50582 (local address 127.26.66.189:33773)
0808 11:37:15.563669 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:15.563676 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:15.564112 (+ 436us) server_negotiation.cc:407] Connection header received
0808 11:37:15.564254 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:15.564260 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:15.564357 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:15.564481 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:15.565158 (+ 677us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50582: BlockingRecv error: recv got EOF from 127.0.0.1:50582 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260808 11:37:15.597810 18523 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:37:15.595296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50594 (local address 127.26.66.189:33773)
0808 11:37:15.595539 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:15.595545 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:15.596155 (+ 610us) server_negotiation.cc:407] Connection header received
0808 11:37:15.596381 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:15.596385 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:15.596475 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:15.596563 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:15.597507 (+ 944us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50594: BlockingRecv error: recv got EOF from 127.0.0.1:50594 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260808 11:37:15.636231 18523 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:37:15.634148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50604 (local address 127.26.66.189:33773)
0808 11:37:15.634375 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:15.634383 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:15.634759 (+ 376us) server_negotiation.cc:407] Connection header received
0808 11:37:15.634937 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:15.634944 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:15.635045 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:15.635173 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:15.635963 (+ 790us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50604: BlockingRecv error: recv got EOF from 127.0.0.1:50604 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260808 11:37:15.706360 18523 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:37:15.704452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50616 (local address 127.26.66.189:33773)
0808 11:37:15.704686 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:15.704693 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:15.704933 (+ 240us) server_negotiation.cc:407] Connection header received
0808 11:37:15.705175 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:15.705179 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:15.705251 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:15.705377 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:15.706179 (+ 802us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50616: BlockingRecv error: recv got EOF from 127.0.0.1:50616 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260808 11:37:15.840581 18523 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:37:15.838485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50628 (local address 127.26.66.189:33773)
0808 11:37:15.838736 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:15.838743 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:15.839080 (+ 337us) server_negotiation.cc:407] Connection header received
0808 11:37:15.839346 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:15.839350 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:15.839422 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:15.839539 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:15.840385 (+ 846us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50628: BlockingRecv error: recv got EOF from 127.0.0.1:50628 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260808 11:37:16.102362 18523 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 11:37:16.100460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50642 (local address 127.26.66.189:33773)
0808 11:37:16.100691 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:16.100697 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:16.100868 (+ 171us) server_negotiation.cc:407] Connection header received
0808 11:37:16.101106 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:16.101112 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:16.101194 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:16.101306 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 11:37:16.102098 (+ 792us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50642: BlockingRecv error: recv got EOF from 127.0.0.1:50642 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 11:37:16.380435 18665 catalog_manager.cc:1259] Loaded cluster ID: a4b393b0da5b4c3db6d870729eeb9906
I20260808 11:37:16.380594 18665 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6957ca68eaf84ced95553e31e3437d82: loading cluster ID for follower catalog manager: success
I20260808 11:37:16.383397 18665 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6957ca68eaf84ced95553e31e3437d82: acquiring CA information for follower catalog manager: success
I20260808 11:37:16.385996 18665 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6957ca68eaf84ced95553e31e3437d82: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 11:37:16.386569 18663 catalog_manager.cc:1259] Loaded cluster ID: a4b393b0da5b4c3db6d870729eeb9906
I20260808 11:37:16.386678 18663 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a0637915df834decb514f45133baac31: loading cluster ID for follower catalog manager: success
I20260808 11:37:16.390439 18663 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a0637915df834decb514f45133baac31: acquiring CA information for follower catalog manager: success
I20260808 11:37:16.392962 18663 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a0637915df834decb514f45133baac31: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 11:37:16.648806 18737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:16.624823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50650 (local address 127.26.66.189:33773)
0808 11:37:16.640935 (+ 16112us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:16.640945 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:16.640971 (+ 26us) server_negotiation.cc:407] Connection header received
0808 11:37:16.641063 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:16.641069 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:16.641275 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:16.641428 (+ 153us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:37:16.642050 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:16.643331 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:16.645543 (+ 2212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:16.646286 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:16.646443 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:16.647142 (+ 699us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:37:16.647982 (+ 840us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:37:16.648160 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:16.648315 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 11:37:16.648403 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15935,"thread_start_us":16020,"threads_started":1}
I20260808 11:37:16.682796 18744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:16.656597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44216 (local address 127.26.66.188:46293)
0808 11:37:16.669881 (+ 13284us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:16.669887 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:16.670477 (+ 590us) server_negotiation.cc:407] Connection header received
0808 11:37:16.670868 (+ 391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:16.670875 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:16.671108 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:16.671280 (+ 172us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:37:16.672277 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:16.673587 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:16.678047 (+ 4460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:16.678749 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:16.678902 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:16.680699 (+ 1797us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:37:16.681653 (+ 954us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:37:16.681829 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:16.682278 (+ 449us) server_negotiation.cc:299] Negotiation successful
0808 11:37:16.682375 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12150,"thread_start_us":13025,"threads_started":1}
I20260808 11:37:16.718986 18737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:16.710578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50660 (local address 127.26.66.189:33773)
0808 11:37:16.710783 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:16.710803 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:16.711682 (+ 879us) server_negotiation.cc:407] Connection header received
0808 11:37:16.712014 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:16.712021 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:16.712117 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:16.712185 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:37:16.712956 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:16.714175 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:16.716543 (+ 2368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:16.717247 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:16.717359 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:16.718061 (+ 702us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:37:16.718218 (+ 157us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:37:16.718289 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:16.718550 (+ 261us) server_negotiation.cc:299] Negotiation successful
0808 11:37:16.718638 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 11:37:16.725543 18744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:16.703011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44226 (local address 127.26.66.188:46293)
0808 11:37:16.703225 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:16.703231 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:16.708610 (+ 5379us) server_negotiation.cc:407] Connection header received
0808 11:37:16.709003 (+ 393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:16.709012 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:16.709118 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:16.709193 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:37:16.720021 (+ 10828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:16.721237 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:16.723262 (+ 2025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:16.723910 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:16.724012 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:16.724652 (+ 640us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:37:16.724794 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:37:16.724876 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:16.725131 (+ 255us) server_negotiation.cc:299] Negotiation successful
0808 11:37:16.725221 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 11:37:16.728229 18751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 11:37:16.702698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36846 (local address 127.26.66.190:41477)
0808 11:37:16.715533 (+ 12835us) server_negotiation.cc:206] Beginning negotiation
0808 11:37:16.715540 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 11:37:16.715559 (+ 19us) server_negotiation.cc:407] Connection header received
0808 11:37:16.715685 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 11:37:16.715692 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 11:37:16.716053 (+ 361us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 11:37:16.716906 (+ 853us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 11:37:16.717128 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:16.718232 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:16.720962 (+ 2730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 11:37:16.724815 (+ 3853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 11:37:16.726121 (+ 1306us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 11:37:16.726420 (+ 299us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 11:37:16.726974 (+ 554us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 11:37:16.727716 (+ 742us) server_negotiation.cc:1035] Waiting for connection context
0808 11:37:16.727777 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 11:37:16.727930 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12697,"thread_start_us":13205,"threads_started":1}
I20260808 11:37:16.733932 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 18372
I20260808 11:37:16.735034 18437 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:37:16.888971 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 18372
I20260808 11:37:16.915603 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 18449
I20260808 11:37:16.916805 18513 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:37:17.026575 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 18449
I20260808 11:37:17.051005 26890 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu pid 18527
I20260808 11:37:17.052306 18592 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 11:37:17.159086 26890 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmiEqRe/build/asan/bin/kudu with pid 18527
2026-08-08T11:37:17Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5206 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (10307 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (372982 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST